DescriptionThis AI tool simplifies the process of running machine learning models locally, enabling developers to easily deploy and interact with various models without extensive setup. Its user-friendly interface streamlines the integration of AI into applications.
Qwen3.5 is faster on Apple GPUs: the MLX engine now uses the model's MTP head for speculative decoding automatically
/v1/chat/completions streaming now matches OpenAI's wire format: role only on the first chunk, finish_reason on its own chunk, and usage in a separate chunk with stream_options.include_usage.
Truncated OpenAI responses now report finish_reason: "length" instead of "tool_calls".
...
Qwen3.5 is faster on Apple GPUs: the MLX engine now uses the model's MTP head for speculative decoding automatically
/v1/chat/completions streaming now matches OpenAI's wire format: role only on the first chunk, finish_reason on its own chunk, and usage in a separate chunk with stream_options.include_usage.
Truncated OpenAI responses now report finish_reason: "length" instead of "tool_calls".
...
Qwen3.5 is faster on Apple GPUs: the MLX engine now uses the model's MTP head for speculative decoding automatically
/v1/chat/completions streaming now matches OpenAI's wire format: role only on the first chunk, finish_reason on its own chunk,
and usage in a separate chunk with stream_options.include_usage.
Truncated OpenAI responses now report finish_reason: "length" instead of "tool_calls".
...