v0.40.8: mlx: add Flint model support (#19181)
Article image or reusable cover for Ollama
Preserve source tool JSON alongside decoded API values so Flint can retain numeric types and schema order in prompts.
Existing API marshaling is unchanged. Assemble ModelOpt expert banks during safetensors import, and reject direct Flint NVFP4 creation before conversion. Other models retain their existing import and quantization paths. Add optional learned sinks and device causal masks to shared MLX attention. Existing callers retain the no-sink and host-mask paths; Flint opts into the new behavior.
The text is the source's own description of its publication. The content belongs to Ollama.
More from Ollama
v0.40.11
Ollama 24 Oct
v0.40.11: voice: add voice catalog for Phonon (#19242)
Ollama 24 Oct
Outside of tech there has been no financial payoff to US companies for using AI, now viewed as a margin-hurting cost center, as VC-backed firms burn more tokens
Techmeme 4 h ago
Source: Replit recently moved most AI spend from Anthropic to OpenAI, which gave 30%+ off in a deal worth $100M+/year, after Anthropic discontinued its discount
Techmeme 6 h ago