v0.40.8: mlx: add Flint model support (#19181)
Artikelbild eller återanvändbart omslag för Ollama
Preserve source tool JSON alongside decoded API values so Flint can retain numeric types and schema order in prompts.
Existing API marshaling is unchanged. Assemble ModelOpt expert banks during safetensors import, and reject direct Flint NVFP4 creation before conversion. Other models retain their existing import and quantization paths. Add optional learned sinks and device causal masks to shared MLX attention. Existing callers retain the no-sink and host-mask paths; Flint opts into the new behavior.
Texten är källans egen beskrivning av publiceringen. Innehållet tillhör Ollama.
Mer från Ollama
v0.40.11
Ollama 24 okt.
v0.40.11: voice: add voice catalog for Phonon (#19242)
Ollama 24 okt.
Outside of tech there has been no financial payoff to US companies for using AI, now viewed as a margin-hurting cost center, as VC-backed firms burn more tokens
Techmeme för 3 tim sedan
Source: Replit recently moved most AI spend from Anthropic to OpenAI, which gave 30%+ off in a deal worth $100M+/year, after Anthropic discontinued its discount
Techmeme för 5 tim sedan