Ollama 0.40.11 Highlights Local Speech and d3 Decisions

Published · AI Daily — AI-assisted deep research, methodology & disclosure

Ollama's October 24 v0.40.11 release notes highlight streaming speech on macOS and d3 decision models in 2B, 4B, 9B and 27B sizes. The speech guide documents Phonon and an OpenAI-compatible audio endpoint, while d3 supports scored choices and yes-or-no decisions. The guide says speech works from v0.40.9, so the patch should not be described as its first appearance.

What the October 24 Ollama release highlights

Ollama published v0.40.11 on October 24. Its release notes highlight two practical capabilities: local speech generation on macOS and access to the d3 family of decision models. This is a release of an existing open-source runtime, not evidence that all of its new model paths work on every operating system. The speech guide itself says to run Ollama v0.40.9 or later, so the v0.40.11 notes should be read as the current release's spotlight rather than proof that speech first appeared in this exact patch. Ollama's examples use the Phonon model for text-to-speech and expose an OpenAI-compatible audio endpoint for applications.

Speech has a streaming path and a bounded input

The official guide says generated sound can begin playing before the entire text is spoken. In a terminal, `ollama run phonon` can read a literal prompt, standard input or a chat model's answer. If output is redirected, the command writes a WAV file rather than playing through speakers. The same server exposes `/v1/audio/speech`; an application can request WAV or raw PCM and consume the stream incrementally. Both formats are documented as mono, 16-bit audio at 24 kHz. The WAV header's size fields use a maximum value because the stream length is unknown when the header is sent. That detail matters to clients that assume a conventional final length before playback or storage.

The request limit is 4,096 input characters. Ollama says its command-line path splits longer text at paragraph and sentence boundaries, while an API client must plan around the per-request bound. Unsupported speed, format or instruction options return HTTP 400, and unknown voices are rejected with a list of available voices. A speech model does not answer chat or embedding requests through the normal model endpoints. Those failure behaviors should be included in integration tests, because an OpenAI-compatible URL does not mean every option from a remote speech service is implemented. Phonon uses a Gradium 31M English checkpoint and English voices; the guide does not claim broad multilingual voice quality.

What d3 is for

The release notes also point to d3, a family derived from vLLM Semantic Router's decision models. They list 2B, 4B, 9B and 27B sizes. The advertised task is not open-ended conversation; it is to take text, structured state or an image and return a scored choice, a yes-or-no judgment, or ratings. The model library shows a `systemone` request carrying a state and named questions, with explicit true and false criteria in its example. This can turn a routing rule, review triage or classification decision into a structured response. It still needs a clear rubric and evaluation data, just as a conventional classifier does.

Scores require calibration against a real workflow

If a team asks d3 whether a customer message concerns billing, the output may be useful for dispatching a ticket. It is not automatically a calibrated probability of business harm, fraud or customer intent. The release notes provide model sizes and capability examples, not a domain-specific calibration study. A production pilot should label a representative held-out sample, compare d3 with a simple rules baseline, and record precision, recall, latency and cost at the decision threshold. Cases with mixed intent or missing context deserve separate error analysis. If an image is supplied, test image quality and privacy obligations; accepting an image input does not verify a particular organization's data rights.

The practical attraction is local control. A small decision model can be deployed near the application rather than calling a general chat model for every yes-or-no question. Whether that is faster or cheaper depends on hardware, batch size and the work needed to keep the runtime running. Ollama's library lists multiple sizes, so a fair comparison holds the input set and rubric constant while changing model size. A larger d3 checkpoint may improve a task but also increase memory and latency. The release page alone does not publish a universal winner for every use case.

What an implementer should verify

For speech, start with a short English passage and check that the expected model is pulled, the selected voice exists, audio starts before generation ends, and saved output decodes with the target player. Then test a long paragraph, a numeric price and an unsupported parameter. The guide notes that text normalization spells out prices, numbers and URLs, while dates are read as written. That can change what a listener hears compared with what the application displays, so accessibility or regulated messaging needs human review. Test the application path separately from terminal playback, especially when the server is remote and the speaker belongs to the client machine.

For decisions, define the labels before asking the model and save the exact prompts, criteria and model tag used in evaluation. Keep ambiguous cases for human review instead of interpreting every score as permission for an irreversible action. The two capabilities occupy different parts of an agent system: speech is an output channel, while d3 is a narrow decision component. Both can be useful in a local workflow, but the v0.40.11 release notes are a starting point for testing, not a substitute for observed reliability. This article appears in the October 25 issue; the version's GitHub release timestamp is October 24 UTC, and the speech documentation has its own broader version requirement.

Sources

FAQ

What does Ollama v0.40.11 highlight for local applications?

The October 24 release highlights speech generation on macOS and access to d3 decision models. Speech can play incrementally in a terminal or stream through an OpenAI-compatible audio endpoint. The d3 family scores structured choices and yes-or-no questions. The speech guide supports v0.40.9 onward, so this patch is not necessarily the feature's first release.

What limits matter when integrating Ollama speech?

The guide limits each speech API input to 4,096 characters and documents WAV or raw PCM as mono 16-bit audio at 24 kHz. Unsupported options return HTTP 400. A developer should test streaming playback, long text, voice selection and remote-server behavior with the actual client before relying on the endpoint in a production workflow.

Can d3 scores authorize automated actions on their own?

A d3 score is a model output for a defined question, not a universal probability of harm or business value. Teams should label held-out examples, compare against a simple baseline, inspect ambiguous cases and keep irreversible actions behind an appropriate human or policy gate. The release does not publish calibration results for every domain.