Commit Graph
4 Commits
Author SHA1 Message Date
Rohit C Prasad db6e0af7eb Add Jan, Docker Model Runner and mlx-lm as local server providers
Same shape as llama.cpp/vLLM/LM Studio: address + optional key, models from the server.
Docker's /engines path is added when the user types the root; mlx-lm's help covers the port shared with llama.cpp.
Local-server checks now read LOCAL_SERVERS instead of a hand-kept tuple.
2026-10-26 11:10:29 -07:00
Rohit C Prasad 45d58dc9a5 Add LM Studio as a local server provider
Joins llama.cpp and vLLM: address + optional key, window from its own listing.
Based on #434 by zalex666: name, model and help text.
2026-10-25 20:55:44 -07:00
Rohit C Prasad 833bb291d2 Reasoning effort and thinking controls beside the model
A per-model table says whether a model has a thinking switch and which effort levels;
the composer shows a grey effort slider and a brain switch only when the model has them.
llama.cpp and vLLM get thinking as enable_thinking; the provider JSON tables ship in the package.
2026-10-06 11:49:22 -07:00
Devika Verma 514c0beb37 llama.cpp and vLLM as providers
Each is a provider of its own with an address and an optional key; the served model, its window and tool support are read from the server (vLLM is probed for tool calling).
Providers carry a kind (local, subscription, api_key) for the settings page; docs/local-servers.md.
2026-10-05 19:49:34 -07:00