Before you start
Applies to
Desktop app
What problem does this solve
When a request does not include sampling parameters, generation uses defaults configured when the model server starts. The Windows client does not show those defaults, so users cannot tell which values are active or adjust them from the client. This makes it harder to understand or control generation behavior compared with clients such as LM Studio.
Proposed solution
Add a sampling section to the Windows client that displays the active model/server defaults for Temperature, Top P, Top K, Min P, Repetition Penalty, and Presence Penalty. Allow the calling client to override these values for a request, and indicate whether each effective value comes from the model/server default or a request-level override. If a request omits a parameter, use the configured model/server default.
Alternatives considered
Keep sampling defaults hidden in the model startup configuration and require users to inspect or change server settings outside the Windows client. This does not make the active values visible to users of the client.
Before you start
Applies to
Desktop app
What problem does this solve
When a request does not include sampling parameters, generation uses defaults configured when the model server starts. The Windows client does not show those defaults, so users cannot tell which values are active or adjust them from the client. This makes it harder to understand or control generation behavior compared with clients such as LM Studio.
Proposed solution
Add a sampling section to the Windows client that displays the active model/server defaults for Temperature, Top P, Top K, Min P, Repetition Penalty, and Presence Penalty. Allow the calling client to override these values for a request, and indicate whether each effective value comes from the model/server default or a request-level override. If a request omits a parameter, use the configured model/server default.
Alternatives considered
Keep sampling defaults hidden in the model startup configuration and require users to inspect or change server settings outside the Windows client. This does not make the active values visible to users of the client.