feat(llm): add Mistral as an LLM provider by Rishabh-git10 · Pull Request #562 · dapr/dapr-agents

Rishabh-git10 · 2026-04-08T17:33:10Z

Description

Adds MistralChatClient to natively support Mistral as an LLM provider via the mistralai SDK. This allows users to configure custom endpoints and utilize multimodal features that are not supported by the generic Conversation API.

Changes included:

Implemented MistralClientBase and MistralChatClient.
Added fallback logic to use the MISTRAL_MODEL environment variable.
Exported the client in dapr_agents/llm/__init__.py.
Added mistralai to project dependencies (supports SDK v2 with v1 fallback).
Added unit tests in tests/llm/test_mistral.py.

Issue reference

Closes #230

Checklist

Please make sure you've completed the relevant tasks for this PR, out of the following list:

Created/updated tests
Tested this change against all the quickstarts
Extended the documentation
- Created the dapr/docs PR: docs(agents): add MistralChatClient to supported LLMs docs#5108

Note: We expect contributors to open a corresponding documentation PR in the dapr/docs repository. As the implementer, you are the best person to document your work! Implementation PRs will not be merged until the documentation PR is opened and ready for review.

sicoyle · 2026-04-08T18:54:34Z

Hi 👋 Thank you for your contribution and interest in Dapr Agents 🎉 Can you pls run these commands to make the DCO build step happy:


In your local branch, run: git rebase HEAD~2 --signoff
Force push your changes to overwrite the branch: git push --force-with-lease origin issue-230-mistral-client

Also, if you use git commit -sm "<commit msg>" then it will include your signoff :)

sicoyle · 2026-04-08T18:57:30Z

also, thank you so much for already opening the docs PR - that's amazing!! Also, we have pre-commit hooks for our repo to help avoid linter/build failures at CI time. There should be docs in the dev docs section of the repo with info on this :) It's under docs/development/README.md in the "Pre-Push Hooks" section.

Copilot

Pull request overview

Adds a native Mistral LLM provider to dapr_agents.llm via the mistralai SDK, exposing a MistralChatClient and wiring it into the package exports so users can select Mistral as a first-class provider.

Changes:

Introduces MistralClientBase + MistralChatClient with env-var model fallback (MISTRAL_MODEL).
Exports MistralChatClient from dapr_agents/llm/__init__.py and adds the mistralai dependency.
Adds initial unit tests for initialization and basic generate() behavior.

Reviewed changes

Copilot reviewed 6 out of 7 changed files in this pull request and generated 11 comments.

Show a summary per file

File	Description
`dapr_agents/llm/mistral/client.py`	Adds the provider base client wrapper around the `mistralai` SDK client creation.
`dapr_agents/llm/mistral/chat.py`	Implements the Mistral chat client and hooks into shared request/response utilities.
`dapr_agents/llm/mistral/__init__.py`	Exposes Mistral client classes at the package level.
`dapr_agents/llm/__init__.py`	Re-exports `MistralChatClient` as part of the public LLM API surface.
`tests/llm/test_mistral.py`	Adds unit tests for env model fallback and a mocked generate() call.
`pyproject.toml`	Adds `mistralai>=2.2.0` to runtime dependencies.
`uv.lock`	Locks `mistralai` (and transitive deps) into the resolved dependency set.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Rishabh-git10 · 2026-04-09T08:10:36Z

Hi @sicoyle, thanks for the guidance! Pre-commit hooks are run, files are formatted, and all commits are now signed off.

I've also addressed the Copilot review:

Added missing Apache 2.0 license headers.
Fixed the Pydantic schema mapping for LLMChatResponse.
Raised NotImplementedError for unsupported features (streaming, tools).

One question regarding from_prompty: Dapr's core PromptyModelConfig doesn't currently accept mistral as a valid type. I've temporarily raised a NotImplementedError to prevent upstream validation crashes. Would you prefer we expand the core types to fully support Mistral Prompty in this PR, or should we tackle that in a follow-up?

Ready for another look!

CasperGN · 2026-04-13T08:16:20Z

~~@Rishabh-git10 looks like there's 3 files still missing the license header :-)~~

Edit: Scratch that, UI just didn't show

CasperGN · 2026-04-13T08:21:52Z

+            values["model"] = env_model
+        elif not values.get("model"):
+            values["model"] = "mistral-large-latest"
+        return values


Make sure this is well documented in dapr-docs but also that docstring reflect this for consumers of the MistralChatClient

Done!

Added class and method docstrings to MistralChatClient.

Updated the dapr/docs PR to document the MISTRAL_MODEL fallback inline on the Core Concepts page.

sicoyle

two final comments from me pls and then this is g2g - thank you! 🚀 @CasperGN do you have any other feedback here by chance?

sicoyle · 2026-04-14T18:45:27Z

+try:
+    # Mistral SDK v1.x
+    from mistralai import Mistral
+except ImportError:
+    try:
+        # Mistral SDK v2.x
+        from mistralai.client import Mistral
+    except ImportError:
+        # Mistral SDK v0.x (Fallback)
+        from mistralai.client import MistralClient as Mistral


the pyproject toml file pins to v2.X.X. Can you pls rm the fallback and try/except setup here and just keep the import sitting alongside the other imports for logging, typing and such above? That way it's consistent too with the imports setup that the other LLM provider clients use :)

sicoyle · 2026-04-14T18:46:33Z

One question regarding from_prompty: Dapr's core PromptyModelConfig doesn't currently accept mistral as a valid type. I've temporarily raised a NotImplementedError to prevent upstream validation crashes. Would you prefer we expand the core types to fully support Mistral Prompty in this PR, or should we tackle that in a follow-up?

This is great! Full Mistral Prompty support can be done in a follow up PR :)

Rishabh-git10 · 2026-04-15T08:37:17Z

@sicoyle I've made both requested changes. I'll tackle the full Mistral Prompty support in a follow-up PR after this merges. Thanks!

sicoyle

This is great - thank you so much for your contribution! 🙌

Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com>

Rishabh-git10 · 2026-04-25T19:36:20Z

@sicoyle @CasperGN
Rebased against main to resolve the uv.lock conflict.
Please check!

yaron2 · 2026-04-30T13:58:30Z

Please resolve the conflicts and we can then merge

Signed-off-by: Casper Nielsen <casper@diagrid.io>

CasperGN · 2026-04-30T14:39:54Z

I did not mean to re-request Copilot. Disregard whatever it may find. The PR is GTG 🚀

sicoyle

thank you so much!

Copilot

Pull request overview

Copilot reviewed 7 out of 8 changed files in this pull request and generated 5 comments.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

+        env_model = os.environ.get("MISTRAL_MODEL")
+        if env_model:
+            values["model"] = env_model
+        elif not values.get("model"):
+            values["model"] = "mistral-large-latest"


+            return LLMChatResponse(
+                id=resp.id,
+                model=resp.model,
+                results=[
+                    {


+from mistralai.client import Mistral
+
+from dapr_agents.llm.base import LLMClientBase
+from dapr_agents.types.llm import MistralClientConfig


+    client = MistralChatClient()
+    assert client.model == "mistral-large-latest"


    "wrapt>=1.14.0,<2.0.0",
    "openinference-instrumentation>=0.1.0,<1.0.0",
    "openinference-semantic-conventions>=0.1.0,<1.0.0",
+    "mistralai>=2.2.0",


* feat(llm): add Mistral as an LLM provider Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com> * test(llm): add unit tests for Mistral provider Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com> * fix(llm): address PR review feedback and formatting for Mistral Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com> * docs(llm): clarify Mistral model fallback behavior in docstrings Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com> * refactor(llm): simplify Mistral imports and add config class Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com> --------- Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com> Signed-off-by: Casper Nielsen <casper@diagrid.io> Co-authored-by: Casper Nielsen <casper@diagrid.io>

Rishabh-git10 requested review from a team as code owners April 8, 2026 17:33

sicoyle requested a review from Copilot April 8, 2026 18:53

Copilot started reviewing on behalf of sicoyle April 8, 2026 18:54 View session

Copilot AI reviewed Apr 8, 2026

View reviewed changes

Rishabh-git10 force-pushed the issue-230-mistral-client branch from aa82609 to 5a73f7e Compare April 9, 2026 07:57

CasperGN requested changes Apr 13, 2026

View reviewed changes

sicoyle mentioned this pull request Apr 14, 2026

Add native AnthropicChatClient provider (direct SDK, no Conversation API) #568

Closed

7 tasks

sicoyle requested changes Apr 14, 2026

View reviewed changes

sicoyle previously approved these changes Apr 15, 2026

View reviewed changes

sicoyle requested a review from CasperGN April 15, 2026 15:45

CasperGN previously approved these changes Apr 15, 2026

View reviewed changes

Rishabh-git10 added 5 commits April 25, 2026 19:31

feat(llm): add Mistral as an LLM provider

1225582

Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com>

test(llm): add unit tests for Mistral provider

085d371

Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com>

fix(llm): address PR review feedback and formatting for Mistral

d0e2ee3

Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com>

docs(llm): clarify Mistral model fallback behavior in docstrings

4eb6ddc

Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com>

refactor(llm): simplify Mistral imports and add config class

94084a0

Signed-off-by: Rishabh Dewangan <107680241+Rishabh-git10@users.noreply.github.com>

Rishabh-git10 dismissed stale reviews from CasperGN and sicoyle via 94084a0 April 25, 2026 19:32

Rishabh-git10 force-pushed the issue-230-mistral-client branch from cf00e55 to 94084a0 Compare April 25, 2026 19:32

Rishabh-git10 requested review from CasperGN and sicoyle April 25, 2026 19:37

CasperGN previously approved these changes Apr 27, 2026

View reviewed changes

yaron2 previously approved these changes Apr 30, 2026

View reviewed changes

Merge branch 'main' into issue-230-mistral-client

9f35124

Signed-off-by: Casper Nielsen <casper@diagrid.io>

CasperGN dismissed stale reviews from yaron2 and themself via 9f35124 April 30, 2026 14:36

CasperGN requested review from CasperGN, Copilot and yaron2 April 30, 2026 14:38

CasperGN approved these changes Apr 30, 2026

View reviewed changes

Copilot started reviewing on behalf of CasperGN April 30, 2026 14:39 View session

sicoyle approved these changes Apr 30, 2026

View reviewed changes

Copilot AI reviewed Apr 30, 2026

View reviewed changes

sicoyle merged commit aee7881 into dapr:main Apr 30, 2026
13 checks passed

Rishabh-git10 deleted the issue-230-mistral-client branch April 30, 2026 19:45

Rishabh-git10 mentioned this pull request May 1, 2026

feat(llm): implement Prompty support for MistralChatClient #593

Merged

4 tasks

		client = MistralChatClient()
		assert client.model == "mistral-large-latest"

Conversation

Rishabh-git10 commented Apr 8, 2026

Description

Issue reference

Checklist

Uh oh!

sicoyle commented Apr 8, 2026

Uh oh!

sicoyle commented Apr 8, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Rishabh-git10 commented Apr 9, 2026

Uh oh!

CasperGN commented Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

CasperGN Apr 13, 2026

Choose a reason for hiding this comment

Uh oh!

Rishabh-git10 Apr 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

sicoyle left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

sicoyle Apr 14, 2026

Choose a reason for hiding this comment

Uh oh!

sicoyle commented Apr 14, 2026

Uh oh!

Rishabh-git10 commented Apr 15, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sicoyle left a comment

Choose a reason for hiding this comment

Uh oh!

Rishabh-git10 commented Apr 25, 2026

Uh oh!

yaron2 commented Apr 30, 2026

Uh oh!

CasperGN commented Apr 30, 2026

Uh oh!

sicoyle left a comment

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

CasperGN commented Apr 13, 2026 •

edited

Loading

Rishabh-git10 Apr 13, 2026 •

edited

Loading

Rishabh-git10 commented Apr 15, 2026 •

edited

Loading