Firstly, thanks for the great hard work.
I have tried this and it is working fine for small chatting mechanism.
But when I want to use it with agents, it doesn't work since agent may send many contents in the user message.
To achieve this, it still needs many changes or maybe flow refactoring for some reasons:
- The request handler only allowing text as a user message content
- Only last user message is processed, any previous items in the messages except
type=system are ignored.
- Enforcing to build messages based on server history, any system message and last user message upon sending to the model provider.
I am not experienced in python, so I wish it is possible to implement this. Thanks.
Firstly, thanks for the great hard work.
I have tried this and it is working fine for small chatting mechanism.
But when I want to use it with agents, it doesn't work since agent may send many contents in the user message.
To achieve this, it still needs many changes or maybe flow refactoring for some reasons:
type=systemare ignored.I am not experienced in python, so I wish it is possible to implement this. Thanks.