-
Notifications
You must be signed in to change notification settings - Fork 353
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Help: can't run roulette_wheel with DeepSeek model #654
Comments
Hi @ME-Msc , I believe the error you encountered is related to the issue described in #149. It seems to arise in scenarios where the model is tasked with generating a chunk that includes both a function call and standard content. Specifically, in your case, the ChatCompletionChunk contains a tool_call (indicating a function call to roulette_wheel) but lacks accompanying content or a well-structured response. At this stage, it appears that OpenAIStreamTextResponse class do not fully handle this particular case—when a chunk contains both a function_call and standard content. This behavior has been identified as a limitation in the current implementation. From what I understand, there is an ongoing refactor of the class behavior (in this PR #468) that could address this issue and should potentially resolve similar problems where mixed outputs are expected in a single chunk. |
@samihamine Thanks for your help! I believe many people have encountered this error, and I will continue to monitor this issue. Additionally, I would like to suggest that the error message be raised more explicitly and clearly so that newcomers like me can quickly identify the problem. |
I am trying to run roulette_wheel with DeepSeek model.
I followed the doc.
The only code I add is
And I changed the model of roulette_agent
I met an error at
async with roulette_agent.run_stream
in main().Could anyone tell me why it happened? Did I call the model in the wrong way?
I think @imfing may know, could you help me with a complete example of roulette_wheel?
The text was updated successfully, but these errors were encountered: