-
Notifications
You must be signed in to change notification settings - Fork 167
Description
Code I had yesterday that functioned quit working today. This could be an inference endpoint change for mistral-large-latest but I figured I would list it here as well as it is probably easier (as in $$$) to fix the client rather than the endpoint.
This is easily reproduced with the function calling example in this repository. A simple cut and paste will do. That example and other function calling code produces:
"
pydantic_core._pydantic_core.ValidationError: 1 validation error for ChatCompletionResponse
choices.0.finish_reason
Input should be 'stop', 'length', 'error' or 'tool_calls' [type=enum, input_value='tool_call', input_type=str]
"
Where the endpoint is sending "tool_call" (singular) and the client is expecting an enum of "tool_calls" (plural) . Yesterday, (29 Feb 2024) all was well and the code worked fine. Was there an endpoint update?