Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No response for a long time after running the PoeServer #214

Closed
cherishleon opened this issue Jan 12, 2025 · 2 comments
Closed

No response for a long time after running the PoeServer #214

cherishleon opened this issue Jan 12, 2025 · 2 comments

Comments

@cherishleon
Copy link

cherishleon commented Jan 12, 2025

Built-in completion (WIP)
OpenAI Proxy Server
Start the server
from poe_api_wrapper import PoeServer
tokens = [
{"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"},
{"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"},
{"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"}
]
PoeServer(tokens=tokens)

When running the above code, it remains unresponsive for a long time
image

Also when running api.py
return ORJSONResponse(content.model_dump())
AttributeError: 'ChatCompletionResponse' object has no attribute 'model_dump'

@snowby666
Copy link
Owner

Built-in completion (WIP) OpenAI Proxy Server Start the server from poe_api_wrapper import PoeServer tokens = [ {"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"}, {"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"}, {"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"} ] PoeServer(tokens=tokens)

When running the above code, it remains unresponsive for a long time image

Also when running api.py return ORJSONResponse(content.model_dump()) AttributeError: 'ChatCompletionResponse' object has no attribute 'model_dump'

Your image shows the api running normally.

And why did you even run the api.py?

The api is up and the base url is 127.0.0.1:7000

After this just use openai library to interact with the proxy server.

@cherishleon
Copy link
Author

Built-in completion (WIP) OpenAI Proxy Server Start the server from poe_api_wrapper import PoeServer tokens = [ {"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"}, {"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"}, {"p-b": "XXXXXXXX", "p-lat": "XXXXXXXX"} ] PoeServer(tokens=tokens)
When running the above code, it remains unresponsive for a long time image
Also when running api.py return ORJSONResponse(content.model_dump()) AttributeError: 'ChatCompletionResponse' object has no attribute 'model_dump'

Your image shows the api running normally.

And why did you even run the api.py?

The api is up and the base url is 127.0.0.1:7000

After this just use openai library to interact with the proxy server.

i fixed it by upgrade pydantic, thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants