mirror of https://github.com/wassname/Open-Assistant.git synced 2026-06-27 16:10:30 +08:00

Files

T

Yannic Kilcher 90c3d5640e Added database to inference server (#1446 )

* added db for inference

* fixed dockerfiles for inference

2023-02-10 22:51:35 +01:00

alembic

Added database to inference server (#1446 )

2023-02-10 22:51:35 +01:00

oasst_inference_server

Added database to inference server (#1446 )

2023-02-10 22:51:35 +01:00

alembic.ini

Added database to inference server (#1446 )

2023-02-10 22:51:35 +01:00

main.py

Added database to inference server (#1446 )

2023-02-10 22:51:35 +01:00

README.md

Initial implementation of the inference system (#869 )

2023-01-21 22:38:18 +01:00

requirements.txt

Added database to inference server (#1446 )

2023-02-10 22:51:35 +01:00

README.md

OpenAssistant Inference Server

Workers communicate with the /work endpoint via Websocket. They provide their configuration and if a task is available, the server returns it. The worker then performs the task and returns the result in a streaming fashion to the server, also via websocket.

Clients first call /chat to make a new chat, then add to that via /chat/<id>/message. The response is a SSE event source, which will send tokens as they are available.