mirror of
https://github.com/wassname/Open-Assistant.git
synced 2026-06-27 16:10:30 +08:00
Yannic Kilcher
1709dc0324
* very primitive implementation of inference * re-worked with security in mind * removed polling from clients * switched workers to websockets * implemented back and forth chats
OpenAssitant Inference
Preliminary implementation of the inference engine for OpenAssistant.
Development (you'll need multiple terminals)
Run a redis container (or use the one of the general docker compose file):
docker run --rm -it -p 6379:6379 redis
Run the inference server:
cd server
pip install -r requirements.txt
uvicorn main:app --reload
Run one (or more) workers:
cd worker
pip install -r requirements.txt
python __main__.py
Run the client:
cd text-client
pip install -r requirements.txt
python __main__.py