Commit Graph

8 Commits

Author SHA1 Message Date
Alan Jean 7961fe3b71 chore(inference): add docs about the containerized inference stack 📝
Fixes #913
2023-01-29 05:30:00 +04:00
Yannic Kilcher f885e27961 added horizontal layout to inference dev setup 2023-01-29 00:37:28 +01:00
Yannic Kilcher 45a4b09eae added setup instructions to readme 2023-01-27 15:42:01 +01:00
Yannic Kilcher ae5d16f394 added a tmux inference dev setup script 2023-01-27 15:40:21 +01:00
Yannic Kilcher a0f4449e9f added seed to parameters 2023-01-27 15:23:19 +01:00
Yannic Kilcher 040344a41f made inference server a bit more robust 2023-01-26 21:01:52 +01:00
Yannic Kilcher f1edcc8a28 added streaming worker 2023-01-26 16:41:57 +01:00
Yannic Kilcher 1709dc0324 Initial implementation of the inference system (#869)
* very primitive implementation of inference

* re-worked with security in mind

* removed polling from clients

* switched workers to websockets

* implemented back and forth chats
2023-01-21 22:38:18 +01:00