Alan Jean
7961fe3b71
chore(inference): add docs about the containerized inference stack 📝
...
Fixes #913
2023-01-29 05:30:00 +04:00
Yannic Kilcher
f885e27961
added horizontal layout to inference dev setup
2023-01-29 00:37:28 +01:00
Yannic Kilcher
45a4b09eae
added setup instructions to readme
2023-01-27 15:42:01 +01:00
Yannic Kilcher
ae5d16f394
added a tmux inference dev setup script
2023-01-27 15:40:21 +01:00
Yannic Kilcher
a0f4449e9f
added seed to parameters
2023-01-27 15:23:19 +01:00
Yannic Kilcher
040344a41f
made inference server a bit more robust
2023-01-26 21:01:52 +01:00
Yannic Kilcher
f1edcc8a28
added streaming worker
2023-01-26 16:41:57 +01:00
Yannic Kilcher
1709dc0324
Initial implementation of the inference system ( #869 )
...
* very primitive implementation of inference
* re-worked with security in mind
* removed polling from clients
* switched workers to websockets
* implemented back and forth chats
2023-01-21 22:38:18 +01:00