Commit Graph
4 Commits
Author SHA1 Message Date
Yannic Kilcher d1aea98ad5 added dockerfile for worker-full 2023-02-10 22:53:40 +01:00
Yannic Kilcher 4076afd0d8 added token buffer for catchiing stop sequences 2023-02-09 23:46:44 +01:00
Yannic Kilcher f1edcc8a28 added streaming worker 2023-01-26 16:41:57 +01:00
Yannic KilcherandGitHub 1709dc0324 Initial implementation of the inference system (#869)
* very primitive implementation of inference

* re-worked with security in mind

* removed polling from clients

* switched workers to websockets

* implemented back and forth chats
2023-01-21 22:38:18 +01:00