Commit Graph
3 Commits
Author SHA1 Message Date
Yannic KilcherandGitHub 90c3d5640e Added database to inference server (#1446)
* added db for inference

* fixed dockerfiles for inference
2023-02-10 22:51:35 +01:00
Andrew MaguireandGitHub b60eb1e1ae minimal fastapi prom metrics (#1426)
* minimal fastapi prom metrics
2023-02-10 14:37:43 +01:00
Yannic KilcherandGitHub 1709dc0324 Initial implementation of the inference system (#869)
* very primitive implementation of inference

* re-worked with security in mind

* removed polling from clients

* switched workers to websockets

* implemented back and forth chats
2023-01-21 22:38:18 +01:00