Commit Graph

3 Commits

Author SHA1 Message Date
Yannic Kilcher 48212079f4 unified queueing 2023-02-11 01:31:25 +01:00
Yannic Kilcher 90c3d5640e Added database to inference server (#1446)
* added db for inference

* fixed dockerfiles for inference
2023-02-10 22:51:35 +01:00
Yannic Kilcher 4076afd0d8 added token buffer for catchiing stop sequences 2023-02-09 23:46:44 +01:00