wassname/Open-Assistant
1
0
Fork 0
mirror of https://github.com/wassname/Open-Assistant.git synced 2026-07-01 16:50:12 +08:00
Code Issues Packages Projects Releases Wiki Activity
2,181 Commits 1 Branch 0 Tags
aaa1276baec0fcf3da4262e3420bf64d8a546b75
Commit Graph

4 Commits

Author SHA1 Message Date
Yannic Kilcher 4076afd0d8 added token buffer for catchiing stop sequences 2023-02-09 23:46:44 +01:00
Yannic Kilcher ed7d920e5d robustifying inference 2023-02-09 15:31:46 +01:00
Yannic Kilcher bab056a73b switched to HF text-generation-inference 2023-02-08 23:52:39 +01:00
Yannic Kilcher 1709dc0324 Initial implementation of the inference system (#869) 
* very primitive implementation of inference

* re-worked with security in mind

* removed polling from clients

* switched workers to websockets

* implemented back and forth chats
 2023-01-21 22:38:18 +01:00