Commit Graph

1605 Commits

Author SHA1 Message Date
Andrew Maguire 0f607c7a28 export and auto-commit docs/docs/api/openapi.json as part of test-api-contract workflow (#719)
- copies that openapi.json file to docs/docs/api/openapi.json as part of start-mock-server.sh.
- adds a step to the end of the test-api-contract workflow that just auto-commits changes to the docs/docs/api/openapi.json file.
- excludes docs/docs/api/openapi.json from pre-commit since its already been formatted by jq.
2023-01-14 22:40:33 +00:00
Yannic Kilcher 885065adec added an init to datasets templates 2023-01-14 23:20:25 +01:00
rallio a203900070 A notebook for question and answer generation using one of the most powerful opensource NLU models, FLAN-T5-11B. (#215)
* Create T5_closed_book_QA_generators.py

This is code that can be run in a notebook or by itself to generate a dictionary for use in creating synthetic dialogue that can be verified for factual accuracy. To use this notebook your need your trusted source material to be in the format of a list of strings (they will be truncated to under 1100 characters). Requires transformers and accelerate. Make sure to use T5 with bfloat16 or full precision.

* Create T5_closed_book_QA_generators.py

* Create T5_closed_book_QA_generators.md

* Delete T5_closed_book_QA_generators.py

Moved to proper folder structure

* fixed pre-commit issues

Co-authored-by: Yannic Kilcher <yk@users.noreply.github.com>
2023-01-14 22:16:54 +00:00
Hyper 3f5ba8940e Pin python package versions (#606)
* Pin python package versions

* Fix CI
2023-01-14 22:41:46 +01:00
Andrew Maguire a9578e5404 create "Tasks" section on docs site (#715)
create tasks section in docs site
2023-01-14 22:39:38 +01:00
Andrew Maguire b44305dfbd CONTRIBUTING.md - add some notes about feature branches (#659)
- try nudge people towards using a feature branch in their fork instead of their main.
- add note about squash and merge,
- link to an example PR as a sort of reference.
- add a "Tips" section with some tips.
2023-01-14 22:36:53 +01:00
Yannic Kilcher bf66b2a890 fixed workflow 2023-01-14 22:10:39 +01:00
Yannic Kilcher f20594f52f fixed workflow 2023-01-14 22:02:13 +01:00
Yannic Kilcher 6430112dfc fixed workflow 2023-01-14 21:47:35 +01:00
Yannic Kilcher 17920e4e66 fixed workflow 2023-01-14 21:39:10 +01:00
Yannic Kilcher 105ff87aed inheriting secrets to deploy 2023-01-14 20:45:43 +01:00
Yannic Kilcher ddae13cf3b fixed workflow 2023-01-14 20:24:23 +01:00
Yannic Kilcher e642a6d826 fixed workflow 2023-01-14 20:12:04 +01:00
Yannic Kilcher 493947fddd Merge branch 'main' of github.com:LAION-AI/Open-Chat-GPT 2023-01-14 20:06:32 +01:00
Yannic Kilcher 39cf2cf6db added deploy workflow 2023-01-14 20:06:27 +01:00
kayjay 5cd9c630fc Small typo fix + Consistent Docstrings (#698)
* Small typo fix + Consistent Docstrings

Also removed a redundant comment.

* undo comment removal

* Fixed indentation from previous commit
2023-01-14 17:24:02 +01:00
notmd 138396a662 fix: improve FlaggableElement UI on mobile 2023-01-14 23:16:19 +07:00
Andreas Köpf 6547058778 add rank to message table and fix message_toxicity migration 2023-01-14 15:12:10 +01:00
klotske feba2de20c Bring back the NextLink 2023-01-14 15:49:33 +03:00
Nil Andreu a902c600fa Store Message Toxicity in database (#553)
* [NEW] MessageToxicity table

* [NEW] Alembic message Toxicity

* [NEW] Model name enum

* [NEW] Refactor Enum HF

* [NEW] Settings: DEBUT_SKIP_TOXICITY_CALCULATION

* [NEW] Store toxicity values

* [FIX] Merge conflict

* [FIX] Documentation

* [NEW] save_toxicity: function

* [FIX] Formatted string

* [NEW] DEBUG_SKIP_TOXICITY_CALCULATION=True

* [FIX] HfClassificationModel

* [FIX] Alembic merge heads

* [NEW] Refactor save_toxicity

* [NEW] Separating score/label

* [NEW] Store score and label

* [FIX] Cleaning Alembic

* [NEW] Clean HF names

* [NEW] Not type hinting

* [NEW] Update alembic versions

* [NEW] Revert the changes

* [NEW] Type hinting label & score

* Updated down_revision in migration script

Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2023-01-14 12:22:55 +00:00
theblackcat102 dbf8f77072 Merge pull request #699 from LAION-AI/sft-fixes
Fix supervised pretraining bugs and add new datasets
2023-01-14 20:20:12 +08:00
theblackcat102 670be60ca8 [fix] Fix config typo 2023-01-14 12:17:58 +00:00
Andreas Köpf 8b8326e22f add /by_display_name user query & created_date to FrontEndUser model 2023-01-14 11:03:25 +01:00
Valentino c36a7ae9da Add UnifiedQA datasets that are not in xP3 (#666)
* Add UnifiedQA datasets that are not in xP3
2023-01-14 09:57:22 +00:00
Keith Stevens b02429c1f7 Tag in the user table when they are new and include it in the user session 2023-01-14 18:55:28 +09:00
Keith Stevens 90e71f3da2 Merge pull request #702 from LAION-AI/labeling-fix
Fix full labelling task display
2023-01-14 18:14:33 +09:00
Keith Stevens 5282c11827 Adding an explicit type 2023-01-14 18:14:29 +09:00
AbdBarho 335218ba22 Fix full labeling task display 2023-01-14 09:51:12 +01:00
AbdBarho b22f11191f Merge pull request #703 from rsandb/Fix-Task-Card-Background-Color
fix task card background color
2023-01-14 09:48:19 +01:00
rsandb 2b3978200f fix task card background color 2023-01-14 02:41:37 -06:00
Keith Stevens 7de25f299c fixing a type error 2023-01-14 17:07:37 +09:00
Keith Stevens e1309b1d5a Adding some function comments 2023-01-14 17:05:24 +09:00
Keith Stevens 8203406fa1 Merging with main changes 2023-01-14 17:03:18 +09:00
Keith Stevens 58cbc50b31 Merge pull request #700 from LAION-AI/rank-fix
Fix submit of initial ranking
2023-01-14 17:02:09 +09:00
Keith Stevens 206ef80426 Merge pull request #695 from rsandb/Style-Empty-State-and-404
Style Empty State and 404
2023-01-14 17:01:27 +09:00
Keith Stevens ddfb497764 Fixing some lint errors and adding a TODO 2023-01-14 16:57:06 +09:00
Keith Stevens f9c8d1dd81 Combining the admin API routes with the backends user routes 2023-01-14 16:55:14 +09:00
Keith Stevens 713d38e601 Merge pull request #577 from LAION-AI/messages
Simplify messages page
2023-01-14 16:23:29 +09:00
rsandb 36f67abfaf Merge branch 'Style-Empty-State-and-404' of https://github.com/rsandb/Open-Assistant into Style-Empty-State-and-404 2023-01-14 01:19:28 -06:00
rsandb d052d676cc add report button 2023-01-14 01:19:09 -06:00
rsandb a4522b97af Style Empty State and 404 2023-01-14 01:17:17 -06:00
AbdBarho 3b4955ff1c Merge pull request #692 from LAION-AI/672-live-leaderboards
Udpating the leaderboard components to use real data
2023-01-14 08:11:43 +01:00
AbdBarho 1c34f8201c Simplify messages page 2023-01-14 08:10:41 +01:00
AbdBarho cc1078616f Merge pull request #693 from rsandb/Messages-Styling-For-Mobile
Message Styling For Mobile
2023-01-14 08:07:48 +01:00
AbdBarho 22bc9c2730 Fix initial Ranking 2023-01-14 08:03:19 +01:00
rsandb e8a1a16b45 move component into EmptyState 2023-01-14 01:01:30 -06:00
Keith Stevens 7319145860 Merge pull request #694 from rsandb/User-Menu-Overhaul
Update UserMenu
2023-01-14 15:56:46 +09:00
rsandb b4d6d93da3 remove FAQ page 2023-01-14 00:48:32 -06:00
theblackcat102 6f6c590e57 [fix] Disable task specific evaluation 2023-01-14 06:47:21 +00:00
rsandb 3950f6e780 Fixed tooltip not showing on hover 2023-01-14 00:46:25 -06:00