Commit Graph

1429 Commits

Author SHA1 Message Date
Keith Stevens e01f2eb4ab Merge pull request #737 from notmd/user_menu_fix
use `NextLink` for `UserMenu` option and cleanup
2023-01-15 20:02:55 +09:00
Tom Zehle 30d7a3d0f5 Added Codeinstructor, fixed file-reading issue, and allowing for csv files in data_augment.py (#679) 2023-01-15 11:55:40 +01:00
notmd 042c151e77 hide user score for now 2023-01-15 17:35:30 +07:00
notmd 8731ded1e0 Merge remote-tracking branch 'origin/main' into user_menu_fix 2023-01-15 17:34:14 +07:00
notmd c01a4fa345 use NextLink for UserMenu option and cleanup 2023-01-15 17:23:46 +07:00
Keith Stevens 112ad5cd44 Merge pull request #730 from LAION-AI/394-show-privacy-links
Ensuring the user can find the privacy and terms of service
2023-01-15 19:13:13 +09:00
Keith Stevens 864c1a6cac Revert "update docs/docs/api/openapi.json by run 3921890755"
This reverts commit 7bfac03995.
2023-01-15 19:07:33 +09:00
Keith Stevens e5219bd5f7 Merge branch 'main' into 394-show-privacy-links 2023-01-15 19:06:57 +09:00
Keith Stevens ceefe4d568 Merge pull request #736 from LAION-AI/email
Use email input type for sign up form
2023-01-15 19:03:06 +09:00
Keith Stevens 35a37df526 Merge pull request #735 from LAION-AI/debug-user
Fix missing `name` for debug users
2023-01-15 19:02:43 +09:00
Andrew Maguire f45de9adbc Nicer docusaurus openapi docs (#722)
- uses this plugin (https://github.com/cloud-annotations/docusaurus-openapi) to make a nice static site docusaurus based api section of docs site.
- adds some nicer postman code snippets etc too as part of api docs.
- makes api docs more "self hosted" as opposed to the dynamic swagger url approach.
2023-01-15 10:38:08 +01:00
Andrew Maguire 124994a04e turn off auto-commit as clashing with branch protection (#723)
disable openapi docs auto-commit while we resolve issue of clashing with branch protection
2023-01-15 10:34:04 +01:00
AbdBarho 9e453902bd Use email input type for sign up form 2023-01-15 10:11:20 +01:00
AbdBarho 7fabe39174 Fix missing display_name for debug users 2023-01-15 10:07:02 +01:00
AbdBarho acc629e73c Merge pull request #706 from LAION-AI/670-store-isNew-in-webdb
Tag in the user table when they are new and include it in use session
2023-01-15 09:40:12 +01:00
fozziethebeat 7bfac03995 update docs/docs/api/openapi.json by run 3921890755 2023-01-15 05:04:34 +00:00
Keith Stevens d3eca126fd Ensuring the user can find the privacy and terms of service links when logged in 2023-01-15 14:01:33 +09:00
Yannic Kilcher 69952dbf80 Merge pull request #678 from LAION-AI/install-sharp-for-prod
installed sharp for next standalone deployment
2023-01-15 05:50:48 +01:00
Keith Stevens 5e0fd4d5b1 Merge pull request #729 from rsandb/Fix-FlaggableElement-for-desktop
Fix FlaggableElement grouping issue for desktop
2023-01-15 13:38:27 +09:00
rsandb 9423f0c973 Fix width issue for messages on desktop
Also replaced grid with box because it wasn't using any grid props and was just calling an extra element
2023-01-14 21:36:35 -06:00
Keith Stevens d68a4d1d8d Merge pull request #711 from notmd/flaggable_element_mobile_fix
fix: improve `FlaggableElement` UI on mobile
2023-01-15 08:35:56 +09:00
Keith Stevens 9e7609008f Merge pull request #709 from Klotske/fix-usermenu-link
Fix NextLink prop missing
2023-01-15 08:34:55 +09:00
Keith Stevens 69be679fe1 Merge pull request #701 from LAION-AI/673-enhanced-admin-routing
673 enhanced admin management
2023-01-15 08:34:09 +09:00
Andrew Maguire 86cadc6e9f Cleanup notebooks folder (#716)
- standardize file naming to be a little more pythonic.
- one folder per notebook plus a README for easy GH viewing.
- adjust colab badges for new structure.
2023-01-14 22:51:09 +00:00
Andrew Maguire 0f607c7a28 export and auto-commit docs/docs/api/openapi.json as part of test-api-contract workflow (#719)
- copies that openapi.json file to docs/docs/api/openapi.json as part of start-mock-server.sh.
- adds a step to the end of the test-api-contract workflow that just auto-commits changes to the docs/docs/api/openapi.json file.
- excludes docs/docs/api/openapi.json from pre-commit since its already been formatted by jq.
2023-01-14 22:40:33 +00:00
Yannic Kilcher 885065adec added an init to datasets templates 2023-01-14 23:20:25 +01:00
rallio a203900070 A notebook for question and answer generation using one of the most powerful opensource NLU models, FLAN-T5-11B. (#215)
* Create T5_closed_book_QA_generators.py

This is code that can be run in a notebook or by itself to generate a dictionary for use in creating synthetic dialogue that can be verified for factual accuracy. To use this notebook your need your trusted source material to be in the format of a list of strings (they will be truncated to under 1100 characters). Requires transformers and accelerate. Make sure to use T5 with bfloat16 or full precision.

* Create T5_closed_book_QA_generators.py

* Create T5_closed_book_QA_generators.md

* Delete T5_closed_book_QA_generators.py

Moved to proper folder structure

* fixed pre-commit issues

Co-authored-by: Yannic Kilcher <yk@users.noreply.github.com>
2023-01-14 22:16:54 +00:00
Hyper 3f5ba8940e Pin python package versions (#606)
* Pin python package versions

* Fix CI
2023-01-14 22:41:46 +01:00
Andrew Maguire a9578e5404 create "Tasks" section on docs site (#715)
create tasks section in docs site
2023-01-14 22:39:38 +01:00
Andrew Maguire b44305dfbd CONTRIBUTING.md - add some notes about feature branches (#659)
- try nudge people towards using a feature branch in their fork instead of their main.
- add note about squash and merge,
- link to an example PR as a sort of reference.
- add a "Tips" section with some tips.
2023-01-14 22:36:53 +01:00
Yannic Kilcher bf66b2a890 fixed workflow 2023-01-14 22:10:39 +01:00
Yannic Kilcher f20594f52f fixed workflow 2023-01-14 22:02:13 +01:00
Yannic Kilcher 6430112dfc fixed workflow 2023-01-14 21:47:35 +01:00
Yannic Kilcher 17920e4e66 fixed workflow 2023-01-14 21:39:10 +01:00
Yannic Kilcher 105ff87aed inheriting secrets to deploy 2023-01-14 20:45:43 +01:00
Yannic Kilcher ddae13cf3b fixed workflow 2023-01-14 20:24:23 +01:00
Yannic Kilcher e642a6d826 fixed workflow 2023-01-14 20:12:04 +01:00
Yannic Kilcher 493947fddd Merge branch 'main' of github.com:LAION-AI/Open-Chat-GPT 2023-01-14 20:06:32 +01:00
Yannic Kilcher 39cf2cf6db added deploy workflow 2023-01-14 20:06:27 +01:00
kayjay 5cd9c630fc Small typo fix + Consistent Docstrings (#698)
* Small typo fix + Consistent Docstrings

Also removed a redundant comment.

* undo comment removal

* Fixed indentation from previous commit
2023-01-14 17:24:02 +01:00
notmd 138396a662 fix: improve FlaggableElement UI on mobile 2023-01-14 23:16:19 +07:00
Andreas Köpf 6547058778 add rank to message table and fix message_toxicity migration 2023-01-14 15:12:10 +01:00
klotske feba2de20c Bring back the NextLink 2023-01-14 15:49:33 +03:00
Nil Andreu a902c600fa Store Message Toxicity in database (#553)
* [NEW] MessageToxicity table

* [NEW] Alembic message Toxicity

* [NEW] Model name enum

* [NEW] Refactor Enum HF

* [NEW] Settings: DEBUT_SKIP_TOXICITY_CALCULATION

* [NEW] Store toxicity values

* [FIX] Merge conflict

* [FIX] Documentation

* [NEW] save_toxicity: function

* [FIX] Formatted string

* [NEW] DEBUG_SKIP_TOXICITY_CALCULATION=True

* [FIX] HfClassificationModel

* [FIX] Alembic merge heads

* [NEW] Refactor save_toxicity

* [NEW] Separating score/label

* [NEW] Store score and label

* [FIX] Cleaning Alembic

* [NEW] Clean HF names

* [NEW] Not type hinting

* [NEW] Update alembic versions

* [NEW] Revert the changes

* [NEW] Type hinting label & score

* Updated down_revision in migration script

Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2023-01-14 12:22:55 +00:00
theblackcat102 dbf8f77072 Merge pull request #699 from LAION-AI/sft-fixes
Fix supervised pretraining bugs and add new datasets
2023-01-14 20:20:12 +08:00
theblackcat102 670be60ca8 [fix] Fix config typo 2023-01-14 12:17:58 +00:00
Andreas Köpf 8b8326e22f add /by_display_name user query & created_date to FrontEndUser model 2023-01-14 11:03:25 +01:00
Valentino c36a7ae9da Add UnifiedQA datasets that are not in xP3 (#666)
* Add UnifiedQA datasets that are not in xP3
2023-01-14 09:57:22 +00:00
Keith Stevens b02429c1f7 Tag in the user table when they are new and include it in the user session 2023-01-14 18:55:28 +09:00
Keith Stevens 90e71f3da2 Merge pull request #702 from LAION-AI/labeling-fix
Fix full labelling task display
2023-01-14 18:14:33 +09:00