Commit Graph

1640 Commits

Author SHA1 Message Date
theblackcat102 f5b2a34857 [feature] add pythia and limit translation pair 2023-01-22 00:56:17 +00:00
theblackcat102 62a203fd8c [feature] move data formatting into dataset, instead of collator 2023-01-21 03:31:35 +00:00
Andreas Köpf 94e5d50537 add users/cursor keyset_pagination endpoint (#866)
* add users/cursor endpoint

* add messages/cursor endpoint

* add user/{user_id}/messages/cursor, frontend_user/{auth_method}/{username}/messages/cursor

* user regex to parse cursor value
2023-01-21 00:29:53 +01:00
Andreas Köpf 2d21b65ed0 Add lang-tag based task selection (lang-separation) (#863)
* lang based task selection

* use BCP 47 instead of ISO 639-1

* add Field(None, nullable=True)

* update migration script down_revision
2023-01-20 19:58:33 +01:00
Andreas Köpf 70fc80aa08 Add keyset pagination for users ordered by username / display_name (#851)
* add keyset pagination for user ordered by username or display_name

* add index on display-name for user table

* update down_revision in migration script
2023-01-20 16:32:13 +01:00
Keith Stevens 7488f175f2 Merge pull request #859 from LAION-AI/fetch-available-tasks
Fetch available tasks
2023-01-20 21:03:45 +09:00
Keith Stevens 7792e316cb Merge pull request #858 from LAION-AI/account
Restyle account page
2023-01-20 21:02:14 +09:00
AbdBarho a588844ba5 use clsx 2023-01-20 12:26:50 +01:00
AbdBarho e80a69dd8a Fetch available tasks 2023-01-20 12:16:17 +01:00
AbdBarho 1fe24db8ae Restyle account page 2023-01-20 11:05:56 +01:00
Keith Stevens c81967fca9 Merge pull request #852 from rjmacarthy/chore/apply-i18n-pages
website: Add localization to pages, header and footer
2023-01-20 18:59:27 +09:00
Keith Stevens bc5aa937b6 Merge pull request #856 from LAION-AI/message-mobile
More space for messages on narrow screens
2023-01-20 18:48:36 +09:00
rjmacarthy f09eee1ce7 Pre-commit 2023-01-20 09:44:06 +00:00
AbdBarho 47c402e762 More space for messages on narrow screen 2023-01-20 10:37:54 +01:00
rjmacarthy 9b659191ca Extract common getStaticProps to single file 2023-01-20 09:37:02 +00:00
sanagnos 8838698d97 Merge pull request #853 from LAION-AI/sft-dataset-update
new SFT datasets
2023-01-20 09:47:24 +01:00
Keith Stevens f711133df9 Merge pull request #844 from LAION-AI/827-use-discord-credentials
Send the most detailed user credentials to the backend
2023-01-20 17:00:00 +09:00
theblackcat102 aca3e9de89 [fix] wait it pass? 2023-01-20 07:26:26 +00:00
theblackcat102 22e3ab1a89 [fix] linter fix 2023-01-20 07:23:02 +00:00
theblackcat102 c255148dc6 [fix] Merge main branch update 2023-01-20 06:18:43 +00:00
theblackcat102 6cd62e3d48 [fix] Fix missing russian and update readme 2023-01-20 06:16:26 +00:00
theblackcat102 5a65dd9440 Merge pull request #846 from LAION-AI/soda_dialogue_dataset_sft
Soda dataset in an instruction format
2023-01-20 11:07:56 +08:00
theblackcat102 74cb9aaa5a [feature] added translation, rallio instruct tuning dataset, prosocial for safety, new summary dataset 2023-01-20 03:02:07 +00:00
Andreas Köpf 038d1cc004 last_uddated for user_stats, swtich to timestamptz 2023-01-19 22:07:08 +01:00
rjmacarthy 3fa2e637d2 Add localization to pages, header and footer
Fix import orders for useTranslation

Apply common translations for header and footer

lint

Fix getServerSideProps messages/id
2023-01-19 19:23:29 +00:00
Andreas Köpf 7a1a8c8b54 fetch whole message tree for purge (including non-reviewed & deleted) 2023-01-19 16:42:13 +01:00
Andreas Köpf 1a93c21f94 add logging 2023-01-19 16:28:03 +01:00
Andreas Köpf 2d4e38a272 remove ensure_user_is_enabled() from ACK/NACK 2023-01-19 15:36:34 +01:00
Andreas Köpf 488842c3cb purge -> purge_user in path 2023-01-19 15:12:37 +01:00
Andreas Köpf 547e355e27 add update_leaderboard..(), admin/purge/{user-id}/messages, ban param for purge_user() 2023-01-19 15:10:22 +01:00
Sotirios Anagnostidis 5d9591d82c added soda dialogue dataset 2023-01-19 14:25:19 +01:00
Andreas Köpf ef8a00e682 add GET /api/v1/admin/backend_settings/{full/public} endpoint for api-clients (#830)
* add GET /api/v1/admin/backend_settings endpoint for trusted api-clients

* add backend_settings/public for untrusted api_clients
2023-01-19 11:48:26 +00:00
Andreas Köpf 335af5d641 add admin purge user function (#834)
* add admin purge user function

* improve comments

* minor naming changes

* ensuer user is enabled for tasks api requests

* add preview with stats to /admin/purge_user/{id} endpoint

* add update_children_counts()
2023-01-19 12:33:55 +01:00
Keith Stevens 581f31203c Fixing the contract tests to use the new user type 2023-01-19 17:32:05 +09:00
Keith Stevens 70febaaa50 Merge pull request #843 from othrayte/is-the-message-spam
website: Change spam question to "Is the message spam?"
2023-01-19 17:24:47 +09:00
Keith Stevens ae6600afa2 Removing an unused import 2023-01-19 17:23:53 +09:00
Keith Stevens df1eca4eaf Ensuring the website uses the most specific auth type with the backend when fetching and interacting with tasks 2023-01-19 17:21:41 +09:00
Adrian Cowan bde1639e07 website: Change spam question to "Is the message spam?" 2023-01-19 19:10:23 +11:00
Keith Stevens d228ddae30 Merge pull request #824 from LAION-AI/slider
Restyle slider thumb
2023-01-19 14:23:11 +09:00
Andreas Köpf 7e8d4f5a6e fix only_active condition of tree_message_count_stats() 2023-01-18 22:02:35 +01:00
MattAlexMiracle 530194de08 Fix to ranking algorithm (#826)
* fixed ranking

* fix index error

Co-authored-by: Alexander Mattick <alex.mattick@fau.de>
2023-01-18 21:27:16 +01:00
Vechtomov 9b98056001 change leaderboard ordering (#825) 2023-01-18 21:17:16 +01:00
AbdBarho 13fa1151a0 Restyle slider thumb 2023-01-18 19:10:48 +01:00
Oliver Stanley 993ed803cf Merge pull request #807 from olliestanley/745-augment-codet
745: Add notebooks for CodeT datasets augmentation
2023-01-18 17:10:08 +00:00
Oliver b60d5ecb08 Add Colab links 2023-01-18 17:02:16 +00:00
AbdBarho 7a628c81f4 Merge pull request #820 from LAION-AI/web-small-test-cleanup
Moving the page tests into pages directory to simplify tab completion
2023-01-18 15:17:30 +01:00
Thierry Deruyttere 0eb9942388 Notebook to convert the DIVERSE dataset (#784)
* Notebook to convert the DIVERSE dataset to Open-Assistant format
2023-01-18 09:09:52 +00:00
Yannic Kilcher 09792e5816 Merge branch 'production' 2023-01-18 08:54:08 +01:00
Yannic Kilcher c05ab42e94 added skip toxicity to playbook 2023-01-18 08:53:01 +01:00
AbdBarho 3be67e777f Merge pull request #819 from LAION-AI/797-udpate-username-web
Cleaning up the username api route and ensuring the users name is fresh
2023-01-18 08:36:28 +01:00