Commit Graph

1661 Commits

Author SHA1 Message Date
Keith Stevens 2e749da450 Merge pull request #868 from rjmacarthy/chore/leaderboard-locales
website: Add locale to Leaderboard and organize locale files
2023-01-22 09:45:23 +09:00
Andreas Köpf 76b5bdc5d7 fix cursor queries query_users_ordered_by_username/query_users_ordered_by_display_name 2023-01-22 00:58:03 +01:00
Yannic Kilcher 1709dc0324 Initial implementation of the inference system (#869)
* very primitive implementation of inference

* re-worked with security in mind

* removed polling from clients

* switched workers to websockets

* implemented back and forth chats
2023-01-21 22:38:18 +01:00
Ori Yonay cec49614c2 added message size limit of 2000 characters (issue 822) (#880)
* added message size limit (issue 822)
2023-01-21 22:37:42 +01:00
rjmacarthy 3f50cf1080 Pre-commit 2023-01-21 20:35:02 +00:00
rjmacarthy edeae8cc84 Fix locale leaderboard after rebase 2023-01-21 20:33:27 +00:00
rjmacarthy 81a392232e Add locale to leaderboard and organize locale json 2023-01-21 20:26:40 +00:00
ontocord 128102e6f1 Merge pull request #571 from jquesnelle/soda-synthetic-dialogue
add soda_synthetic_dialogue dataset
2023-01-21 08:29:50 -08:00
Andreas Köpf e08b36e675 imporve prev/next status for user cursor 2023-01-21 16:04:43 +01:00
James Mete d15d8357a1 126 twitter data (#620)
* Added a script file to process json archive files into more unified parquet files focused on tweet reply rows for further processing.

* Added README file for Twitter data collection.

* Re did code for processing json into standardized parquet files.

* Added file to process parquet files into a conversation tree jsonl file.

* Added requirements and ran pre-commit.
2023-01-21 13:54:21 +01:00
AbdBarho 5f3f0776e9 Merge pull request #873 from LAION-AI/web-fix-main
Ensuring localization works everywhere and fix an admin view
2023-01-21 12:51:13 +01:00
Andreas Köpf 186aabe3a5 improve prev,next cursor values 2023-01-21 12:19:45 +01:00
Keith Stevens e756e5d992 Fixing another page with locale data 2023-01-21 19:03:12 +09:00
Keith Stevens b9ce2fb140 Ensuring localization works across all pages and fix user data fetching in admin view 2023-01-21 17:56:29 +09:00
Keith Stevens 1c725bb4e2 Merge pull request #862 from LAION-AI/whitespace
Render whitespace in messages
2023-01-21 10:34:50 +09:00
Keith Stevens b05df5b095 Merge pull request #861 from LAION-AI/last-updated
Show last updated on leaderboard
2023-01-21 10:34:23 +09:00
Andreas Köpf 94e5d50537 add users/cursor keyset_pagination endpoint (#866)
* add users/cursor endpoint

* add messages/cursor endpoint

* add user/{user_id}/messages/cursor, frontend_user/{auth_method}/{username}/messages/cursor

* user regex to parse cursor value
2023-01-21 00:29:53 +01:00
Andreas Köpf 2d21b65ed0 Add lang-tag based task selection (lang-separation) (#863)
* lang based task selection

* use BCP 47 instead of ISO 639-1

* add Field(None, nullable=True)

* update migration script down_revision
2023-01-20 19:58:33 +01:00
Andreas Köpf 70fc80aa08 Add keyset pagination for users ordered by username / display_name (#851)
* add keyset pagination for user ordered by username or display_name

* add index on display-name for user table

* update down_revision in migration script
2023-01-20 16:32:13 +01:00
AbdBarho 2802bc1581 Render whitespace in messages 2023-01-20 13:51:47 +01:00
Keith Stevens 7488f175f2 Merge pull request #859 from LAION-AI/fetch-available-tasks
Fetch available tasks
2023-01-20 21:03:45 +09:00
Keith Stevens 7792e316cb Merge pull request #858 from LAION-AI/account
Restyle account page
2023-01-20 21:02:14 +09:00
AbdBarho 0c5e2fc45d Show last updated on leaderboard 2023-01-20 13:00:59 +01:00
AbdBarho a588844ba5 use clsx 2023-01-20 12:26:50 +01:00
AbdBarho e80a69dd8a Fetch available tasks 2023-01-20 12:16:17 +01:00
AbdBarho 1fe24db8ae Restyle account page 2023-01-20 11:05:56 +01:00
Keith Stevens c81967fca9 Merge pull request #852 from rjmacarthy/chore/apply-i18n-pages
website: Add localization to pages, header and footer
2023-01-20 18:59:27 +09:00
Keith Stevens bc5aa937b6 Merge pull request #856 from LAION-AI/message-mobile
More space for messages on narrow screens
2023-01-20 18:48:36 +09:00
rjmacarthy f09eee1ce7 Pre-commit 2023-01-20 09:44:06 +00:00
AbdBarho 47c402e762 More space for messages on narrow screen 2023-01-20 10:37:54 +01:00
rjmacarthy 9b659191ca Extract common getStaticProps to single file 2023-01-20 09:37:02 +00:00
sanagnos 8838698d97 Merge pull request #853 from LAION-AI/sft-dataset-update
new SFT datasets
2023-01-20 09:47:24 +01:00
Keith Stevens f711133df9 Merge pull request #844 from LAION-AI/827-use-discord-credentials
Send the most detailed user credentials to the backend
2023-01-20 17:00:00 +09:00
theblackcat102 aca3e9de89 [fix] wait it pass? 2023-01-20 07:26:26 +00:00
theblackcat102 22e3ab1a89 [fix] linter fix 2023-01-20 07:23:02 +00:00
theblackcat102 c255148dc6 [fix] Merge main branch update 2023-01-20 06:18:43 +00:00
theblackcat102 6cd62e3d48 [fix] Fix missing russian and update readme 2023-01-20 06:16:26 +00:00
theblackcat102 5a65dd9440 Merge pull request #846 from LAION-AI/soda_dialogue_dataset_sft
Soda dataset in an instruction format
2023-01-20 11:07:56 +08:00
theblackcat102 74cb9aaa5a [feature] added translation, rallio instruct tuning dataset, prosocial for safety, new summary dataset 2023-01-20 03:02:07 +00:00
Andreas Köpf 038d1cc004 last_uddated for user_stats, swtich to timestamptz 2023-01-19 22:07:08 +01:00
rjmacarthy 3fa2e637d2 Add localization to pages, header and footer
Fix import orders for useTranslation

Apply common translations for header and footer

lint

Fix getServerSideProps messages/id
2023-01-19 19:23:29 +00:00
Andreas Köpf 7a1a8c8b54 fetch whole message tree for purge (including non-reviewed & deleted) 2023-01-19 16:42:13 +01:00
Andreas Köpf 1a93c21f94 add logging 2023-01-19 16:28:03 +01:00
Andreas Köpf 2d4e38a272 remove ensure_user_is_enabled() from ACK/NACK 2023-01-19 15:36:34 +01:00
Andreas Köpf 488842c3cb purge -> purge_user in path 2023-01-19 15:12:37 +01:00
Andreas Köpf 547e355e27 add update_leaderboard..(), admin/purge/{user-id}/messages, ban param for purge_user() 2023-01-19 15:10:22 +01:00
Sotirios Anagnostidis 5d9591d82c added soda dialogue dataset 2023-01-19 14:25:19 +01:00
Andreas Köpf ef8a00e682 add GET /api/v1/admin/backend_settings/{full/public} endpoint for api-clients (#830)
* add GET /api/v1/admin/backend_settings endpoint for trusted api-clients

* add backend_settings/public for untrusted api_clients
2023-01-19 11:48:26 +00:00
Andreas Köpf 335af5d641 add admin purge user function (#834)
* add admin purge user function

* improve comments

* minor naming changes

* ensuer user is enabled for tasks api requests

* add preview with stats to /admin/purge_user/{id} endpoint

* add update_children_counts()
2023-01-19 12:33:55 +01:00
Keith Stevens 581f31203c Fixing the contract tests to use the new user type 2023-01-19 17:32:05 +09:00