Commit Graph

1812 Commits

Author SHA1 Message Date
Andreas Köpf 8ea53a54eb add quality to valid-labels for simple text labeling tasks (anti-spam) 2023-01-28 00:01:49 +01:00
dhug 49b5999ce6 Duplicate message reply filter (#958)
* added changes for user specific message dumplication filter, added error codes, and settings variable as described in Draft PR #926, ran precommit

* removed debug statements

* add missing await to async_managed_tx_method

* add 2nd missing await to async_managed_tx_method

* added changes for user specific message dumplication filter, added error codes, and settings variable as described in Draft PR #926, ran precommit

* removed debug statements

* assert task user matches prompt_repository user

* removed assert statments

* moved duplicate_message_filter and message_length check into store_text_reply

* removed old checks in tree_manager
2023-01-27 21:52:19 +00:00
Andreas Köpf 3a32a10b23 add reply_message to LabelConversationReplyTask & LabelConversationReplyPayload 2023-01-27 22:30:27 +01:00
Andreas Köpf 4b3ce24c72 add parsing of additional x-oasst-user header field (#957)
* add parsing of additional x-oasst-user header field

* simplify passing FrontendUserId to PromptRepository, use frontend_user_id on more message enpoints

* remove unrelated change
2023-01-27 21:28:57 +01:00
AbdBarho b07c7271b8 Merge pull request #960 from notmd/fix_leaderboard_limit
Pass correct param when fetch leaderboard
2023-01-27 21:20:11 +01:00
Andreas Köpf 002f847406 add missing alembic migration script 2023-01-27 21:16:31 +01:00
Andreas Köpf 9bad3d6e74 Exclude certain users from leaderboard stats (#961)
Co-authored-by: Akhil Datla <66145155+akhil-datla@users.noreply.github.com>
2023-01-27 21:04:55 +01:00
Adrian Cowan 356fd775e9 Add emoji reactions and reporting for messages (website) (#952)
* website: Move labelling to message ... menu and add reporting and emoji reactions

We can add more emoji easily in future, we just need to pick ones that we have consistent icons for.

Also added "open in new tab" option so that messages can be navigated to from tasks on mobile.

* website: Make new label and report strings translatable.

* website: Move report api call to oasst client

* small fixes

* pre-commit

---------

Co-authored-by: AbdBarho <ka70911@gmail.com>
2023-01-27 20:52:40 +01:00
Andreas Köpf c7692b9049 add 2nd missing await to async_managed_tx_method 2023-01-27 19:44:48 +01:00
Andreas Köpf d165987256 add missing await to async_managed_tx_method 2023-01-27 19:43:08 +01:00
notmd ce3b3c7ecc pass correct param when fetch leaderboard 2023-01-28 00:17:31 +07:00
James Melvin Ebenezer 3b04080d7b 949_transaction error handling (#950)
* fix: transaction error handling

* refactor: retry handling for all decorators as per review comments

* fix: raising retry exhausted error

* fix: avoid auto refresh on RollBack and review comments

* removed refresh_result param from managed_tx_function

---------

Co-authored-by: James Melvin <melvin@gameface.ai>
Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2023-01-27 18:06:25 +01:00
Yannic Kilcher 45a4b09eae added setup instructions to readme 2023-01-27 15:42:01 +01:00
Yannic Kilcher ae5d16f394 added a tmux inference dev setup script 2023-01-27 15:40:21 +01:00
Yannic Kilcher 83dc00b638 Merge branch 'main' of github.com:LAION-AI/Open-Assistant 2023-01-27 15:23:25 +01:00
Yannic Kilcher a0f4449e9f added seed to parameters 2023-01-27 15:23:19 +01:00
Keith Stevens 639722b0f4 Merge pull request #951 from othrayte/fix-new-label-handling
website: Fix handling of new and unknown labels
2023-01-27 15:37:42 +09:00
Adrian Cowan 1011fa527c website: Fix handling of new and unknown labels 2023-01-27 13:25:07 +11:00
Andreas Köpf da1c81d2c9 Add LabelDescription list to labeling tasks, make +1/-1 emojis exclusive (#947)
* add LabelDescription list to labeling tasks

* make +1 & -1 emoji exclusive (only one of both or none)

* add red_flag emoji to message when reported

* fix task's valid labels

* fix typo
2023-01-27 00:54:29 +01:00
Andreas Köpf f3ffde47ff add preferred lonely_children extension (#942)
* add preferred lonely_children extension

* simplify sampling process, lower the probability to 25%

* exclude parents for replies that were recently used

* lonely children := count > 0

* consider only tasks not done for parent exclusion

* increase lonely child sampling probability
2023-01-26 23:00:54 +01:00
Yannic Kilcher de00cc82d0 Merge branch 'main' of github.com:LAION-AI/Open-Assistant 2023-01-26 21:02:00 +01:00
Yannic Kilcher 040344a41f made inference server a bit more robust 2023-01-26 21:01:52 +01:00
Andreas Köpf 348999a936 exclude trees in ranking state in acitve tree count 2023-01-26 19:08:58 +01:00
Yannic Kilcher 2eed530e1a Merge branch 'main' of github.com:LAION-AI/Open-Assistant 2023-01-26 16:42:02 +01:00
Yannic Kilcher f1edcc8a28 added streaming worker 2023-01-26 16:41:57 +01:00
Andreas Köpf d4688835d5 check condition for scoring on startup 2023-01-26 16:33:03 +01:00
Andreas Köpf c2fa476904 Add user emoji augmentation for message queries (#937)
* add disposition to text labeling tasks

* add emoji stats to ConversationMessage

* add user emoji augmentation for message queries

* add auth_method,username to message queries (query emoji status)

* add auth_method+username for single message

* fix param name typo

* only join rows when message.emojis != JSON.NULL

* formatting

* make sure emojis and user_emojis default to {}, []

* remove init_user(), use fresh empty default collections
2023-01-26 14:29:54 +00:00
MattAlexMiracle 5d4f74f9d6 Ranked pairs (#933)
* commented out legacy numerical solver

* added comments and task_scheduling for selecting which task to serve to users

* removed standalone task weighting

* pre-commit hook rerun

* fixed ranking

* fix index error

* ranking fix

* fix typo

Co-authored-by: Alexander Mattick <alex.mattick@fau.de>
Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2023-01-26 09:50:25 +00:00
kayjay 1eb3f05c44 PR: Create notebook to convert r/changemyview data (#839)
* (#737) Create notebook to convert r/changemyview data into cleaner format
2023-01-26 09:49:03 +00:00
Keith Stevens 1e88166401 Merge pull request #936 from othrayte/simple-spam-task
website: Make the spam question simple again
2023-01-26 17:13:48 +09:00
Keith Stevens bf082a96bb Merge pull request #935 from othrayte/message-stories
website: Add storybook stories for messages
2023-01-26 17:12:55 +09:00
Keith Stevens cccf59dbd4 Merge pull request #928 from notmd/refactor_oasst_api_client
Refactor `OasstApiClient`
2023-01-26 17:11:41 +09:00
Adrian Cowan 58a07dd05d website: Make the spam question simple again
This is an initial quick fix to get back simple buttons. This should be followed up with some refactoring or maybe a real spam task.
2023-01-26 18:11:41 +11:00
Adrian Cowan 63dc5d170f website: Add storybook stories for messages 2023-01-26 17:24:17 +11:00
Andreas Köpf 4d7be8ebb9 wait for pending message reviews before entering ranking state 2023-01-25 18:18:21 +01:00
Andreas Köpf 39a107e851 Use intersection of ranking ID sets, add fetch_siblings() 2023-01-25 16:21:58 +01:00
Vechtomov 1020dcb024 add retry_scoring_failed_message_trees cli command (#931) 2023-01-25 13:40:36 +01:00
Keith Stevens 50e60862b4 Merge pull request #930 from othrayte/fix-storybook
website: Fix errors when running storybook
2023-01-25 20:53:53 +09:00
Adrian Cowan 9813b389f8 website: Fix errors when running storybook 2023-01-25 22:09:27 +11:00
notmd de661e04d1 pass ignore-path arg 2023-01-25 17:48:29 +07:00
notmd 05f2e5c534 Merge branch 'main' into refactor_oasst_api_client 2023-01-25 16:36:32 +07:00
notmd 2e2a57cf10 wip 2023-01-25 16:36:06 +07:00
Keith Stevens c7f9d24023 Add a few web files to skip pre-commit rewriting 2023-01-25 18:19:49 +09:00
notmd 97cd57a300 fix test 2023-01-25 16:02:20 +07:00
notmd 31630be319 fix test & build 2023-01-25 15:48:53 +07:00
Andreas Köpf 558b207013 Add /messages/{message_id}/emoji endpoint to toggle, add, remove message emojis (#925)
* add endpoint to set message emojis

* make refresh result optional in db utils
2023-01-25 09:31:20 +01:00
notmd 94d2ed820e Refactor OasstApiClient 2023-01-25 15:04:39 +07:00
AbdBarho 4146930eb9 Merge pull request #905 from rjmacarthy/chore/localisation-tasks
website: Add localisation to dashboard and tasks pages
2023-01-24 23:12:19 +01:00
Graeme Harris 032a748ba5 677 - Add tree message export (#808)
* Added - Basic functions to export trees for users, export-ready trees and specific tree ids to files

* Added print to logger by default for no file specified

* linting to remove extra imports

* Added cli for exporting trees which are ready to export

Fixed some accidental removal

Updated message lookup to use dict for better perf

* removed unused imports

* changed export flag for including deleted prompts back to include_deleted for better understandability

* Use native collection types list, tuple, dict

* pre-commit fix

Co-authored-by: Andreas Köpf <andreas.koepf@provisio.com>
2023-01-24 22:13:10 +01:00
rjmacarthy c14bcd7c14 Fix dashboard translation keys 2023-01-24 19:20:59 +00:00