Commit Graph

210 Commits

Author SHA1 Message Date
Andreas Koepf d0ef7c4bbc add missing doc-strings for tree-manager mandatory labels settings 2023-01-13 16:04:06 +00:00
Andreas Koepf 343853fb57 add TreeManagerConfiguration as sub-module to global pydantic settings class 2023-01-13 15:52:09 +00:00
Andreas Koepf 448d17dd61 Set some message trees into ranking state after seed-data insertion 2023-01-13 13:57:55 +00:00
Andreas Köpf 945c645818 returning list[FrontEndUser] from api/v1/frontend_users/ endpoint 2023-01-12 22:58:43 +01:00
Vechtomov 0d646e72f3 537: Endpoint to list frontend users (#554)
* added frontend users endpoint

* fix comparison

* added api_client_id filtration

* allow untrusted api-clients

* review fixes

Co-authored-by: Andreas Köpf <andreas.koepf@provisio.com>
2023-01-12 22:45:11 +01:00
Andreas Köpf f264b43cde fix user's notes column server_default value 2023-01-12 21:43:33 +01:00
Oliver Stanley 050d4902f3 538: Add endpoints to manage users (#601)
* Add endpoints for getting, updating, deleting users by global user ID

* Resolve formatting

* Include alembic revision script

* Updated down_revision to current alembic head

Co-authored-by: Andreas Köpf <andreas.koepf@xamla.com>
2023-01-12 21:30:07 +01:00
Andreas Köpf 7b78430569 remove accepted_messages ref 2023-01-12 01:23:05 +01:00
Andreas Köpf b659e1cf01 remove accepted_messages from message_tree_state 2023-01-12 01:21:32 +01:00
Andreas Köpf 025d20e638 shuffle ranking options, add simple mode for text-labels 2023-01-11 23:47:56 +01:00
dhug 3136b2e120 added similarity functions and ran precommit (#633) 2023-01-11 20:53:53 +01:00
dhug 9421488619 Add realistic seed data json and update seed_data to properly label task payloads (#613)
* modifies seed_data script to properly label taks types as prompteror assistant

* added realistic data json

* pre-commit changes

* update realistic_seed_data.json 5000 messages -> 450 messages

* pre-commit changes

* modifies seed_data script to properly label taks types as prompteror assistant

* added realistic data json

* pre-commit changes

* update realistic_seed_data.json 5000 messages -> 450 messages

* pre-commit changes

* changed DEBUG_USE_SEED_DATA_PATH to realistic_seed_data, merged with main, ran pre-commit

* Delete 2023_01_10_2052-06cc56417e69_.py

Co-authored-by: Andreas Köpf <andreas.koepf@provisio.com>
2023-01-11 18:48:14 +01:00
Andrew Maguire b1fbd0fa96 Devcontainer backend dev (#608)
add backend-dev devcontainer and extract openapi.json to docs/
2023-01-11 17:09:02 +01:00
Andreas Köpf f32ec78988 Returning from /api/v1/frontend_users/{auth_method}/{username}
fixes #615
2023-01-11 14:46:29 +01:00
Andreas Köpf 0117159da0 returning 503 Service Unavailable when requested task type is not available 2023-01-11 13:56:21 +01:00
Andreas Köpf 14fa08e2e7 Message tree state machine (#555)
* add query_incomplete_rankings()

* Add SQL queries for TreeManager task selection

* first working version of TreeManager.next_task()

* remove old generate_task(), add mandatory_labels to text_labels task

* Add ConversationMessage list to Ranking tasks

* add more sophisticated sql queries to find extendible trees

* add TreeManager.query_extendible_parents()

* fix task validation, seed data insertion (reviewed)

* provide user for task selection in text-frontend

* enter 'growing' state

* enter 'aborted_low_grade' state

* enter 'ranking' state

* check tree 'growing' state upon relpy insertion

* exclude user from labeling their own messages (added DEBUG_ALLOW_SELF_LABELING setting)

* add DEBUG_ALLOW_SELF_LABELING to docker-compose.yaml

* fix ranking submission

* add query_tree_ranking_results()

* add ranked_message_ids to RankingReactionPayload

* fix reply_messages instead of prompt_messages

* incorment 'ranking_count' of ranked replies

* added logic to check_condition_for_scoring_state

* changes to msg_tree_state_machine

* pre-commit changes

* enter 'ready_for_scoring' state

* re-add HF embedding call (lost during merge)

* use prepare_conversation() helper for seed-data creation

* Partially add user specified task selection

Co-authored-by: Daniel Hug <danielpatrickhug@gmail.com>
2023-01-11 10:54:03 +01:00
Oliver Stanley 8b44183843 Add note on Python version to backend README.md 2023-01-10 20:05:30 +00:00
Oliver Stanley e5abb2dc85 536: Add endpoint to resolve frontend user by auth method and username (#539)
* Add endpoint to resolve frontend user by auth method and username

* Require client ID for frontend user lookup

* Remove unnecessary if check

* Fix PromptRepository -> UserRepository

* Convert to protocol User

* Move User prep

* Address review comments

* 404 -> HTTP_404_NOT_FOUND
2023-01-10 18:20:56 +01:00
Yannic Kilcher ba12c35e22 Merge pull request #540 from jojopirker/messageEmbeddings
Store Message embedding
2023-01-09 21:22:56 +01:00
Andreas Köpf 225aa58f89 Fix expiry test in Task.expired()
Co-authored-by: Hemang Joshi <hemangjoshi37a@gmail.com>
2023-01-09 11:13:18 +01:00
Nil-Andreu 4b4a564a8f [NEW] Camelcase & 2x space 2023-01-09 10:10:19 +01:00
Nil-Andreu b39b86309c [FIX] Import on top 2023-01-09 09:03:02 +01:00
Nil-Andreu 70620520b4 [NEW] Created date 2023-01-08 21:29:12 +01:00
Nil-Andreu e241a8bf28 [NEW] Adding consistency in the URLs 2023-01-08 21:01:15 +01:00
Nil-Andreu 412736f52c [NEW] insert_message_embedding: documentation 2023-01-08 20:59:46 +01:00
Nil-Andreu 225a136ad1 [NEW] Refactor name of message_embedding object 2023-01-08 20:58:19 +01:00
Nil-Andreu 19eee6be58 [NEW] Removing embedding param in function Store Text Reply 2023-01-08 20:54:30 +01:00
Nil-Andreu fe4d265d12 [NEW] Solving merge conflicts 2023-01-08 20:48:13 +01:00
Nil-Andreu 7101e0e7d5 [NEW] Message embedding created_date 2023-01-08 20:17:14 +01:00
Andreas Köpf 8906854dbf Extract UserRepository and TaskRepository from PromptRepository
* Extract classes UserRepository and TaskRepository from PromptRepository
* move close_task() to TaskRepository and get_user_leaderboard to UserRepository()
* Use UserRepository in leaderboards endpoint, add type annotation to leaderboards endpoint
2023-01-08 19:08:47 +01:00
jojopirker a677e40cff insert embedding now to new table 2023-01-08 16:46:53 +01:00
Nil-Andreu 34e7d1db8a [NEW] Except OasstError 2023-01-08 14:36:38 +01:00
jojopirker 11d55d572a message embeddings in Messages table 2023-01-08 12:28:38 +01:00
jojopirker 9194e15b80 bugfix in alembic downgrade (frontend_type not frontend_id) 2023-01-08 10:59:12 +01:00
kostiak d183c343a9 Temporary fix for #506 to get the frontend working (#508) 2023-01-07 23:55:44 +01:00
Andreas Köpf d910c310c0 fix text_frontend 204 & creation of labeling tasks (#487) 2023-01-07 21:58:29 +01:00
Andreas Köpf 5e01f421aa add 'help_text' to valid_lables response 2023-01-07 21:48:11 +01:00
jojopirker 5fb0121668 #438 Frontend type (#483)
* add dev setup to readme & alembic description

* frontend_type for api_client

* readme update & missing file

* pre-commit
2023-01-07 21:33:57 +01:00
Oliver Stanley 45f2f3a60e Validate text labels in text frontend (#495)
* Validate text labels in text frontend

* Correct task type
2023-01-07 21:30:18 +01:00
Andreas Köpf 5b2cb5dd29 add api/v1/text_labels/valid_labels backend endpoint (#498)
Provides the set of valid text_lables with descriptions via a REST endpoint.
2023-01-07 21:28:24 +01:00
Daniel Hug f75a07301b Conversation messages refactor add msg ids (#500)
* update ConversationMessage in protocal.py

* updated ConversationMessage instantiations in tasks.py and util.py to include message_id and frontend_message_id

* changed message_id and frontend_message_id to type UUID

* update ConversationMessage instantiation in main.py to include message_id and frontend_message_id"

* changed frontend_message_id to type str

* ran precomit
2023-01-07 19:16:32 +01:00
Andreas Köpf 96d6717be4 Fetch conversation for seed data tasks, minor model fixes (#485)
* Fetch conversation for seed data, fix models, remove redundant payload type checks
2023-01-07 15:59:54 +01:00
Ken Tsui 043b5eff5a Add DEBUG_USD_SEED_DATA_PATH in config to make seed data flexible (#395)
* Add DEBUG_USD_SEED_DATA_PATH in config to make seed data flexible

* reformat

* Copy test_data folder in Dockerfile.backend, correct DEBUG_USE_SEED_DATA_PATH in cofig

* - make DEBUG_USE_SEED_DATA_PATH to absolute path
- correct test_data path in  Dockerfile.backend
2023-01-07 14:37:30 +01:00
Oliver Stanley 69bc799cd9 344: Create tasks for text labels (#381)
* Implement label task for initial prompts and replies

* Resolve formatting

* Include missing argument

* Modify text_labels API to match new model, update DB schema accordingly

* Send valid labels as part of label tasks

* Send correctly formatted valid_labels list

* Fix request format

* Fix request details for text-frontend reply label task

* Include message_id in tasks

* Address review comments

* Fix alembic tree
2023-01-06 18:39:04 +01:00
Yannic Kilcher 6c115bced9 reverted merge of 413 2023-01-06 16:12:52 +01:00
Yannic Kilcher f2db4220bb Merge pull request #413 from batuhanerenler/patch-3
Update env.py
2023-01-06 14:59:09 +01:00
shawticus 1309b5b339 lint env 2023-01-05 17:17:59 -08:00
Batuhan Erenler 104aad87d9 Update env.py 2023-01-06 03:19:10 +03:00
Batuhan Erenler c86e486c4d Update env.py 2023-01-06 03:12:55 +03:00
Batuhan Erenler cc82db81f2 Update env.py 2023-01-06 03:02:34 +03:00