* add tos_acceptance_date column to user
* send 451 UNAVAILABLE_FOR_LEGAL_REASONS status
* add create user REST endpoint
* adapt text-frontend to ToS requirements
* set DEBUG_IGNORE_TOS_ACCEPTANCE default to True (temporary change)
* update down revision to f60958968ff8
* add full message to prompt-labeling & always require full prompt labeling
* always sending conversation, also for initial prompt labeling
* update type annotation
* fix: update user streaks
* Moved streak_last_day_date & streak_days from UserStats to User
* Updated Alembic version
* update last_activity after tm.handle_interaction()
* periodically executed function in main.py to update the user_streak every 4hrs
* fix:removed log messages
* fix: pre commit issues
* refactor: incorporated review comments
* fix: removed the managed -scope.
* refactor: managed_tx to Outer REST Db Ops in /interaction API
* fix: pre-commit changes
* fix: added streak and last_activity_date to protocol.FrontEndUser
* fix: pre-commit fixes after merge
* fix: added streak info to user_stat_repository, leaderboard and review comments
* fix: proper 4h delay and simpler startup_time initialisation
---------
Co-authored-by: James Melvin <melvin@gameface.ai>
* add new backlog_ranking tree state
* add first version of import script
* allow activation of trees during import
* add min_active_rankings_per_lang config param
* add settings docstring
* added changes for user specific message dumplication filter, added error codes, and settings variable as described in Draft PR #926, ran precommit
* removed debug statements
* add missing await to async_managed_tx_method
* add 2nd missing await to async_managed_tx_method
* added changes for user specific message dumplication filter, added error codes, and settings variable as described in Draft PR #926, ran precommit
* removed debug statements
* assert task user matches prompt_repository user
* removed assert statments
* moved duplicate_message_filter and message_length check into store_text_reply
* removed old checks in tree_manager
* add LabelDescription list to labeling tasks
* make +1 & -1 emoji exclusive (only one of both or none)
* add red_flag emoji to message when reported
* fix task's valid labels
* fix typo
* add preferred lonely_children extension
* simplify sampling process, lower the probability to 25%
* exclude parents for replies that were recently used
* lonely children := count > 0
* consider only tasks not done for parent exclusion
* increase lonely child sampling probability
* store message_id in message_reactions and task_id in text_labels
* exclude tasks to which users already responded to
* remove test code
* fix join in find_incomplete_rankings_ex
* only ranking assistant replies by default
* add tasks/availability endpoint allow to specify desired task
* move rank_prompter_replies option to TreeManagerConfiguration
* fix type annotation
* remove desired_task_type from _random_task_selection()
* fix typo
* Convert query_tree_size to sqlachemy, return 'full' text-labeling tasks if they were explicitly requested
* added root tokens and endpoint for adding api keys
* Change down revision to current alembic head
* removed added_by_root_token
* refactored description
* fixed jinja errors
Co-authored-by: Andreas Köpf <andreas.koepf@provisio.com>
* add leaderboard stats, periodic update via fastapi-utils
* count label tasks for assistant and prompter replies
* Daily stats update every 15 mins, simplify leaderboard endpoint
* add indices for some created_date columns
* make user stats update intervals configurable
* make sure intervals are positive
* add query_incomplete_rankings()
* Add SQL queries for TreeManager task selection
* first working version of TreeManager.next_task()
* remove old generate_task(), add mandatory_labels to text_labels task
* Add ConversationMessage list to Ranking tasks
* add more sophisticated sql queries to find extendible trees
* add TreeManager.query_extendible_parents()
* fix task validation, seed data insertion (reviewed)
* provide user for task selection in text-frontend
* enter 'growing' state
* enter 'aborted_low_grade' state
* enter 'ranking' state
* check tree 'growing' state upon relpy insertion
* exclude user from labeling their own messages (added DEBUG_ALLOW_SELF_LABELING setting)
* add DEBUG_ALLOW_SELF_LABELING to docker-compose.yaml
* fix ranking submission
* add query_tree_ranking_results()
* add ranked_message_ids to RankingReactionPayload
* fix reply_messages instead of prompt_messages
* incorment 'ranking_count' of ranked replies
* added logic to check_condition_for_scoring_state
* changes to msg_tree_state_machine
* pre-commit changes
* enter 'ready_for_scoring' state
* re-add HF embedding call (lost during merge)
* use prepare_conversation() helper for seed-data creation
* Partially add user specified task selection
Co-authored-by: Daniel Hug <danielpatrickhug@gmail.com>
* Add DEBUG_USD_SEED_DATA_PATH in config to make seed data flexible
* reformat
* Copy test_data folder in Dockerfile.backend, correct DEBUG_USE_SEED_DATA_PATH in cofig
* - make DEBUG_USE_SEED_DATA_PATH to absolute path
- correct test_data path in Dockerfile.backend