Commit Graph
2006 Commits
Author SHA1 Message Date
Keith StevensandGitHub cc1a4bdcb4 Merge pull request #920 from LAION-AI/857-backend-token-decrypt
857 backend token decrypt
2023-01-29 19:31:16 +09:00
Alan JeanandGitHub b5a875007a Update pre-commit config to upgrade to isort v5.12.0 (#988)
Fixes #987
2023-01-29 11:25:10 +01:00
bair82andGitHub bd27e1674e Update prompting.md (#992) 2023-01-29 11:15:18 +01:00
Andreas Köpf 8db2cd6413 change default values 2023-01-29 11:10:06 +01:00
Andreas Köpf d67b0ad0be add stats intervals & max children count to ansible/workflows 2023-01-29 11:06:32 +01:00
AbdBarho d7f2a6d0d9 Consolidate API calls to TaskContext 2023-01-29 11:03:07 +01:00
AbdBarhoandGitHub 5b113eadd9 Merge pull request #993 from othrayte/simplify-isloading
website: Simplify isLoading handling
2023-01-29 11:00:48 +01:00
Adrian Cowan 8b152fad1d website: Simplify isLoading handling 2023-01-29 20:48:30 +11:00
AbdBarhoandGitHub aaefac97a8 Merge pull request #970 from othrayte/improve-e2e-test-reliability
website: Improve reliability of e2e tests
2023-01-29 09:18:35 +01:00
AbdBarhoandGitHub 515cb25a95 Merge pull request #967 from LAION-AI/865-storbook-mock-service-worker
Copying from #769 to implement mock service worker
2023-01-29 08:58:05 +01:00
Keith Stevens f8c9503ba6 merging with main 2023-01-29 15:18:49 +09:00
Keith StevensandGitHub 7072ae2a8d Merge pull request #971 from othrayte/message-specific-labels
website: request message specific labels for on demand labelling
2023-01-29 15:16:23 +09:00
Keith StevensandGitHub 608bc0506a Merge pull request #986 from occupytheweb/981_fix_typos_in_labelling_task
Fix two typos in the labelling translation file
2023-01-29 15:15:07 +09:00
Keith StevensandGitHub ab6f11b2a9 Merge pull request #985 from occupytheweb/979_fix_task_placeholder_text
Refactor tasks translation file to have one placeholder per task-type
2023-01-29 15:14:43 +09:00
Keith Stevens b0ee9bea5f Addressing review comments 2023-01-29 15:13:50 +09:00
theblackcat102 0e024e3955 [fix] Add working A100 config for deberta-xxlarge (deepspeed stuck during evaluation, deadlock?) 2023-01-29 03:17:11 +00:00
theblackcat102 fdcc629678 [feature] add reddit eli5, asks, askh; bug fix 2023-01-29 03:05:56 +00:00
Adrian Cowan 8d45a989d6 website: request message specific labels for on demand labelling 2023-01-29 12:41:15 +11:00
Alan Jean e59b73d942 chore(inference): target dev stage at build time 🐳 2023-01-29 05:30:00 +04:00
Alan Jean bcecf257c7 Fix two typos in the labelling translation file
Fixes #981
2023-01-29 05:30:00 +04:00
Alan Jean ccf96fd843 Refactor tasks translation file to have one placeholder per task-type
Fixes #979
2023-01-29 05:30:00 +04:00
Alan Jean 8d6908d663 chore(inference): follow the pattern of splitting base-env and prod stage 🐋 2023-01-29 05:30:00 +04:00
Alan Jean d9dac3fe1a feat(inference): add a prod stage to the worker's dockerfile 🐋 2023-01-29 05:30:00 +04:00
Alan Jean 6ae6ff51d5 feat(inference): add a prod stage to the server's dockerfile 🐋 2023-01-29 05:30:00 +04:00
Alan Jean 7961fe3b71 chore(inference): add docs about the containerized inference stack 📝
Fixes #913
2023-01-29 05:30:00 +04:00
Alan Jean 0ab56041b6 feat(inference): integrate inference stack with the unified compose descriptor 🐳 2023-01-29 05:30:00 +04:00
Alan Jean 6d6b3504ac feat(inference): add compose file for the inference stack 🐳
Initial inference stack definition.
2023-01-29 05:30:00 +04:00
Alan Jean 6b3fe78693 feat(inference): add Dockerfile for the inference stack's text client 🐋
Initial definition of the inference stack's text client container image.
2023-01-29 05:30:00 +04:00
Alan Jean fef871161c feat(inference): add Dockerfile for the inference stack's worker 🐋
Initial definition of the inference stack's worker container image.

Notes:
- The oasst-shared package is installed as root as a workaround: it seems
  that python 3.10+ doesn't pick up on a .egg-link file installed on the
  PYTHONPATH anywhere other than at a global site-package directory.
  This quirk is similar to the behaviour described here
  https://groups.google.com/g/python-virtualenv/c/sKVq_6gG5z4.

- pydantic 1.9.1 (specified by oasst-shared) is incompatible with python 3.11,
  and needs to be upgraded. For now, this image uses python 3.10, as
  specified by the .python-version file
2023-01-29 05:30:00 +04:00
Alan Jean 4a7a1513a7 feat(inference): add Dockerfile for the inference stack's orchestrator image 🐋
Initial definition of the inference stack's coordination/orchestration
server container image.

Notes:
- The base layer uses python:3-slim to avoid having to install cargo on
  top of alpine. Cargo is required to install orjson, which is in turns a
  dependency of fastapi[all].

- The oasst-shared package is installed as root as a workaround: it seems
  that python 3.10+ doesn't pick up on a .egg-link file installed on the
  PYTHONPATH anywhere other than at a global site-package directory.
  This quirk is similar to the behaviour described here
  https://groups.google.com/g/python-virtualenv/c/sKVq_6gG5z4.

- pydantic 1.9.1 (specified by oasst-shared) is incompatible with python 3.11,
  and needs to be upgraded. For now, this image uses python 3.10, as
  specified by the .python-version file
2023-01-29 05:30:00 +04:00
Adrian Cowan 21c4a1263a website: Add head to task pages even if no task and improve var name 2023-01-29 12:09:58 +11:00
Yannic Kilcher 5e342cbbdf Merge branch 'main' of github.com:LAION-AI/Open-Assistant 2023-01-29 00:37:32 +01:00
Yannic Kilcher f885e27961 added horizontal layout to inference dev setup 2023-01-29 00:37:28 +01:00
AbdBarhoandGitHub d37d4dcfee Merge pull request #973 from rjmacarthy/fix/locales-messages
website: Fix locale issue on messages/id page
2023-01-28 22:36:03 +01:00
rjmacarthy 86911b4453 Fix locale issue on messages/id page
Pre-commit
2023-01-28 20:25:31 +00:00
Andreas Köpf eb4c41e3c6 send full conversation (including last-message) in label tasks 2023-01-28 20:23:39 +01:00
Andreas KöpfandGitHub 5747373480 fix typo Unhelful 2023-01-28 19:57:44 +01:00
Andreas Köpf 54503b7e1b reduce userstats cron defaults, fix reference error 2023-01-28 19:10:03 +01:00
Adrian Cowan e0e398fa8b website: Improve reliability of e2e tests 2023-01-29 03:17:44 +11:00
ab4dce3f60 website: Support new widget types for labelling (#966)
* website: Support new widget types for labelling

Adds proper support for yes/no spam style questions as well as a simple interface for flag style labels.

Also cleaned up the Task component to fix some rerender issues.

* website: Fix some UI text, adjust yes/no button alignment

* website: Remove left over console.log

Co-authored-by: notmd <33456881+notmd@users.noreply.github.com>

---------

Co-authored-by: notmd <33456881+notmd@users.noreply.github.com>
2023-01-28 17:07:43 +01:00
Andreas Köpf 314c590dd2 include import.py in backend docker image 2023-01-28 16:18:31 +01:00
Andreas Köpf 19116f7251 add optional message_id query param to text_labels/valid_labels endpoint 2023-01-28 15:29:38 +01:00
Andreas Köpf 264e914225 exclude fails_task from default valid labels 2023-01-28 15:07:46 +01:00
Andreas KöpfandGitHub c8d16285d0 Import message trees from jsonl file (#964)
* add new backlog_ranking tree state

* add first version of import script

* allow activation of trees during import

* add min_active_rankings_per_lang config param

* add settings docstring
2023-01-28 15:05:46 +01:00
Keith Stevens 46d20aff40 Final manual change 2023-01-28 21:13:58 +09:00
Keith Stevens 656d44529b manually applying the lint fixes that get applied in GitHub actions 2023-01-28 20:53:02 +09:00
Keith Stevens 4709223e93 manually applying the lint fixes that get applied in GitHub actions 2023-01-28 20:47:45 +09:00
Keith Stevens 8a69f3541e test 2023-01-28 20:44:14 +09:00
Keith Stevens 602352b73d Dropping changes 2023-01-28 20:39:49 +09:00
Keith Stevens c44e822248 Another exclude attempt 2023-01-28 20:37:25 +09:00