Alan Jean 4a7a1513a7 feat(inference): add Dockerfile for the inference stack's orchestrator image 🐋 ...

Initial definition of the inference stack's coordination/orchestration
server container image.

Notes:
- The base layer uses python:3-slim to avoid having to install cargo on
  top of alpine. Cargo is required to install orjson, which is in turns a
  dependency of fastapi[all].

- The oasst-shared package is installed as root as a workaround: it seems
  that python 3.10+ doesn't pick up on a .egg-link file installed on the
  PYTHONPATH anywhere other than at a global site-package directory.
  This quirk is similar to the behaviour described here
  https://groups.google.com/g/python-virtualenv/c/sKVq_6gG5z4.

- pydantic 1.9.1 (specified by oasst-shared) is incompatible with python 3.11,
  and needs to be upgraded. For now, this image uses python 3.10, as
  specified by the .python-version file

2023-01-29 05:30:00 +04:00

..

Dockerfile.server

feat(inference): add Dockerfile for the inference stack's orchestrator image 🐋

2023-01-29 05:30:00 +04:00