Initial definition of the inference stack's coordination/orchestration
server container image.
Notes:
- The base layer uses python:3-slim to avoid having to install cargo on
top of alpine. Cargo is required to install orjson, which is in turns a
dependency of fastapi[all].
- The oasst-shared package is installed as root as a workaround: it seems
that python 3.10+ doesn't pick up on a .egg-link file installed on the
PYTHONPATH anywhere other than at a global site-package directory.
This quirk is similar to the behaviour described here
https://groups.google.com/g/python-virtualenv/c/sKVq_6gG5z4.
- pydantic 1.9.1 (specified by oasst-shared) is incompatible with python 3.11,
and needs to be upgraded. For now, this image uses python 3.10, as
specified by the .python-version file
Yannic Kilcher