mirror of
https://github.com/wassname/ray.git
synced 2026-09-26 14:10:59 +08:00
IMPALA support for multiagent was broken since IMPALA has a requirement that batch sizes be of a certain length. However multi-agent envs can create variable-length batches. Fix this by adding zero-padding as needed (similar to the RNN case).