mirror of
https://github.com/wassname/ray.git
synced 2026-07-01 14:36:45 +08:00
706dc1d473
IMPALA support for multiagent was broken since IMPALA has a requirement that batch sizes be of a certain length. However multi-agent envs can create variable-length batches. Fix this by adding zero-padding as needed (similar to the RNN case).