mirror of
https://github.com/wassname/ray.git
synced 2026-07-19 11:27:32 +08:00
IMPALA support for multiagent was broken since IMPALA has a requirement that batch sizes be of a certain length. However multi-agent envs can create variable-length batches. Fix this by adding zero-padding as needed (similar to the RNN case).
77 KiB
77 KiB