mirror of
https://github.com/wassname/ray.git
synced 2026-09-28 14:30:40 +08:00
We should use episode ids instead of the timestep to determine when sequences should be cut, since when batches are concatenated, increasing t does not guarantee we are part of the same episode.