mirror of
https://github.com/wassname/ray.git
synced 2026-08-12 12:20:11 +08:00
We should use episode ids instead of the timestep to determine when sequences should be cut, since when batches are concatenated, increasing t does not guarantee we are part of the same episode.