Eric LiangandGitHub 5f430da180 [rllib] Provide internal access to episode state in compute_actions() and allow returning extra batches (#2559) ...

The goal of this PR is to allow custom policies to perform model-based rollouts. In the multi-agent setting, this requires access to not only policies of other agents, but also their current observations.
Also, you might want to return the model-based trajectories as part of the rollout for efficiency.

  compute_actions() now takes a new keyword arg episodes
  pull out internal episode class into a top-level file
  add function to return extra trajectories from an episode that will be appended to the sample batch
  documentation

2018-08-16 14:37:21 -07:00

..

autoscaler

ray exec and ray attach commands (#2560)

2018-08-15 14:31:50 -07:00

cloudpickle

Bring cloudpickle inside the repository. (#1445)

2018-01-25 11:36:37 -08:00

common

Introduce constant for ID_SIZE in python code. (#2517)

2018-07-31 12:40:53 -07:00

core

Use flatbuffers for some messages from Redis. (#341)

2017-03-10 18:35:25 -08:00

dataframe

Dataframe deprecation (#2353)

2018-07-06 00:16:22 -07:00

experimental

[xray] Adds a driver table. (#2289)

2018-08-08 23:41:40 -07:00

global_scheduler

Introduce constant for ID_SIZE in python code. (#2517)

2018-07-31 12:40:53 -07:00

internal

Add ray.internal.free (#2542)

2018-08-14 22:01:23 -07:00

local_scheduler

[xray] Adds a driver table. (#2289)

2018-08-08 23:41:40 -07:00

plasma

Introduce constant for ID_SIZE in python code. (#2517)

2018-07-31 12:40:53 -07:00

pyarrow_files

Package pyarrow along with ray. (#822)

2017-08-07 21:17:28 -07:00

rllib

[rllib] Provide internal access to episode state in compute_actions() and allow returning extra batches (#2559)

2018-08-16 14:37:21 -07:00

scripts

ray exec and ray attach commands (#2560)

2018-08-15 14:31:50 -07:00

test

Fix frequent failure of Jenkins CI. (#2490)

2018-08-02 10:28:28 -07:00

tune

[tune] Support lambda functions in hyperparameters / tune rllib multiagent support (#2568)

2018-08-07 16:29:21 -07:00

workers

[xray] Add error table and push error messages to driver through node manager. (#2256)

2018-06-20 21:29:28 -07:00

__init__.py

Add ray.internal.free (#2542)

2018-08-14 22:01:23 -07:00

actor.py

Introduce constant for ID_SIZE in python code. (#2517)

2018-07-31 12:40:53 -07:00

gcs_utils.py

[xray] Adds a driver table. (#2289)

2018-08-08 23:41:40 -07:00

import_thread.py

Use different serialization context for each driver. (#2406)

2018-07-20 23:42:49 -07:00

log_monitor.py

[xray] Implement timeline and profiling API. (#2306)

2018-07-04 23:23:48 -07:00

monitor.py

ray exec and ray attach commands (#2560)

2018-08-15 14:31:50 -07:00

profiling.py

Move profile data flushing to background thread on workers. (#2415)

2018-07-18 12:34:53 -07:00

ray_constants.py

[xray] Add error table and push error messages to driver through node manager. (#2256)

2018-06-20 21:29:28 -07:00

remote_function.py

Introduce constant for ID_SIZE in python code. (#2517)

2018-07-31 12:40:53 -07:00

serialization.py

Expose custom serializers through the API. (#1147)

2017-10-29 00:08:55 -07:00

services.py

[xray] Add flag to start raylet in valgrind (#2582)

2018-08-07 11:25:21 -07:00

signature.py

Printing messages to stderr (#2312)

2018-07-02 16:10:57 -07:00

utils.py

Introduce constant for ID_SIZE in python code. (#2517)

2018-07-31 12:40:53 -07:00

WebUI.ipynb

Embedded task trace with object dependencies. (#818)

2017-08-09 23:00:14 -07:00

worker.py

Updating documentation. (#2643)

2018-08-13 19:18:12 -07:00