ray/python/ray/experimental/streaming at c1d4ab8bb4739c32abcac32977cbf7ddc0f6910d - ray

mirror of https://github.com/wassname/ray.git synced 2026-06-30 04:52:23 +08:00

Files

T

Edward Oakes 1ce521a7f3 Remove task context from python worker (#5987 )

Removes duplicated state between the python and C++ workers. Also cleans up the serialization codepaths a bit.

2019-10-25 07:38:33 -07:00

benchmarks/micro

Initial Skeleton for Streaming API (#4126 )

2019-02-26 12:15:08 -08:00

examples

Initial Skeleton for Streaming API (#4126 )

2019-02-26 12:15:08 -08:00

__init__.py

Initial Skeleton for Streaming API (#4126 )

2019-02-26 12:15:08 -08:00

batched_queue.py

Remove task context from python worker (#5987 )

2019-10-25 07:38:33 -07:00

communication.py

Initial Skeleton for Streaming API (#4126 )

2019-02-26 12:15:08 -08:00

operator_instance.py

Initial Skeleton for Streaming API (#4126 )

2019-02-26 12:15:08 -08:00

operator.py

Initial Skeleton for Streaming API (#4126 )

2019-02-26 12:15:08 -08:00

README.rst

Initial Skeleton for Streaming API (#4126 )

2019-02-26 12:15:08 -08:00

streaming.py

Initial Skeleton for Streaming API (#4126 )

2019-02-26 12:15:08 -08:00

README.rst

Streaming Library
=================

Dependencies:

Install NetworkX: ``pip install networkx``

Examples:

- simple.py: A simple example with stateless operators and different parallelism per stage.

Run ``python simple.py --input-file toy.txt``

- wordcount.py: A streaming wordcount example with a stateful operator (rolling sum).

Run ``python wordcount.py --titles-file articles.txt``