* Add a lineage_ref_count to References
* Refactor TaskManager to store TaskEntry as a struct
* Refactor to fix deadlock between TaskManager and ReferenceCounter
Add references to task specs
* Pin TaskEntries and References in the lineage of any ObjectIDs in scope
* Fix deadlock, convert num_plasma_returns to a set of object IDs
* fix unit tests
* Feature flag
* Do not release lineage for objects that were promoted to plasma
* fix build
* fix build
* Remove num executions
* Remove num executions
* Add pinned locations to ReferenceCounter, empty handler for node death
* Fix num returns for actor tasks, fix Put return value
* Add regression test
* Clear pinned locations and callbacks on node removal
* Clear pinned locations and callbacks on node removal
* Simplify num return values
* Remove unused
* doc
* tmp
* Set num returns
* Move lineage pinning flag to ReferenceCounter
* comments
* Recover from plasma failures by pinning a new copy
* Basic object reconstruction, no concurrent reqs yet
* reconstruction test suite and a few fixes:
- fix for disabling lineage
- fix for updating submitted task refs
* Handle concurrent attempts to recover the same object
* Fix deadlock in DrainAndShutdown
* Revert "[core] Revert lineage pinning (#7499) (#7692)"
This reverts commit ba86a02b37.
* debug rllib
* debug rllib
* turn on all rllib tests again
* debug rllib
* Fix drain bug, check number of pending tasks
* revert rllib debug
* remove todo
* Trigger rllib tests
* revert rllib debug commit
* Split out logic into ObjectRecoveryManager
* Fix python tests
* Refactor to remove dependency on gcs client
* Unit tests
* Move pinned at node ID to direct memory store
* Unit test fixes and lint
* simplify and more tests
* Add ResubmitTask test for TaskManager
* Doc
* fix build
* comments
* Fix
* debug
* Update
* fix
* Fix
* Fix bad status handling, unit test
* Fix build
* regression test
* Cancel lease requests
* unit tests
* update
* fix build
* Move unit test
* Set success
* Ref to shared_ptr
* debug
* Revert "debug"
This reverts commit 6b2c25805a8223b41ffcc2d88d903e16ea415089.
* Bad move
* Fix bad status handling
* Subset and Errors
* fixup! Subset and Errors
* fixup! Subset and Errors
* fixup! Subset and Errors
* fixup! Subset and Errors
* fixup! Subset and Errors
* fixup! Subset and Errors
* fixup! Subset and Errors
* Cross language serialization for Java and Python
* Use strict types when Python serializing
* Handle recursive objects in Python; Pin msgpack >= 0.6.0, < 1.0.0
* Disable gc for optimizing msgpack loads
* Fix merge bug
* Java call Python use returnType; Fix ClassLoaderTest
* Fix RayMethodsTest
* Fix checkstyle
* Fix lint
* prepare_args raises exception if try to transfer a non-deserializable object to another language
* Fix CrossLanguageInvocationTest.java, Python msgpack treat float as double
* Minor fixes
* Fix compile error on linux
* Fix lint in java/BUILD.bazel
* Fix test_failure
* Fix lint
* Class<?> to Class<T>; Refine metadata bytes.
* Rename FST to Fst; sort java dependencies
* Change Class<?>[] to Optional<Class<?>>; sort requirements in setup.py
* Improve CrossLanguageInvocationTest
* Refactor MessagePackSerializer.java
* Refactor MessagePackSerializer.java; Refine CrossLanguageInvocationTest.java
* Remove unnecessary dependencies for Java; Add getReturnType() for RayFunction in Java
* Fix bug
* Remove custom cross language type support
* Replace Serializer.Meta with MutableBoolean
* Remove @SuppressWarnings support from checkstyle.xml; Add null test in CrossLanguageInvocationTest.java
* Refine MessagePackSerializer.pack
* Ray.get support RayObject as input
* Improve comments and error info
* Remove classLoader argument from serializer
* Separate msgpack from pickle5 in Python
* Pair<byte[], MutableBoolean> to Pair<byte[], Boolean>
* Remove public static <T> T get(RayObject<T> object), use RayObject.get() instead
* Refine test
* small fixes
Co-authored-by: 刘宝 <po.lb@antfin.com>
Co-authored-by: Hao Chen <chenh1024@gmail.com>
Philipp Moritz