mirror of
https://github.com/wassname/ray.git
synced 2026-07-04 07:18:12 +08:00
Stephanie Wang
ee08c8274b
* Implement sharding in the Ray core * Single node Python modifications to do sharding * Do the sharding in redis.cc * Pipe num_redis_shards through start_ray.py and worker.py. * Use multiple redis shards in multinode tests. * first steps for sharding ray.global_state * Fix problem in multinode docker test. * fix runtest.py * fix some tests * fix redis shard startup * fix redis sharding * fix * fix bug introduced by the map-iterator being consumed * fix sharding bug * shard event table * update number of Redis clients to be 64K * Fix object table tests by flushing shards in between unit tests * Fix local scheduler tests * Documentation * Register shard locations in the primary shard * Add plasma unit tests back to build * lint * lint and fix build * Fix * Address Robert's comments * Refactor start_ray_processes to start Redis shard * lint * Fix global scheduler python tests * Fix redis module test * Fix plasma test * Fix component failure test * Fix local scheduler test * Fix runtest.py * Fix global scheduler test for python3 * Fix task_table_test_and_update bug, from actor task table submission race * Fix jenkins tests. * Retry Redis shard connections * Fix test cases * Convert database clients to DBClient struct * Fix race condition when subscribing to db client table * Remove unused lines, add APITest for sharded Ray * Fix * Fix memory leak * Suppress ReconstructionTests output * Suppress output for APITestSharded * Reissue task table add/update commands if initial command does not publish to any subscribers. * fix * Fix linting. * fix tests * fix linting * fix python test * fix linting
44 lines
1.1 KiB
C
44 lines
1.1 KiB
C
#ifndef COMMON_PROTOCOL_H
|
|
#define COMMON_PROTOCOL_H
|
|
|
|
#include "format/common_generated.h"
|
|
|
|
#include "common.h"
|
|
|
|
#define DB_CLIENT_PREFIX "CL:"
|
|
|
|
/**
|
|
* Convert an object ID to a flatbuffer string.
|
|
*
|
|
* @param fbb Reference to the flatbuffer builder.
|
|
* @param object_id The object ID to be converted.
|
|
* @return The flatbuffer string contining the object ID.
|
|
*/
|
|
flatbuffers::Offset<flatbuffers::String> to_flatbuf(
|
|
flatbuffers::FlatBufferBuilder &fbb,
|
|
ObjectID object_id);
|
|
|
|
/**
|
|
* Convert a flatbuffer string to an object ID.
|
|
*
|
|
* @param string The flatbuffer string.
|
|
* @return The object ID.
|
|
*/
|
|
ObjectID from_flatbuf(const flatbuffers::String *string);
|
|
|
|
/**
|
|
* Convert an array of object IDs to a flatbuffer vector of strings.
|
|
*
|
|
* @param fbb Reference to the flatbuffer builder.
|
|
* @param object_ids Array of object IDs.
|
|
* @param num_objects Number of elements in the array.
|
|
* @return Flatbuffer vector of strings.
|
|
*/
|
|
flatbuffers::Offset<
|
|
flatbuffers::Vector<flatbuffers::Offset<flatbuffers::String>>>
|
|
to_flatbuf(flatbuffers::FlatBufferBuilder &fbb,
|
|
ObjectID object_ids[],
|
|
int64_t num_objects);
|
|
|
|
#endif
|