0aa9373d62
Revert "Removing Pyarrow dependency ( #7146 )" ( #7209 )
...
This reverts commit 2116fd3bca
2020-02-18 14:12:06 -08:00
5df801605e
Add ray.util package and move libraries from experimental ( #7100 )
2020-02-18 13:43:19 -08:00
2116fd3bca
Removing Pyarrow dependency ( #7146 )
2020-02-17 18:00:13 -08:00
3bd82d0bcd
Fix various issues/warnings that come up on Jenkins ( #7147 )
...
* Avoid warning about swap being unlimited
Currently we get the following message on Jenkins:
"Your kernel does not support swap limit capabilities or the cgroup is not mounted. Memory limited without swap."
Since we're not limiting swap anyway, we might as well avoid trying to.
https://docs.docker.com/config/containers/resource_constraints/#--memory-swap-details
* Fix escaping in re.search()
* Fix escaping in _noisy_layer()
* Raise a more descriptive error when dashboard data isn't found
* Don't error on dashboard files not being found when webui isn't required
* Change dashboard error to a warning instead
2020-02-17 16:08:55 -08:00
734629b4ea
Ssh command format ( #7176 )
2020-02-17 14:15:42 -08:00
c6d768be14
[Serve] Added support for no http route services ( #7010 )
2020-02-17 11:31:30 -08:00
a6b8bd47b0
[xlang] Cross language serialize ActorHandle ( #7134 )
2020-02-17 20:44:56 +08:00
b079787c59
Fix flaky test_get_with_timeout ( #7175 )
2020-02-16 21:10:16 -08:00
94e2fcea2e
[sgd] fp16 (apex) and scheduler support + move examples page ( #7061 )
...
* Init fp16
* fp16 and schedulers
* scheduler linking and fp16
* to fp16
* loss scaling and documentation
* more documentation
* add tests, refactor config
* moredocs
* more docs
* fix logo, add test mode, add fp16 flag
* fix tests
* fix scheduler
* fix apex
* improve safety
* fix tests
* fix tests
* remove pin memory default
* rm
* fix
* Update doc/examples/doc_code/raysgd_torch_signatures.py
* fix
* migrate changes from other PR
* ok thanks
* pass
* signatures
* lint'
* Update python/ray/experimental/sgd/pytorch/utils.py
* Apply suggestions from code review
Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com >
* should address most comments
* comments
* fix this ci
* fix tests'
* testmode
Co-authored-by: Edward Oakes <ed.nmi.oakes@gmail.com >
2020-02-16 19:04:08 -08:00
6745459f96
Apply cpython patch bpo-39492 for the reference counting issue in pickle5 ( #7177 )
...
* apply cpython patch bpo-39492 for the reference count issue
2020-02-15 21:16:13 -08:00
dc5a27dac0
Move ray.experimental.multiprocessing to ray.util.multiprocessing ( #7149 )
2020-02-14 16:17:05 -08:00
52d9189d5d
[autoscaler] port-forward for attach + redis_port ( #7145 )
...
* port-forward
* fixport
* force redis port in init mode
* test
* Update python/ray/tests/test_ray_init.py
2020-02-14 15:17:00 -08:00
f3703bafa3
[Java] Support concurrent actor calls API. ( #7022 )
...
* WIP
Temp change
Attach native thread to jvm
* Fix run mode
* Address comments.
2020-02-14 13:02:39 +08:00
0d3687a10d
No warning for docker memory > system memory ( #7151 )
2020-02-13 15:21:44 -08:00
94a286ef1d
[Java] Add session_dir as temp_dir for logs, socket files like Python ( #7044 )
...
* Support
* Add gcs_server support
* Fix ut
* Fix
* Remove unused py code
* Fix linting
* Fix cross language ci
* Fix CI
* Add docstring
* Fix
* Fix linting
* Add a singleton for config
* Refine
* fix
* Fix
* linting
* Remove FileUnit
* Fix
* Fix
* Fix
* Update java/runtime/src/main/java/org/ray/runtime/config/RayConfig.java
Co-Authored-By: Hao Chen <chenh1024@gmail.com >
* Fix streaming singleprocess CI
* Fix checkstyle
Co-authored-by: Hao Chen <chenh1024@gmail.com >
2020-02-13 17:49:52 +08:00
e904711e74
Add python tests for serialized object ID reference counting ( #7038 )
2020-02-12 16:52:07 -08:00
d91d3ea936
Split half of test_actor into test_actor_advanced ( #7143 )
2020-02-12 15:17:25 -08:00
0e94e1dc2a
[Asyncio] Increase recursion limit manually ( #7142 )
2020-02-12 14:15:36 -08:00
5dda0b66bf
[Dashboard] Refactor dialogs to use parent component state instead of routes ( #7129 )
2020-02-12 10:59:47 -08:00
d941ac6c89
Updating package-lock.json with latest npm ( #7128 )
2020-02-12 09:54:20 -08:00
305eaaabe9
Fix hang if actor object id is returned from a task that exits ( #6885 )
2020-02-11 20:28:13 -08:00
039d2cde88
Change log level for OMP warning ( #7114 )
2020-02-11 14:15:38 -08:00
d7ff55852a
[tune][Dashboard] Added Tune Dashboard ( #6911 )
2020-02-11 11:56:49 -08:00
0ddc389830
Fix documentation building with psutil issue ( #7077 )
2020-02-11 10:00:29 -08:00
58c94f6381
[core] Delete() should never remote objects from in-memory store ( #7117 )
2020-02-10 22:40:09 -08:00
4139e02f01
[autoscaler] Add `--all-nodes` option to rsync-up ( #7065 )
...
* Add option to sync workers to rsync-up
* Format
* Rename --sync-workers to --all-nodes
2020-02-10 16:27:59 -08:00
6e1c3ea824
[RLlib] Exploration API (+EpsilonGreedy sub-class). ( #6974 )
2020-02-10 15:22:07 -08:00
1e690673d8
Render tasks that are not schedulable on the dashboard. ( #7034 )
2020-02-10 14:23:06 -08:00
3f99be8dad
Add 'ray dashboard' command ( #6959 )
2020-02-10 12:55:21 -08:00
72c31e3e19
Ray nodes should respect docker limits ( #7039 )
2020-02-10 11:08:38 -08:00
247a4d022a
Fix passing empty bytes in python tasks ( #7045 )
...
* ensure data_ won't be null_ptr when size == 0
* when data_sizes[i] == 0, we should Allocate an empty buffer
* work around for pyarrow.py_buffer
* fix comments
* add null ptr check
* add test for bytes
* lint
2020-02-10 12:07:29 +08:00
694c0f2867
[Java] Enable GCS server when running java unit tests ( #7041 )
...
* enable gcs service when run java testcase
* fix ci bug
* fix windows compile bug
* fix ci bug
* restart ci job
* enable java testcase
* restart ci job
* restart ci job
* add debug log
* add debug log
* restart ci job
* add debug log
* restart ci
* add debug log
* fix java testcase bug
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
* restart ci job
2020-02-10 09:39:14 +08:00
48e2adbc21
[tune] Remove unused TF loggers ( #7090 )
2020-02-09 13:58:24 -08:00
98a07fe37e
[tune] Asynchronous saves ( #6912 )
...
* Support asynchronous saves
* Fix merge issues
* Add test, fix existing tests
* More informative warning
* Lint, remove print statements
* Address comments, add checkpoint.is_resolved fn
* Add more detailed comments
2020-02-09 12:17:45 -08:00
0648bd28ef
[xlang] Cross language Python support ( #6709 )
2020-02-08 13:01:28 +08:00
f146d05b36
[Serve] Added support for composing arbitrary DAGs ( #7015 )
2020-02-07 17:55:26 -08:00
3333ee84a5
Fix ref counting ( #7075 )
2020-02-06 14:35:08 -08:00
a0ba4499ac
[Serve] Fix batching bug
2020-02-05 14:18:19 -08:00
0826f95e1c
Including psutil & setproctitle ( #7031 )
2020-02-05 14:16:58 -08:00
93ed86f175
[Tune] logger.py: Relax TBX Summary ValueErrors with e.g. empty lists in lists (and all… ( #6987 )
2020-02-05 12:02:39 -08:00
ade7ebfc0c
Add service based gcs client ( #6686 )
2020-02-05 12:06:25 +08:00
37053443b4
Restore set omp ( #7051 )
2020-02-04 15:02:23 -08:00
dd095c476a
Move serve and asyncio tests to bazel ( #6979 )
2020-02-04 08:29:16 -08:00
844f607c93
Collect contained ObjectIDs during deserialization ( #7029 )
2020-02-03 22:49:14 -08:00
5e8ded344a
[Serve] Fix flaky test with nursery double init ( #6982 )
2020-02-03 21:32:12 -08:00
984490d2be
Collect object IDs during serialization ( #6946 )
2020-02-03 18:38:11 -08:00
ca5a9c6739
Exclude test profiling info endpoint ( #7030 )
...
* Skip test_profiling_info_endpoint when pytest running locally
* Fixed formatting.
* Fixed the reason for skipping the test based on pr comments
2020-02-03 16:49:03 -08:00
42cbf801e1
workaround for python3.5 fast numpy serialization ( #6675 )
2020-02-03 13:08:18 -08:00
271de9b04d
[Dashboard] Remove files used by previous dashboard ( #7028 )
2020-02-03 11:51:09 -08:00
740bd00651
Use 100k for memory limit #7013 )
2020-02-02 22:48:59 -08:00
Eric Liang