7 Commits

Author	SHA1	Message	Date
Simon Mo	660eef6502	[Serve] Async Router (#6873)	2020-01-30 09:34:47 -08:00
alindkhare	d78a1062db	[Serve] Pluggable Queueing Policy (#6492)	2019-12-18 21:28:38 -08:00
Simon Mo	c23eae5998	[Serve] Fix router-worker communication (#5961) ... * Half way there, needs the strict queuing fix * Fix scale down, use callback * Cleanup * Address commments * Comment, nit * Fix docstring	2019-11-04 11:29:21 -08:00
Simon Mo	9e2c5f8218	[Serve] Put global state in remote actor (#5937) ... * Making progress * Impl done, start debugging * Tests all pass * Add test, fix * Update doc * Fix type	2019-10-28 11:43:47 -07:00
Simon Mo	97a786cf11	[Serve] Remove handle passing in tail recursion (#5894) ... * Remove handle pass in tail recursion * Quick fix * Fix worker timeout issue	2019-10-12 20:13:20 -07:00
Simon Mo	e8570874b6	[Serve] Implement flask_request and named python request (#5849) ... * Implement flask_request and named python request * Forgot to include missing files * Address comment * Add flask to requirements for doc (lint failed) * Update doc requirement so lint will build * Install flask in CI * Fix typo in .travis.yml	2019-10-06 15:12:30 -07:00
Simon Mo	5f88823c49	[Serve] Rewrite Ray.Serve From Scratch (#5562) ... * Commit and format files * address stylistic concerns * Replcae "Usage" by "Example" in doc * Rename srv to serve * Add serve to CI process; Fix 3.5 compat * Improve determine_tests_to_run.py * Quick cosmetic for determien_tests * Address comments * Address comments * Address comment * Fix typos and grammar Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com> * Update python/ray/experimental/serve/global_state.py Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com> * Use __init__ for Query and WorkIntent class * Remove dataclasses dependency * Rename oid to object_id for clarity * Rename produce->enqueue_request, consume->dequeue_request * Address last round of comment	2019-09-13 21:36:56 -07:00