* [Serve] Added deadline awareness
Added deadline awareness while enqueuing a query
Using Blist sorted-list implementation (ascending order) to get queries according to their specified deadlines. [buffer_queues]
Exposed slo_ms via handle/http request
Added slo example
The queries in example will be executed in almost the opposite order of which they are fired
Added slo pytest
Added check for slo_ms to not be negative
Included the changes suggested
* Linting Corrections
* Adding the code changes suggested by format.sh
* Added the suggested changes
Added justification for blist
Added blist in travis/ci/install-dependencies.sh
* Fixed linting issues
* Added blist to ray/doc/requirements-doc.txt
* Implement metric interface
* Address comment: made actor_handles a dict
* Fix iteration
* Lint
* Mark lightweight actors as num_cpus=0 to prevent resource starvation
* Be more explicit about the readiness condition
* Make task_runner non-blocking
* Lint
* Implement flask_request and named python request
* Forgot to include missing files
* Address comment
* Add flask to requirements for doc (lint failed)
* Update doc requirement so lint will build
* Install flask in CI
* Fix typo in .travis.yml
* Commit and format files
* address stylistic concerns
* Replcae "Usage" by "Example" in doc
* Rename srv to serve
* Add serve to CI process; Fix 3.5 compat
* Improve determine_tests_to_run.py
* Quick cosmetic for determien_tests
* Address comments
* Address comments
* Address comment
* Fix typos and grammar
Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>
* Update python/ray/experimental/serve/global_state.py
Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>
* Use __init__ for Query and WorkIntent class
* Remove dataclasses dependency
* Rename oid to object_id for clarity
* Rename produce->enqueue_request, consume->dequeue_request
* Address last round of comment
