SangBin ChoandGitHub 603ad84815 [Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

..

__init__.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

test_model_runner.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

test_swap.py

[Core] Refactor model loading code (#4097)

2024-04-16 11:34:39 -07:00