Cyrus LeungandGitHub 133707123e [Model] Replace embedding models with pooling adapter (#10769) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2024-12-01 08:02:54 +08:00

..

fused_moe

[Model] Clean up MiniCPMV (#10751)

2024-11-29 04:47:06 +00:00

mamba

[Model] factoring out MambaMixer out of Jamba (#8993)

2024-11-04 18:00:00 +00:00

quantization

[Bugfix] Fix GGUF inference with FP16 unquantized checkpoint (#10675)

2024-11-27 10:43:17 -08:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

Remove ScaledActivation for AWQ (#10057)

2024-11-06 14:27:06 +00:00

layernorm.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00

linear.py

[Bugfix] Fix Phi-3 BNB quantization with tensor parallel (#9948)

2024-11-22 15:01:56 +08:00

logits_processor.py

[Hardware][Intel-Gaudi] Add Intel Gaudi (HPU) inference backend (#6143)

2024-11-06 01:09:10 -08:00

pooler.py

[Model] Replace embedding models with pooling adapter (#10769)

2024-12-01 08:02:54 +08:00

rejection_sampler.py

[5/N][torch.compile] torch.jit.script --> torch.compile (#10406)

2024-11-18 23:20:06 +08:00

resampler.py

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

rotary_embedding.py

[Bugfix] Fix mrope_position_delta in non-last prefill chunk (#10403)

2024-11-17 08:50:24 +00:00

sampler.py

[V1] Make v1 more testable (#9888)

2024-11-06 11:57:35 -08:00

spec_decode_base_sampler.py

Remove hard-dependencies of Speculative decode to CUDA workers (#10587)

2024-11-26 17:57:11 -08:00

typical_acceptance_sampler.py

Fix typical acceptance sampler with correct recovered token ids (#8562)

2024-09-23 12:32:27 -07:00

vocab_parallel_embedding.py

[5/N][torch.compile] torch.jit.script --> torch.compile (#10406)

2024-11-18 23:20:06 +08:00