Mor ZusmanandGitHub 7fc23be81c [Kernel] W8A16 Int8 inside FusedMoE (#7415)

2024-08-16 10:06:51 -07:00

..

fused_moe

[Kernel] W8A16 Int8 inside FusedMoE (#7415)

2024-08-16 10:06:51 -07:00

ops

[CI/Build] Update PyTorch to 2.4.0 (#6951)

2024-08-01 11:11:24 -07:00

quantization

[Kernel] W8A16 Int8 inside FusedMoE (#7415)

2024-08-16 10:06:51 -07:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Doc] Add Nemotron to supported model docs (#6843)

2024-07-26 17:32:44 -04:00

layernorm.py

[Model] Add Gemma 2 (#5908)

2024-06-27 13:33:56 -07:00

linear.py

[Misc] Update awq and awq_marlin to use vLLMParameters (#7422)

2024-08-13 17:08:20 -04:00

logits_processor.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)

2024-08-13 05:33:41 +00:00

pooler.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

rejection_sampler.py

[Bugfix] Fix speculative decoding with MLPSpeculator with padded vocabulary (#7218)

2024-08-08 22:08:46 -07:00

rotary_embedding.py

[hardware] unify usage of is_tpu to current_platform.is_tpu() (#7102)

2024-08-13 00:16:42 -07:00

sampler.py

Fix empty output when temp is too low (#2937)

2024-08-14 05:31:44 +00:00

spec_decode_base_sampler.py

[SpecDecode] [Minor] Fix spec decode sampler tests (#7183)

2024-08-06 10:40:32 -07:00

typical_acceptance_sampler.py

[Bugfix] Make spec. decode respect per-request seed. (#6034)

2024-07-18 19:22:08 -07:00

vocab_parallel_embedding.py

[Core] Support loading GGUF model (#5191)

2024-08-05 17:54:23 -06:00