Jason T. GreeneandGitHub f1d1bf6288 [Bugfix] Fix fully sharded LoRAs with Mixtral (#11390) ...

Signed-off-by: Jason Greene <jason.greene@redhat.com>

2024-12-22 23:25:10 +08:00

..

ops

[Kernel] Register punica ops directly (#10522)

2024-11-21 09:18:11 -08:00

punica_wrapper

[Misc] Minor improvements to the readability of PunicaWrapperBase (#11200)

2024-12-14 16:38:27 +00:00

__init__.py

[Experimental] Add multi-LoRA support (#1804)

2024-01-23 15:26:37 -08:00

fully_sharded_layers.py

[Misc][LoRA] Clean up the function interface of Punica (#10917)

2024-12-05 13:22:28 +00:00

layers.py

[Bugfix] Fix fully sharded LoRAs with Mixtral (#11390)

2024-12-22 23:25:10 +08:00

lora.py

[Misc][LoRA] Add PEFTHelper for LoRA (#11003)

2024-12-10 11:12:01 +00:00

models.py

[Misc][LoRA] Add PEFTHelper for LoRA (#11003)

2024-12-10 11:12:01 +00:00

peft_helper.py

[Misc][LoRA] Add PEFTHelper for LoRA (#11003)

2024-12-10 11:12:01 +00:00

request.py

[Core] Support Lora lineage and base model metadata management (#6315)

2024-09-20 06:20:56 +00:00

utils.py

[LoRA] Adds support for bias in LoRA (#5733)

2024-11-12 11:08:40 -08:00

worker_manager.py

[Misc][LoRA] Replace hardcoded cuda device with configurable argument (#10223)

2024-11-12 11:10:15 +08:00