Jason T. Greene f1d1bf6288 [Bugfix] Fix fully sharded LoRAs with Mixtral (#11390) ...

Signed-off-by: Jason Greene <jason.greene@redhat.com>

2024-12-22 23:25:10 +08:00

..

data

[mypy] Enable type checking for test directory (#5017)

2024-06-15 04:45:31 +00:00

__init__.py

[Experimental] Add multi-LoRA support (#1804)

2024-01-23 15:26:37 -08:00

conftest.py

[LoRA] Adds support for bias in LoRA (#5733)

2024-11-12 11:08:40 -08:00

test_baichuan.py

[MISC] Consolidate cleanup() and refactor offline_inference_with_prefix.py (#9510)

2024-10-18 14:30:55 -07:00

test_chatglm3_tp.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_gemma.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_layers.py

[Misc][LoRA] Abstract PunicaWrapper (#10955)

2024-12-09 12:54:44 -08:00

test_llama_tp.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_long_context.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_lora_bias_e2e.py

[LoRA] Adds support for bias in LoRA (#5733)

2024-11-12 11:08:40 -08:00

test_lora_checkpoints.py

[Misc][LoRA] Support loading LoRA weights for target_modules in reg format (#9275)

2024-10-11 12:31:21 +00:00

test_lora_huggingface.py

[Core] Support dynamically loading Lora adapter from HuggingFace (#6234)

2024-07-22 15:42:40 -07:00

test_lora_manager.py

[Misc][LoRA] Add PEFTHelper for LoRA (#11003)

2024-12-10 11:12:01 +00:00

test_minicpmv_tp.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_minicpmv.py

[Bugfix] fix minicpmv test (#11304)

2024-12-18 10:34:26 -08:00

test_mixtral.py

[Bugfix] Fix fully sharded LoRAs with Mixtral (#11390)

2024-12-22 23:25:10 +08:00

test_phi.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_punica_sizes.py

[LoRA][Kernel] Remove the unused libentry module (#10214)

2024-11-11 09:43:23 +00:00

test_punica_variation.py

[Kernel] Register punica ops directly (#10522)

2024-11-21 09:18:11 -08:00

test_quant_model.py

[Misc] LoRA + Chunked Prefill (#9057)

2024-12-11 10:09:20 +08:00

test_tokenizer_group.py

[LoRA] Change lora_tokenizers capacity (#10796)

2024-12-04 17:40:16 +00:00

test_utils.py

[LoRA] Adds support for bias in LoRA (#5733)

2024-11-12 11:08:40 -08:00

test_worker.py

[2/N] executor pass the complete config to worker/modelrunner (#9938)

2024-11-02 07:35:05 -07:00

utils.py

[Misc][LoRA] Replace hardcoded cuda device with configurable argument (#10223)

2024-11-12 11:10:15 +08:00