youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
d81edded69a5534a80785b68cde26c547cfcd4c6
vllm/examples/offline_inference
History
汪志鹏 1282bd812e Add tarsier model support (#18985) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
2025-06-03 13:13:13 +08:00
..
basic
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
disaggregated-prefill-v1
add an absolute path for run.sh (#18258)
2025-06-02 19:38:23 +00:00
openai_batch
[Frontend] add run batch to CLI (#18804)
2025-05-28 07:08:57 -07:00
profiling_tpu
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
qwen2_5_omni
[Misc] improve docs (#18734)
2025-05-27 07:07:01 +00:00
audio_language.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
automatic_prefix_caching.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
batch_llm_inference.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
chat_with_tools.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
context_extension.py
[Bugfix] Fix nomic max_model_len (#18755)
2025-05-27 20:29:53 -07:00
data_parallel.py
[BugFix] Fix multi-node offline data-parallel (#18981)
2025-05-31 08:34:52 -07:00
disaggregated_prefill.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
eagle.py
[V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010)
2025-05-27 09:37:06 +00:00
embed_jina_embeddings_v3.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
embed_matryoshka_fy.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
encoder_decoder_multimodal.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
encoder_decoder.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
llm_engine_example.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
load_sharded_state.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
lora_with_quantization_inference.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
metrics.py
[V1][Metrics] Add API for accessing in-memory Prometheus metrics (#17010)
2025-05-27 09:37:06 +00:00
mistral-small.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
mlpspeculator.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
multilora_inference.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
neuron_eagle.py
[Misc] improve docs (#18734)
2025-05-27 07:07:01 +00:00
neuron_int8_quantization.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
neuron_multimodal.py
[Neuron] Add Multi-Modal model support for Neuron (#18921)
2025-05-31 10:39:11 +00:00
neuron_speculation.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
neuron.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
prefix_caching.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
prithvi_geospatial_mae.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
profiling.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
prompt_embed_inference.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
qwen_1m.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
reproducibility.py
[Doc] Update reproducibility doc and example (#18741)
2025-05-27 07:03:13 +00:00
rlhf_colocate.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
rlhf_utils.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
rlhf.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
save_sharded_state.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
simple_profiling.py
[Misc] refactor argument parsing in examples (#16635)
2025-04-15 08:05:30 +00:00
structured_outputs.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
torchrun_example.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
tpu.py
[Hardware][TPU] Initial support of model parallelism with single worker using SPMD (#18011)
2025-06-03 00:06:20 +00:00
vision_language_embedding.py
Convert examples to ruff-format (#18400)
2025-05-26 16:57:54 +00:00
vision_language_multi_image.py
Add tarsier model support (#18985)
2025-06-03 13:13:13 +08:00
vision_language.py
Add tarsier model support (#18985)
2025-06-03 13:13:13 +08:00