vllm/examples at 9ad32dacd9c4697ca06e841bd1bc97b58d2c7b3d - vllm

fp8

[mypy] Enable type checking for test directory (#5017 )

2024-06-15 04:45:31 +00:00

production_monitoring

[Bugfix] Use templated datasource in grafana.json to allow automatic imports (#6136 )

2024-07-05 09:49:47 -07:00

api_client.py

[doc][misc] further lower visibility of simple api server (#6041 )

2024-07-01 10:50:56 -07:00

aqlm_example.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718 )

2024-06-20 17:00:13 -06:00

fuyu_example.py

[Model] Initialize Fuyu-8B support (#3924 )

2024-07-14 05:27:14 +00:00

gradio_openai_chatbot_webserver.py

[CI] Try introducing isort. (#3495 )

2024-03-25 07:59:47 -07:00

gradio_webserver.py

Remove deprecated parameter: concurrency_count (#2315 )

2024-01-03 09:56:21 -08:00

llava_example.py

[vlm] Remove vision language config. (#6089 )

2024-07-03 22:14:16 +00:00

llava_next_example.py

[vlm] Remove vision language config. (#6089 )

2024-07-03 22:14:16 +00:00

llm_engine_example.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718 )

2024-06-20 17:00:13 -06:00

logging_configuration.md

[MISC] Rework logger to enable pythonic custom logging configuration to be provided (#4273 )

2024-05-01 17:34:40 -07:00

lora_with_quantization_inference.py

[Feature][Kernel] Support bitsandbytes quantization and QLoRA (#4776 )

2024-06-01 14:51:10 -06:00

multilora_inference.py

[CI] Try introducing isort. (#3495 )

2024-03-25 07:59:47 -07:00

offline_inference_arctic.py

[Model] Snowflake arctic model implementation (#4652 )

2024-05-09 22:37:14 +00:00

offline_inference_distributed.py

[mypy] Enable type checking for test directory (#5017 )

2024-06-15 04:45:31 +00:00

offline_inference_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734 )

2024-05-11 11:30:37 -07:00

offline_inference_mlpspeculator.py

[BugFix] Fix cuda graph for MLPSpeculator (#5875 )

2024-06-27 04:12:10 +00:00

offline_inference_neuron.py

Unmark more files as executable (#5962 )

2024-06-28 17:34:56 -04:00

offline_inference_openai.md

[Frontend] Support OpenAI batch file format (#4794 )

2024-05-15 19:13:36 -04:00

offline_inference_tpu.py

[CI/Build][TPU] Add TPU CI test (#6277 )

2024-07-15 14:31:16 -07:00

offline_inference_with_prefix.py

[Bugfix] Add warmup for prefix caching example (#5235 )

2024-06-03 19:36:41 -07:00

offline_inference.py

[Quality] Add code formatter and linter (#326 )

2023-07-03 11:31:55 -07:00

openai_chat_completion_client.py

Add example scripts to documentation (#4225 )

2024-04-22 16:36:54 +00:00

openai_completion_client.py

lint: format all python file instead of just source code (#2567 )

2024-01-23 15:53:06 -08:00

openai_embedding_client.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734 )

2024-05-11 11:30:37 -07:00

openai_example_batch.jsonl

[docs] Fix typo in examples filename openi -> openai (#4864 )

2024-05-17 00:42:17 +09:00

openai_vision_api_client.py

[vlm] Remove vision language config. (#6089 )

2024-07-03 22:14:16 +00:00

paligemma_example.py

[Model] Add PaliGemma (#5189 )

2024-07-07 09:25:50 +08:00

phi3v_example.py

[vlm] Remove vision language config. (#6089 )

2024-07-03 22:14:16 +00:00

save_sharded_state.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718 )

2024-06-20 17:00:13 -06:00

template_alpaca.jinja

Support chat template and echo for chat API (#1756 )

2023-11-30 16:43:13 -08:00

template_baichuan.jinja

Fix Baichuan chat template (#3340 )

2024-03-15 21:02:12 -07:00

template_chatglm2.jinja

Add chat templates for ChatGLM (#3418 )

2024-03-14 23:19:22 -07:00

template_chatglm.jinja

Add chat templates for ChatGLM (#3418 )

2024-03-14 23:19:22 -07:00

template_chatml.jinja

Support chat template and echo for chat API (#1756 )

2023-11-30 16:43:13 -08:00

template_falcon_180b.jinja

Add chat templates for Falcon (#3420 )

2024-03-14 23:19:02 -07:00

template_falcon.jinja

Add chat templates for Falcon (#3420 )

2024-03-14 23:19:02 -07:00

template_inkbot.jinja

Support chat template and echo for chat API (#1756 )

2023-11-30 16:43:13 -08:00

template_llava.jinja

[Frontend] Add OpenAI Vision API Support (#5237 )

2024-06-07 11:23:32 -07:00

tensorize_vllm_model.py

[Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718 )

2024-06-20 17:00:13 -06:00