youngkingdom/vllm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[🚀 Ready to be merged] Added support for Jais models (#3183)

Browse Source
This commit is contained in:
Lalit Pradhan
2024-03-21 13:45:24 +04:00
committed by GitHub
parent 3bbff9e5ab
commit 4c07dd28c0
8 changed files with 596 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
docs/source/models/supported_models.rst
View File

@ -66,7 +66,11 @@ Alongside each architecture, we include some popular models that use it.
* - :code:`InternLM2ForCausalLM`
- InternLM2
- :code:`internlm/internlm2-7b`, :code:`internlm/internlm2-chat-7b`, etc.
-
-
* - :code:`JAISLMHeadModel`
- Jais
- :code:`core42/jais-13b`, :code:`core42/jais-13b-chat`, :code:`core42/jais-30b-v3`, :code:`core42/jais-30b-chat-v3`, etc.
-
* - :code:`LlamaForCausalLM`
- LLaMA, LLaMA-2, Vicuna, Alpaca, Yi
- :code:`meta-llama/Llama-2-13b-hf`, :code:`meta-llama/Llama-2-70b-hf`, :code:`openlm-research/open_llama_13b`, :code:`lmsys/vicuna-13b-v1.3`, :code:`01-ai/Yi-6B`, :code:`01-ai/Yi-34B`, etc.