20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
4,206 Commits 1 Branch 0 Tags
Commit Graph

619 Commits

Author SHA1 Message Date
Roger Wang
81763c58a0
[V1] Add V1 support of Qwen2-VL (#12128) 
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: imkero <kerorek@outlook.com>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-19 19:52:13 +08:00
Isotr0py
02798ecabe
[Model] Port deepseek-vl2 processor, remove dependency (#12169) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-01-18 13:59:39 +08:00
Hongxia Yang
c09503ddd6
[AMD][CI/Build][Bugfix] use pytorch stale wheel (#12172) 
Signed-off-by: hongxyan <hongxyan@amd.com>
 2025-01-18 11:15:53 +08:00
Yuan Tang
1475847a14
[Doc] Add instructions on using Podman when SELinux is active (#12136) 
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
 2025-01-17 04:45:36 +00:00
Isotr0py
62b06ba23d
[Model] Add support for deepseek-vl2-tiny model (#12068) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-01-16 17:14:48 +00:00
Cyrus Leung
f8ef146f03
[Doc] Add documentation for specifying model architecture (#12105) 2025-01-16 15:53:43 +08:00
RunningLeon
97eb97b5a4
[Model]: Support internlm3 (#12037) 2025-01-15 11:35:17 +00:00
Kyle Sayers
3f9b7ab9f5
[Doc] Update examples to remove SparseAutoModelForCausalLM (#12062) 
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
 2025-01-15 06:36:01 +00:00
Harry Mellor
c9d6ff530b
Explain where the engine args go when using Docker (#12041) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-14 16:05:50 +00:00
TJian
8a1f938e6f
[Doc] Update Quantization Hardware Support Documentation (#12025) 
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>
 2025-01-14 04:37:52 +00:00
Woosuk Kwon
1a401252b5
[Docs] Add Sky Computing Lab to project intro (#12019) 
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
 2025-01-13 17:24:36 -08:00
Harry Mellor
e8c23ff989
[Doc] Organise installation documentation into categories and tabs (#11935) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-13 12:27:36 +00:00
Roger Wang
cd8249903f
[Doc][V1] Update model implementation guide for V1 support (#11998) 
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
 2025-01-13 11:58:54 +00:00
Akshat Tripathi
8bddb73512
[Hardware][CPU] Multi-LoRA implementation for the CPU backend (#11100) 
Signed-off-by: Akshat Tripathi <akshat@krai.ai>
Signed-off-by: Oleg Mosalov <oleg@krai.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Oleg Mosalov <oleg@krai.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2025-01-12 13:01:52 +00:00
Isotr0py
f967e51f38
[Model] Initialize support for Deepseek-VL2 models (#11578) 
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-01-12 00:17:24 -08:00
Rafael Vasquez
43f3d9e699
[CI/Build] Add markdown linter (#11857) 
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
 2025-01-12 00:17:13 -08:00
Cyrus Leung
a991f7d508
[Doc] Basic guide for writing unit tests for new models (#11951) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-11 21:27:24 +08:00
Li, Jiang
aa1e77a19c
[Hardware][CPU] Support MOE models on x86 CPU (#11831) 
Signed-off-by: jiang1.li <jiang1.li@intel.com>
 2025-01-10 11:07:58 -05:00
Harry Mellor
482cdc494e
[Doc] Rename offline inference examples (#11927) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-10 23:50:29 +08:00
Cyrus Leung
12664ddda5
[Doc] [1/N] Initial guide for merged multi-modal processor (#11925) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-10 14:30:25 +00:00
Harry Mellor
d85c47d6ad
Replace "online inference" with "online serving" (#11923) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-10 12:05:56 +00:00
Cyrus Leung
3de2b1eafb
[Doc] Show default pooling method in a table (#11904) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-10 11:25:20 +08:00
Cyrus Leung
c3cf54dda4
[Doc][5/N] Move Community and API Reference to the bottom (#11896) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Simon Mo <simon.mo@hey.com>
 2025-01-10 03:10:12 +00:00
Charles Frye
36f5303578
[Docs] Add Modal to deployment frameworks (#11907) 2025-01-09 23:26:37 +00:00
Cyrus Leung
9a228348d2
[Misc] Provide correct Pixtral-HF chat template (#11891) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-09 10:19:37 -07:00
Cyrus Leung
65097ca0af
[Doc] Add model development API Reference (#11884) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-09 09:43:40 +00:00
Guspan Tanadi
a732900efc
[Doc] Intended links Python multiprocessing library (#11878) 2025-01-09 05:39:39 +00:00
Michael Goin
730e9592e9
[Doc] Recommend uv and python 3.12 for quickstart guide (#11849) 
Signed-off-by: mgoin <michael@neuralmagic.com>
 2025-01-09 11:37:48 +08:00
Cyrus Leung
5984499e47
[Doc] Expand Multimodal API Reference (#11852) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-08 17:14:14 +00:00
Cyrus Leung
6cd40a5bfe
[Doc][4/N] Reorganize API Reference (#11843) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-08 21:34:44 +08:00
Harry Mellor
aba8d6ee00
[Doc] Move examples into categories (#11840) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-08 13:09:53 +00:00
Wallas Henrique
cfd3219f58
[Hardware][Apple] Native support for macOS Apple Silicon (#11696) 
Signed-off-by: Wallas Santos <wallashss@ibm.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2025-01-08 16:35:49 +08:00
Simon Mo
a1b2b8606e
[Docs] Update sponsor name: 'Novita' to 'Novita AI' (#11833) 2025-01-07 23:05:46 -08:00
youkaichao
ad9f1aa679
[doc] update wheels url (#11830) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-01-08 14:36:49 +08:00
Simon Mo
259abd8953
[Docs] reorganize sponsorship page (#11639) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-01-07 21:16:08 -08:00
Harry Mellor
5950f555a1
[Doc] Group examples into categories (#11782) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-08 09:20:12 +08:00
sroy745
973f5dc581
[Doc]Add documentation for using EAGLE in vLLM (#11417) 
Signed-off-by: Sourashis Roy <sroy@roblox.com>
 2025-01-07 19:19:12 +00:00
Cyrus Leung
c0efe92d8b
[Doc] Add note to gte-Qwen2 models (#11808) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-07 21:50:58 +08:00
youkaichao
d9fa1c05ad
[doc] update how pip can install nightly wheels (#11806) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-01-07 21:42:58 +08:00
Roger Wang
2de197bdd4
[V1] Support audio language models on V1 (#11733) 
Signed-off-by: Roger Wang <ywang@roblox.com>
 2025-01-07 19:47:36 +08:00
youkaichao
869e829b85
[doc] add doc to explain how to use uv (#11773) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-01-07 18:41:17 +08:00
Roger Wang
8082ad7950
[V1][Doc] Update V1 support for LLaVa-NeXT-Video (#11798) 
Signed-off-by: Roger Wang <ywang@roblox.com>
 2025-01-07 09:55:39 +00:00
Russell Bryant
ce1917fcf2
[Doc] Create a vulnerability management team (#9925) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-01-06 22:57:32 -08:00
Cyrus Leung
8ceffbf315
[Doc][3/N] Reorganize Serving section (#11766) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-07 11:20:01 +08:00
Roger Wang
91b361ae89
[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685) 
Signed-off-by: Roger Wang <ywang@roblox.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-06 19:58:16 +00:00
youkaichao
4ca5d40adc
[doc] explain how to add interleaving sliding window support (#11771) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-01-06 21:57:44 +08:00
Cyrus Leung
ee77fdb5de
[Doc][2/N] Reorganize Models and Usage sections (#11755) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-06 21:40:31 +08:00
Suraj Deshmukh
2a622d704a
k8s-config: Update the secret to use stringData (#11679) 
Signed-off-by: Suraj Deshmukh <surajd.service@gmail.com>
 2025-01-06 08:01:22 +00:00
Cyrus Leung
402d378360
[Doc] [1/N] Reorganize Getting Started section (#11645) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-01-06 02:18:33 +00:00
Alberto Ferrer
d1d49397e7
Update bnb.md with example for OpenAI (#11718) 2025-01-04 06:29:02 +00:00