Kuntai Du 81ede99ca4

[Core] Deprecating block manager v1 and make block manager v2 default (#8704) ...

Removing the block manager v1. This is the initial piece of prefix-caching-centric design. In order to achieve prefix-caching-centric design, we need to simplify the code path so that we only use v2 block manager (which has much higher performance on prefix caching).

2024-10-17 11:38:15 -05:00

..

_static

[Docs] Add RunLLM chat widget (#6857)

2024-07-27 09:24:46 -07:00

_templates/sections

[Doc] Guide for adding multi-modal plugins (#6205)

2024-07-10 14:55:34 +08:00

assets

[Doc] add visualization for multi-stage dockerfile (#4456)

2024-04-30 17:41:59 +00:00

automatic_prefix_caching

[Doc] Add an automatic prefix caching section in vllm documentation (#5324)

2024-06-11 10:24:59 -07:00

community

Add NVIDIA Meetup slides, announce AMD meetup, and add contact info (#8319)

2024-09-09 23:21:00 -07:00

dev

[Core] Rename input data types (#8688)

2024-10-16 10:49:37 +00:00

getting_started

[Hardware][CPU] compressed-tensor INT8 W8A8 AZP support (#9344)

2024-10-17 12:21:04 -04:00

models

[Core] Deprecating block manager v1 and make block manager v2 default (#8704)

2024-10-17 11:38:15 -05:00

performance_benchmark

[Doc] fix 404 link (#7966)

2024-08-28 13:54:23 -07:00

quantization

[Hardware][CPU] Support AWQ for CPU backend (#7515)

2024-10-09 10:28:08 -06:00

serving

[Doc] Compatibility matrix for mutual exclusive features (#8512)

2024-10-11 11:18:50 -07:00

conf.py

[model] Support for Llava-Next-Video model (#7559)

2024-09-10 22:21:36 -07:00

generate_examples.py

Add example scripts to documentation (#4225)

2024-04-22 16:36:54 +00:00

index.rst

[Doc] Compatibility matrix for mutual exclusive features (#8512)

2024-10-11 11:18:50 -07:00