Yihuan Bu 654bc5ca49

Support for guided decoding for offline LLM (#6878) ...

Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

2024-08-04 03:12:09 +00:00

..

_static

[Docs] Add RunLLM chat widget (#6857)

2024-07-27 09:24:46 -07:00

_templates/sections

[Doc] Guide for adding multi-modal plugins (#6205)

2024-07-10 14:55:34 +08:00

assets

[Doc] add visualization for multi-stage dockerfile (#4456)

2024-04-30 17:41:59 +00:00

automatic_prefix_caching

[Doc] Add an automatic prefix caching section in vllm documentation (#5324)

2024-06-11 10:24:59 -07:00

community

[Docs] Publish 5th meetup slides (#6799)

2024-07-25 16:47:55 -07:00

dev

[Bugfix] Fix broadcasting logic for multi_modal_kwargs (#6836)

2024-07-31 10:38:45 +08:00

getting_started

[CI/Build] Add support for Python 3.12 (#7035)

2024-08-02 13:51:22 -07:00

models

[Bugfix] Clean up MiniCPM-V (#6939)

2024-07-31 14:39:19 +00:00

performance_benchmark

[Doc] Add documentations for nightly benchmarks (#6412)

2024-07-25 11:57:16 -07:00

quantization

[bitsandbytes]: support read bnb pre-quantized model (#5753)

2024-07-23 23:45:09 +00:00

serving

[Models] Support Qwen model with PP (#6974)

2024-08-01 12:40:43 -07:00

conf.py

Support for guided decoding for offline LLM (#6878)

2024-08-04 03:12:09 +00:00

generate_examples.py

Add example scripts to documentation (#4225)

2024-04-22 16:36:54 +00:00

index.rst

[Doc] Add documentations for nightly benchmarks (#6412)

2024-07-25 11:57:16 -07:00