omer-dayan 995f56236b

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192) ...

Signed-off-by: OmerD <omer@run.ai>

2024-12-20 16:46:24 +00:00

..

_static

[doc] fix location of runllm widget (#10266)

2024-11-12 14:34:39 -08:00

_templates/sections

[Doc] Guide for adding multi-modal plugins (#6205)

2024-07-10 14:55:34 +08:00

assets

[Doc] add documentation for disaggregated prefilling (#11197)

2024-12-15 13:31:16 -06:00

automatic_prefix_caching

[doc] format fix (#10789)

2024-11-30 11:38:40 +00:00

community

[Docs] Add Nebius as sponsors (#10371)

2024-11-15 12:47:40 -08:00

contributing

[Doc] Move PR template content to docs (#10159)

2024-11-15 13:20:20 -08:00

design

[Core] V1: Use multiprocessing by default (#11074)

2024-12-13 16:27:32 -08:00

dev

[Doc] Move CONTRIBUTING to docs site (#9924)

2024-11-08 05:15:12 +00:00

getting_started

[doc] backward compatibility for 0.6.4 (#11359)

2024-12-19 21:33:53 -08:00

models

[Model] Add JambaForSequenceClassification model (#10860)

2024-12-19 22:48:06 +08:00

performance

Doc: Improve benchmark documentation (#9927)

2024-11-06 23:50:35 -08:00

quantization

[[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201)

2024-12-15 03:03:06 +00:00

serving

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

2024-12-20 16:46:24 +00:00

usage

[Model] IBM Granite 3.1 (#11307)

2024-12-19 11:27:24 +08:00

conf.py

[Core][Performance] Add XGrammar support for guided decoding and set it as default (#10785)

2024-12-03 15:17:00 +08:00

generate_examples.py

Add example scripts to documentation (#4225)

2024-04-22 16:36:54 +00:00

index.rst

[Core] Loading model from S3 using RunAI Model Streamer as optional loader (#10192)

2024-12-20 16:46:24 +00:00