Vincent a4f1ee35d6

Deprecate best_of Sampling Parameter in anticipation for vLLM V1 (#13997) ...

Signed-off-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2025-03-05 20:22:43 +00:00

..

basic

Merge similar examples in offline_inference into single basic example (#12737)

2025-02-20 04:53:51 -08:00

openai

[CI/Build] Auto-fix Markdown files (#12941)

2025-02-08 04:25:15 -08:00

profiling_tpu

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

audio_language.py

[Doc] Consolidate whisper and florence2 examples (#14050)

2025-02-28 22:49:15 -08:00

chat_with_tools.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

cpu_offload_lmcache.py

[Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953)

2025-02-25 00:38:42 -08:00

data_parallel.py

[V1] EP/TP MoE + DP Attention (#13931)

2025-03-04 21:27:26 -08:00

disaggregated_prefill_lmcache.py

[Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953)

2025-02-25 00:38:42 -08:00

disaggregated_prefill.py

[Bugfix] Offline example of disaggregated prefill (#13214)

2025-02-13 20:20:47 -08:00

distributed.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

encoder_decoder_multimodal.py

[Doc] Consolidate whisper and florence2 examples (#14050)

2025-02-28 22:49:15 -08:00

encoder_decoder.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

llm_engine_example.py

Deprecate best_of Sampling Parameter in anticipation for vLLM V1 (#13997)

2025-03-05 20:22:43 +00:00

lora_with_quantization_inference.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

mlpspeculator.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

multilora_inference.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

neuron_int8_quantization.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

neuron.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

pixtral.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

prefix_caching.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

prithvi_geospatial_mae.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

profiling.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

rlhf_colocate.py

[BugFix] Pop instead of del CUDA_VISIBLE_DEVICES (#12962)

2025-02-12 00:21:50 +08:00

rlhf.py

[BugFix] Pop instead of del CUDA_VISIBLE_DEVICES (#12962)

2025-02-12 00:21:50 +08:00

save_sharded_state.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

simple_profiling.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

structured_outputs.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

torchrun_example.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

tpu.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

vision_language_embedding.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

vision_language_multi_image.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

vision_language.py

[Bugfix] Fix broken vision language example (#14292)

2025-03-05 15:57:10 +00:00