Reid 35e076b3a8

[Misc] update api_client example (#16459) ...

Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

2025-04-11 10:05:40 +00:00

..

chart-helm

[CI/Build] Auto-fix Markdown files (#12941)

2025-02-08 04:25:15 -08:00

disagg_examples

[Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957)

2025-03-29 04:01:46 -07:00

opentelemetry

Deprecate best_of Sampling Parameter in anticipation for vLLM V1 (#13997)

2025-03-05 20:22:43 +00:00

prometheus_grafana

fix typo of grafana dashboard, with correct datasource (#13668)

2025-02-21 18:21:05 +00:00

api_client.py

[Misc] update api_client example (#16459)

2025-04-11 10:05:40 +00:00

cohere_rerank_client.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

disaggregated_prefill.sh

[Frontend][Bugfix] support prefill decode disaggregation on deepseek (#14824)

2025-03-20 00:00:33 -07:00

gradio_openai_chatbot_webserver.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

gradio_webserver.py

[Bugfix] Fix small typo in the example of Streaming delimiter (#14793)

2025-03-14 08:05:17 +00:00

jinaai_rerank_client.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

multi-node-serving.sh

[Misc] Adding script to setup ray for multi-node vllm deployments (#12913)

2025-02-20 21:16:40 -08:00

openai_chat_completion_client_for_multimodal.py

[Model] Ultravox Model: Support v0.5 Release (#12912)

2025-02-10 22:02:48 +00:00

openai_chat_completion_client_with_tools_required.py

[Frontend] Implement Tool Calling with tool_choice='required' (#13483)

2025-04-02 07:45:45 -07:00

openai_chat_completion_client_with_tools.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

openai_chat_completion_client.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

openai_chat_completion_structured_outputs_with_reasoning.py

[Bugfix][Structured Output] Support outlines engine with reasoning outputs for DeepSeek R1 (#14114)

2025-03-06 03:49:20 +00:00

openai_chat_completion_structured_outputs.py

[Frontend] Add backend-specific options for guided decoding (#13505)

2025-02-20 15:07:58 -05:00

openai_chat_completion_tool_calls_with_reasoning.py

[Frontend] Support tool calling and reasoning parser (#14511)

2025-03-23 14:00:07 -07:00

openai_chat_completion_with_reasoning_streaming.py

[Model] Add Reasoning Parser for Granite Models (#14202)

2025-03-26 14:28:07 +00:00

openai_chat_completion_with_reasoning.py

[Model] Add Reasoning Parser for Granite Models (#14202)

2025-03-26 14:28:07 +00:00

openai_chat_embedding_client_for_multimodal.py

[Misc] fixed 'required' is an invalid argument for positionals (#13948)

2025-02-27 09:06:49 +00:00

openai_completion_client.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

openai_cross_encoder_score.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

openai_embedding_client.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

openai_pooling_client.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

openai_transcription_client.py

[Frontend][Docs] Transcription API streaming (#13301)

2025-03-06 10:39:35 +00:00

run_cluster.sh

[Doc] Move examples into categories (#11840)

2025-01-08 13:09:53 +00:00

sagemaker-entrypoint.sh

[Doc] Move examples into categories (#11840)

2025-01-08 13:09:53 +00:00