Yihua Cheng 3408e47159

[P/D][V1] KV Connector API V1 (#15960) ...

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Signed-off-by: remi <remi@mistral.ai>
Co-authored-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>

2025-04-17 13:22:40 -07:00

..

offline_inference

[P/D][V1] KV Connector API V1 (#15960)

2025-04-17 13:22:40 -07:00

online_serving

[Doc] Document Matryoshka Representation Learning support (#16770)

2025-04-17 13:37:37 +00:00

other

[Doc] Fix typo in documentation (#14783)

2025-03-13 20:33:09 -07:00

template_alpaca.jinja

Support chat template and echo for chat API (#1756)

2023-11-30 16:43:13 -08:00

template_baichuan.jinja

Fix Baichuan chat template (#3340)

2024-03-15 21:02:12 -07:00

template_blip2.jinja

[Model] Initial support for BLIP-2 (#5920)

2024-07-27 11:53:07 +00:00

template_chatglm2.jinja

Add chat templates for ChatGLM (#3418)

2024-03-14 23:19:22 -07:00

template_chatglm.jinja

Add chat templates for ChatGLM (#3418)

2024-03-14 23:19:22 -07:00

template_chatml.jinja

Support chat template and echo for chat API (#1756)

2023-11-30 16:43:13 -08:00

template_deepseek_vl2.jinja

[Misc] Correct deepseek-vl2 chat template (#14558)

2025-03-11 04:37:11 +00:00

template_dse_qwen2_vl.jinja

[Model] Adding Support for Qwen2VL as an Embedding Model. Using MrLight/dse-qwen2-2b-mrl-v1 (#9944)

2024-11-13 08:28:13 +00:00

template_falcon_180b.jinja

Add chat templates for Falcon (#3420)

2024-03-14 23:19:02 -07:00

template_falcon.jinja

Add chat templates for Falcon (#3420)

2024-03-14 23:19:02 -07:00

template_florence2.jinja

[VLM] Florence-2 supports online serving (#16164)

2025-04-07 04:04:02 -07:00

template_inkbot.jinja

Support chat template and echo for chat API (#1756)

2023-11-30 16:43:13 -08:00

template_llava.jinja

[Frontend] Add OpenAI Vision API Support (#5237)

2024-06-07 11:23:32 -07:00

template_teleflm.jinja

[Model] Support Tele-FLM Model (#15023)

2025-03-22 02:04:44 -07:00

template_vlm2vec.jinja

[Frontend] Use a proper chat template for VLM2Vec (#9912)

2024-11-01 14:09:07 +00:00

tool_chat_template_granite_20b_fc.jinja

[Model] tool calling support for ibm-granite/granite-20b-functioncalling (#8339)

2024-10-29 15:07:37 -07:00

tool_chat_template_granite.jinja

Change granite chat template to keep json list formatting for tool calls (#10452)

2024-11-19 18:16:54 -07:00

tool_chat_template_hermes.jinja

[Bugfix] Fix Hermes tool call chat template bug (#8256)

2024-09-07 10:49:01 +08:00

tool_chat_template_internlm2_tool.jinja

[Frontend][Feature] support tool calling for internlm/internlm2_5-7b-chat model (#8405)

2024-10-04 10:36:39 +08:00

tool_chat_template_llama3.1_json.jinja

[Bugfix][Frontend] Update Llama Chat Templates to also support Non-Tool use (#10164)

2024-11-23 10:17:38 +08:00

tool_chat_template_llama3.2_json.jinja

[Misc] Update llama 3.2 template to support system prompt with images (#10901)

2024-12-05 05:54:06 +00:00

tool_chat_template_llama3.2_pythonic.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

2025-04-06 07:44:36 +00:00

tool_chat_template_llama4_pythonic.jinja

[Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463)

2025-04-12 06:26:17 +08:00

tool_chat_template_mistral_parallel.jinja

[Bugfix] example template should not add parallel_tool_prompt if tools is none (#9007)

2024-10-03 03:04:17 +00:00

tool_chat_template_mistral.jinja

[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistral models (#5649)

2024-09-04 13:18:13 -07:00

tool_chat_template_phi4_mini.jinja

[Frontend] Add Phi-4-mini function calling support (#14886)

2025-03-31 22:50:05 -07:00

tool_chat_template_toolace.jinja

[Frontend] Fix typo in tool chat templates for llama3.2 and toolace (#14501)

2025-04-06 07:44:36 +00:00