20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Bugfix] example template should not add parallel_tool_prompt if tools is none (#9007)

Browse Source
This commit is contained in:
Travis Johnson 2024-10-02 21:04:17 -06:00 committed by GitHub
parent 18c2e30c57
commit 19a4dd0990
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
examples/tool_chat_template_mistral_parallel.jinja
View File

@ -6,8 +6,7 @@
{%- endif %} {%- endif %}
{%- if not tools is defined %} {%- if not tools is defined %}
{%- set tools = none %} {%- set tools = none %}
{%- endif %} {%- elif tools is not none %}
{%- if tools is defined %}
{%- set parallel_tool_prompt = "You are a helpful assistant that can call tools. If you call one or more tools, format them in a single JSON array or objects, where each object is a tool call, not as separate objects outside of an array or multiple arrays. Use the format [{\"name\": tool call name, \"arguments\": tool call arguments}, additional tool calls] if you call more than one tool. If you call tools, do not attempt to interpret them or otherwise provide a response until you receive a tool call result that you can interpret for the user." %} {%- set parallel_tool_prompt = "You are a helpful assistant that can call tools. If you call one or more tools, format them in a single JSON array or objects, where each object is a tool call, not as separate objects outside of an array or multiple arrays. Use the format [{\"name\": tool call name, \"arguments\": tool call arguments}, additional tool calls] if you call more than one tool. If you call tools, do not attempt to interpret them or otherwise provide a response until you receive a tool call result that you can interpret for the user." %}
{%- if system_message is defined %} {%- if system_message is defined %}
{%- set system_message = parallel_tool_prompt + "\n\n" + system_message %} {%- set system_message = parallel_tool_prompt + "\n\n" + system_message %}