20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Bugfix] Fix Hermes tool call chat template bug (#8256)

Browse Source 
Co-authored-by: Kyle Mistele <kyle@constellate.ai>
This commit is contained in:
Kyle Mistele 2024-09-06 21:49:01 -05:00 committed by GitHub
parent 12dd715807
commit 41e95c5247
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 16 additions and 15 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
examples/tool_chat_template_hermes.jinja
View File

@ -97,12 +97,13 @@
{{- '{' }} {{- '{' }}
{{- '"name": "' }} {{- '"name": "' }}
{{- tool_call.name }} {{- tool_call.name }}
{{- '"}' }} {{- '"' }}
{{- ', ' }}
{%- if tool_call.arguments is defined %} {%- if tool_call.arguments is defined %}
{{- ', ' }}
{{- '"arguments": ' }} {{- '"arguments": ' }}
{{- tool_call.arguments|tojson }} {{- tool_call.arguments|tojson }}
{%- endif %} {%- endif %}
{{- '}' }}
{{- '\n</tool_call>' }} {{- '\n</tool_call>' }}
{%- endfor %} {%- endfor %}
{{- '<|im_end|>\n' }} {{- '<|im_end|>\n' }}