20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

[Model] add a lora module for granite 3.0 MoE models (#9673)

Browse Source
This commit is contained in:
Will Johnson 2024-10-25 01:00:17 -04:00 committed by GitHub
parent 9f7b4ba865
commit a6f3721861
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
vllm/model_executor/models/granitemoe.py
View File

@ -324,6 +324,7 @@ class GraniteMoeForCausalLM(nn.Module, SupportsLoRA, SupportsPP):
"o_proj", "o_proj",
"embed_tokens", "embed_tokens",
"lm_head", "lm_head",
"layer",
] ]
embedding_modules = { embedding_modules = {
"embed_tokens": "input_embeddings", "embed_tokens": "input_embeddings",