20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
vllm/cacheflow/model_executor/parallel_utils/README.md

1 line
169 B
Markdown
Raw Normal View History

Support tensor parallel (#2)
2023-03-22 04:45:42 +08:00
The files in this folder are ported from [Megatron-LM](https://github.com/NVIDIA/Megatron-LM/tree/main/megatron/core). We only keep the codes that are used in inference.
Reference in New Issue Copy Permalink