20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
vllm/cacheflow/parallel_utils
History
Zhuohan Li 2f49f15585
Support tensor parallel (#2)
2023-03-21 13:45:42 -07:00
..
tensor_parallel
Support tensor parallel (#2)
2023-03-21 13:45:42 -07:00
__init__.py
Support tensor parallel (#2)
2023-03-21 13:45:42 -07:00
parallel_state.py
Support tensor parallel (#2)
2023-03-21 13:45:42 -07:00
README.md
Support tensor parallel (#2)
2023-03-21 13:45:42 -07:00
utils.py
Support tensor parallel (#2)
2023-03-21 13:45:42 -07:00

README.md

The files in this folder are ported from Megatron-LM. We only keep the codes that are used in inference.