This website requires JavaScript.
Explore
Help
Register
Sign In
20231088
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
1
Packages
Projects
Releases
Wiki
Activity
vllm
/
docs
/
source
/
quantization
History
Dipika Sikka
23f322297f
[Misc] Remove
SqueezeLLM
(
#8220
)
2024-09-06 16:29:03 -06:00
..
auto_awq.rst
[Doc] fix the autoAWQ example (
#7937
)
2024-08-28 12:12:32 +00:00
bnb.rst
[bitsandbytes]: support read bnb pre-quantized model (
#5753
)
2024-07-23 23:45:09 +00:00
fp8_e4m3_kvcache.rst
[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (
#7208
)
2024-08-12 22:47:41 +00:00
fp8_e5m2_kvcache.rst
[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (
#7208
)
2024-08-12 22:47:41 +00:00
fp8.rst
[Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (
#7444
)
2024-08-16 13:59:16 -07:00
int8.rst
[Doc] Add docs for llmcompressor INT8 and FP8 checkpoints (
#7444
)
2024-08-16 13:59:16 -07:00
supported_hardware.rst
[Misc] Remove
SqueezeLLM
(
#8220
)
2024-09-06 16:29:03 -06:00