Philipp Moritz 33d3914b1e

[Bugfix] Fix dynamic FP8 quantization for Mixtral (#4793)

2024-05-13 19:00:27 -04:00

..

__init__.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

arctic.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

baichuan.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

bloom.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

chatglm.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

commandr.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

dbrx.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

decilm.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

deepseek.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

falcon.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

gemma.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

gpt2.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

gpt_bigcode.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

gpt_j.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

gpt_neox.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

internlm2.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

jais.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

llama_embedding.py

[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (#3734)

2024-05-11 11:30:37 -07:00

llama.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

llava.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

minicpm.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

mixtral_quant.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

mixtral.py

[Bugfix] Fix dynamic FP8 quantization for Mixtral (#4793)

2024-05-13 19:00:27 -04:00

mpt.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

olmo.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

opt.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

orion.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

phi.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

qwen2_moe.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

qwen2.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

qwen.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

stablelm.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

starcoder2.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00

xverse.py

[Misc] Enhance attention selector (#4751)

2024-05-13 10:47:25 -07:00