Kuntai Du a4feba929b

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

..

convert-results-json-to-markdown.py

[CI] Avoid naming different metrics with the same name in performance benchmark (#5615)

2024-06-17 21:37:18 -07:00

download-tokenizer.py

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

get-lmdeploy-modelname.py

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

launch-trt-server.sh

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

nightly-annotate.sh

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

plot-nightly-results.py

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

run-lmdeploy-nightly.sh

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

run-tgi-nightly.sh

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

run-trt-nightly.sh

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

run-vllm-nightly.sh

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

summary-nightly-results.py

[CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362)

2024-07-11 13:28:38 -07:00

wait-for-image.sh

[CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with perf-benchmarks label (#5073)

2024-06-13 22:36:20 -07:00