20231088/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
vllm/tests
History
Michael Goin b4fe16c75b
Add vllm bench [latency, throughput] CLI commands (#16508) 
Signed-off-by: mgoin <mgoin64@gmail.com>
2025-04-14 23:10:35 -07:00
..
async_engine
[V1] V1 Enablement Oracle (#13726)
2025-03-14 22:02:20 -07:00
basic_correctness
[core] Add tags parameter to wake_up() (#15500)
2025-04-02 01:59:27 -07:00
benchmarks
Add vllm bench [latency, throughput] CLI commands (#16508)
2025-04-14 23:10:35 -07:00
compile
[BugFix] Fix fusion test and add them to CI (#16287)
2025-04-08 23:46:45 -07:00
config
[Feature] specify model in config.yaml (#15798)
2025-04-01 01:20:06 -07:00
core
[V1] Implement sliding window attention in kv_cache_manager (#14097)
2025-04-01 00:33:17 -07:00
detokenizer
[V1] V1 Enablement Oracle (#13726)
2025-03-14 22:02:20 -07:00
distributed
[Distributed] Add custom allreduce support for ROCM (#14125)
2025-03-31 22:49:12 -07:00
encoder_decoder
[V1] V1 Enablement Oracle (#13726)
2025-03-14 22:02:20 -07:00
engine
[Bugfix] Proper input validation for multi-modal encoder-decoder models (#16156)
2025-04-08 09:45:21 -07:00
entrypoints
[Core][V0] Enable regex support with xgrammar (#13228)
2025-04-14 10:13:38 +08:00
fastsafetensors_loader
[Core] Integrate fastsafetensors loader for loading model weights (#10647)
2025-03-24 08:08:02 -07:00
kernels
[Bugfix] Fix tests/kernels/test_mamba_ssm_ssd.py (#16623)
2025-04-15 05:35:38 +00:00
kv_transfer
[Misc] Replace os environ to monkeypatch in test suite (#14516)
2025-03-16 20:35:57 -07:00
lora
[Bugfix] Multi-modal caches not acting like LRU caches (#16593)
2025-04-14 09:24:16 -07:00
metrics
[V1][Spec Decode] Remove deprecated spec decode config params (#15466)
2025-03-31 09:19:35 -07:00
mistral_tool_use
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
model_executor
[FEAT][ROCm] Integrate Fused MoE Kernels from AITER (#14967)
2025-03-26 16:30:30 +08:00
models
[Bugfix] Fix broken GritLM model and tests (missing pooling_metadata) (#16631)
2025-04-14 23:09:58 -07:00
mq_llm_engine
[Misc] Replace os environ to monkeypatch in test suite (#14516)
2025-03-16 20:35:57 -07:00
multi_step
[Misc] Replace os environ to monkeypatch in test suite (#14516)
2025-03-16 20:35:57 -07:00
multimodal
[V1] Enable multi-input by default (#15799)
2025-04-12 08:52:39 +00:00
neuron
[Neuron][kernel] Fuse kv cache into a single tensor (#15911)
2025-04-03 09:51:32 -07:00
plugins
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
plugins_tests
[V1] Scheduler Refactoring [1/N] - Add Scheduler Interface (#15250)
2025-03-20 17:50:43 -07:00
prefix_caching
[Misc] Replace os environ to monkeypatch in test suite (#14516)
2025-03-16 20:35:57 -07:00
prompt_adapter
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
prompts
[BugFix] Fix input positions for long context with sliding window (#2088)
2023-12-13 12:28:13 -08:00
quantization
[Bugfix] Fix bugs of running Quark quantized models (#16236)
2025-04-11 10:18:32 -04:00
reasoning
[Bugfix][Frontend] Eliminate regex based check in reasoning full generator (#14821)
2025-03-28 11:20:35 +00:00
runai_model_streamer_test
[1/n][CI] Load models in CI from S3 instead of HF (#13205)
2025-02-19 07:34:59 +00:00
samplers
[Core][Bugfix] Fix Offline MM Beam Search (#16390)
2025-04-15 10:33:02 +08:00
spec_decode
[V1][Spec Decode] Remove deprecated spec decode config params (#15466)
2025-03-31 09:19:35 -07:00
standalone_tests
[Build] Make sure local main branch is synced when VLLM_USE_PRECOMPILED=1 (#13921)
2025-03-03 16:43:14 +08:00
system_messages
[V1] Implement Cascade Attention (#11635)
2025-01-01 21:56:46 +09:00
tensorizer_loader
[Core] Update dtype detection and defaults (#14858)
2025-03-19 13:49:33 +08:00
tokenization
[V1] Avoid redundant input processing in n>1 case (#14985)
2025-03-20 22:24:10 -07:00
tool_use
[Frontend] Added chat templates for LLaMa4 pythonic tool calling (#16463)
2025-04-12 06:26:17 +08:00
tpu
[TPU][V1] Refine tpu_model_runner to mitigate future recompilation issues (#16275)
2025-04-09 18:51:51 -06:00
tracing
[Misc] Replace os environ to monkeypatch in test suite (#14516)
2025-03-16 20:35:57 -07:00
v1
[TPU][V1] Fix exponential padding when max-num-batched-tokens is not a power of 2 (#16596)
2025-04-14 17:01:05 +00:00
vllm_test_utils
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
weight_loading
[V1] V1 Enablement Oracle (#13726)
2025-03-14 22:02:20 -07:00
worker
[V1] V1 Enablement Oracle (#13726)
2025-03-14 22:02:20 -07:00
__init__.py
[Small] Formatter only checks lints in changed files (#1528)
2023-10-31 15:39:38 -07:00
build_cython.py
[Build] Cython compilation support fix (#14296)
2025-03-24 23:37:54 +00:00
conftest.py
[Core][Bugfix] Fix Offline MM Beam Search (#16390)
2025-04-15 10:33:02 +08:00
test_cache_block_hashing.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
test_config.py
Default to generation_config from model (#12622)
2025-03-08 14:46:15 +08:00
test_embedded_commit.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_inputs.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
test_logger.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
test_logits_processor.py
Update deprecated Python 3.8 typing (#13971)
2025-03-02 17:34:51 -08:00
test_regression.py
[Misc] Replace os environ to monkeypatch in test suite (#14516)
2025-03-16 20:35:57 -07:00
test_sampling_params.py
[Bugfix][Frontend] respect provided default guided decoding backend (#15476)
2025-04-09 05:11:10 -07:00
test_scalartype.py
[NVIDIA] Support nvfp4 quantization (#12784)
2025-02-12 19:51:51 -08:00
test_seed_behavior.py
[Bugfix] fix flaky test (#13089)
2025-02-11 14:41:20 +00:00
test_sequence.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
test_sharded_state_loader.py
[Misc] Fix test_sharded_state_loader.py(#16004) (#16005)
2025-04-09 14:47:30 +08:00
test_utils.py
[Bugfix] Multi-modal caches not acting like LRU caches (#16593)
2025-04-14 09:24:16 -07:00
test_version.py
[Metrics] Add --show-hidden-metrics-for-version CLI arg (#13295)
2025-02-22 00:20:45 -08:00
utils.py
[Metrics] Hide deprecated metrics (#15458)
2025-04-02 07:37:19 -07:00