mirror of https://github.com/wassname/vllm.git synced 2026-07-01 22:41:35 +08:00

Files

T

Tran Quang Dai ea4adeddc1 [Bugfix] Fix E2EL mean and median stats (#9984 )

Signed-off-by: daitran2k1 <tranquangdai7a@gmail.com>

2024-11-04 09:37:58 +00:00

2024-08-06 18:17:08 +00:00

2024-10-29 14:47:44 +00:00

2024-10-17 11:38:15 -05:00

backend_request_func.py

2024-10-30 18:15:56 -07:00

benchmark_latency.py

2024-10-22 15:40:38 -07:00

benchmark_prefix_caching.py

2024-10-22 15:40:38 -07:00

benchmark_prioritization.py

2024-10-22 15:40:38 -07:00

benchmark_serving.py

2024-11-04 09:37:58 +00:00

benchmark_throughput.py

2024-10-23 16:47:20 +00:00

launch_tgi_server.sh

2024-08-27 15:07:53 -07:00

README.md

2023-06-17 03:07:40 -07:00

sonnet.txt

2024-03-27 13:39:26 -07:00

Benchmarking vLLM

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json