[Docs][V1] Prefix caching design (#12598)

Browse Source

- Create v1 design document section in docs.
- Add prefix caching design doc.

@WoosukKwon @ywang96

---------

Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>

...

This commit is contained in:

Cody Yu

2025-01-31 12:30:46 -08:00

committed by GitHub

parent 847f883232

commit 60bcef000e

10 changed files with 235 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

docs/source/assets/design/v1/prefix_caching/example-time-1.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 34 KiB

docs/source/assets/design/v1/prefix_caching/example-time-3.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 36 KiB

docs/source/assets/design/v1/prefix_caching/example-time-4.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 41 KiB

docs/source/assets/design/v1/prefix_caching/example-time-5.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 39 KiB

docs/source/assets/design/v1/prefix_caching/example-time-6.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 25 KiB

docs/source/assets/design/v1/prefix_caching/example-time-7.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 32 KiB

docs/source/assets/design/v1/prefix_caching/free.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 18 KiB

docs/source/assets/design/v1/prefix_caching/overview.png

BIN

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 32 KiB