mirror of
https://github.com/wassname/activation_store.git
synced 2026-08-03 12:40:47 +08:00
16 lines
436 B
Markdown
16 lines
436 B
Markdown
# activation_store
|
|
|
|
Utility library to persistently store transformer activations on disk.
|
|
|
|
These activations can be quite large (layers x batch x sequence x hidden_size), so generating them to disk helps avoid out of memory errors.
|
|
|
|
Install using `pip install git+https://github.com/wassname/activation_store.git`.
|
|
|
|
## Development
|
|
```
|
|
git clone https//github.com/wassname/activation_store.git
|
|
uv sync
|
|
```
|
|
|
|
see exampes in `nbs` folder.
|