wassname/activation_store
1
0
Fork 0
mirror of https://github.com/wassname/activation_store.git synced 2026-06-27 16:44:07 +08:00
Code Issues Packages Projects Releases Wiki Activity
6 Commits 4 Branches 0 Tags
f0311c022fc4c4d12e7723383e1efa0f923a7a44
T
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
wassname f0311c022f another example
2025-02-16 09:56:23 +08:00
activation_store
another example
2025-02-16 09:56:23 +08:00
nbs
another example
2025-02-16 09:56:23 +08:00
.gitignore
parquet
2025-02-15 22:03:52 +08:00
.python-version
init
2025-02-15 19:30:09 +08:00
pyproject.toml
working
2025-02-15 21:15:15 +08:00
README.md
comments
2025-02-15 21:21:36 +08:00
uv.lock
working
2025-02-15 21:15:15 +08:00

README.md

activation_store

Utility library to persistently store transformer activations on disk.

These activations can be quite large (layers x batch x sequence x hidden_size), so generating them to disk helps avoid out of memory errors.

Install using pip install git+https://github.com/wassname/activation_store.git.

Development

git clone https//github.com/wassname/activation_store.git
uv sync

see exampes in nbs folder.

Reference in New Issue View Git Blame Copy Permalink
S
Description
Store transformer activations on disk
Readme 655 KiB
Languages
Jupyter Notebook 56.1%
Python 43.9%