Signed-off-by: thiswillbeyourgithub <26625900+thiswillbeyourgithub@users.noreply.github.com>
This commit is contained in:
thiswillbeyourgithub
2025-09-11 08:43:42 +02:00
parent e44e4fbd1a
commit a1dd6d3d85
+3 -3
View File
@@ -1,10 +1,10 @@
# activation_store # activation_store
Utility library to persistently store transformer activations on disk. Utility library to persistently store transformer activations on disk as huggingface dataset.
These activations can be quite large (layers x batch x sequence x hidden_size), so generating them to disk helps avoid out of memory errors. As these activations can be quite large (layers x batch x sequence x hidden_size), generating them to disk helps avoid out of memory errors.
Install using Install using
``` ```
pip install git+https://github.com/wassname/activation_store.git pip install git+https://github.com/wassname/activation_store.git
``` ```