wassname/discovering_latent_knowledge
1
0
Fork 0
mirror of https://github.com/wassname/discovering_latent_knowledge.git synced 2026-09-11 12:10:11 +08:00
Code Issues Packages Projects Releases Wiki Activity

abandon branch for poor results

Browse Source
This commit is contained in:
wassname
2023-10-23 15:24:00 +08:00
parent 1890a214b0
commit aefbdb6cd0
4 changed files with 407 additions and 493 deletions
Download Patch File Download Diff File Expand all files Collapse all files
mjc_notes.md
+10
View File
@@ -1791,3 +1791,13 @@ bugs?:
ideas:
- maybe I need both head and mlp?
- or just residual stream?
# 2023-10-23 15:07:58
After reading https://github.dev/andyzoujm/representation-engineering/tree/main/repe_eval/examples/decoder_repe_eval.ipynb
- use pipelines <3
- use their pca code
- use the diff of hidden states
- use their intervention pipeline
- and chain to a dataset?