From 29d79b855c5274730c55fc4a460596ed3824c089 Mon Sep 17 00:00:00 2001 From: wassname <1103714+wassname@users.noreply.github.com> Date: Wed, 12 Mar 2025 07:35:34 +0800 Subject: [PATCH] wip --- README.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 1f2f393..0267b1b 100644 --- a/README.md +++ b/README.md @@ -1,8 +1,10 @@ -# Eliciting Suppressed Knowledge (ESK) +# Eliciting Suppressed Knowledge (ESK) WIP ## Abstract Transformer models possess knowledge they actively suppress during inference. By isolating and probing these suppressed activation, we demonstrate small improvements on TruthfulQA compared to standard activation probes. This confirms that supressed activations are a more useful source of knowledge than the model's direct outputs, or hidden states. +*This is a Work In Progress. While we have promising results, they should be improved by simple changes to the probing method. We are currently working on these improvements.* + ## Background Recent mechanistic interpretability research identifies competing neural dynamics in transformers: