From 6b8374ed19426d51c1b762b74002107c28efc008 Mon Sep 17 00:00:00 2001
From: Joshuaclymer <joshmclymer@gmail.com>
Date: Sat, 11 Nov 2023 20:04:17 +0000
Subject: [PATCH] update

---
 README.md | 1 +
 1 file changed, 1 insertion(+)

diff --git a/README.md b/README.md
index 48ec6fa..44d087d 100644
--- a/README.md
+++ b/README.md
@@ -21,6 +21,7 @@ conda create --name env python=3.10
 pip install -e .
 python download_model_from_hf.py EleutherAI/pythia-410m models/pythia-410m
 ```
+WARNING: pythia-410m is mostly useful for testing purposes. Most of the tuning interventions perform very poorly using this model.
 
 ## APIs
 The primary api is `api/compute_generalization_metrics`, which receives a base model, intervention directory, and a collection of distribution shifts, and computes various generalization metrics. See `examples/compute_generalization_metrics.sh` for example usage.