Update README.md

This commit is contained in:
wassname (Michael J Clark)
2026-05-12 11:38:06 +08:00
committed by GitHub
parent 0b4381704f
commit 139c023bb0
+13 -1
View File
@@ -53,14 +53,26 @@ Respond with one enum value:
This is wrong because {"violation": "
```
We let the model think for 256 tokens then fore and answer and measure the distribution over all possible tokens then weigth them by the labels:
We let the model think for 256 tokens then force an answer and measure the distribution over all possible tokens then weight them by the labels:
```json
{'care': 2 nats, 'fair': 2.4 nats, 'sanct': -1.2 nats .... }
````
To avoid positional bias we score each row twice, once with the enum order forward and once reversed, then
average log-probabilities before softmax.
At the end we multiply the probability by the labels and get the score for each moral factor which we can compare to humans
| Foundation | Change from human |
|-|-|
|Auth| +0.128 +-0.087|
|Care| +0.258 +-0.314|
Where change is the movement of probability in nats compared to human labels.
## Labels
`human_*` columns are the eval target.