Commit Graph
62 Commits
Author SHA1 Message Date
deep1 7a3a9dae73 fixed bug in batch 2023-08-11 15:56:14 +08:00
deep1 9533e61b6e rought fix for 23 still need to tidy 2023-08-06 20:33:05 +08:00
deep1 38cf72f921 fixes 2023-08-06 18:47:42 +08:00
deep1 f7a119723d tidy 2023-08-06 14:31:36 +08:00
deep1 90d27388ee tidy 2023-08-06 14:02:59 +08:00
deep1 d579a712b3 fixed generation, bug due to padding 2023-08-06 11:47:50 +08:00
deep1 d15b4fa54d dataset refactored but there is a 🐛 2023-08-05 20:00:15 +08:00
deep1 8cb669f121 wip refactoring 2023-08-05 08:55:55 +08:00
deep1 217b7735e8 wip refactoring 2023-07-28 18:29:48 +08:00
deep1 d067ba50aa mv from 023 to src, wip 2023-07-28 17:38:17 +08:00
deep1 add388479a tidy 2023-07-28 17:24:43 +08:00
deep1 aeaa6a8645 conv 2023-07-28 17:23:51 +08:00
deep1 d562a3c841 eval wip 2023-07-28 17:22:48 +08:00
deep1 5c7631e8c2 tidy 2023-07-23 10:26:42 +08:00
deep1 6cfeeaac8b record past experiments 2023-07-23 10:24:17 +08:00
deep1 94f273925a good 2023-07-21 21:52:30 +08:00
deep1 a18ca5b822 debug the data gen
- by using capitals
- and recording a lie for every non lie to make sure the model can solve the problem
2023-07-10 08:11:45 +08:00
deep1 b1cc406376 fixed loaders 2023-07-08 12:47:02 +08:00
deep1 f690697dff it works, for wizcode, sentiment 2023-07-06 15:45:23 +08:00
deep1 5a626008a9 include old experiments 2023-07-06 15:44:32 +08:00
deep1 b401b18041 new pipeline, and dual model works :) 2023-07-02 19:52:39 +08:00
deep1 4253cb53b2 fix cache 2023-07-02 14:39:58 +08:00
deep1 279c8cc674 a script to cache ds 2023-07-02 14:39:52 +08:00
wassname 2600df2b6d fixed seed on precache 2023-06-18 21:00:26 +08:00
wassname e2ca9ddf71 add a supervised version 2023-06-18 18:32:04 +08:00
wassname 0d88405af7 fixes 2023-06-18 13:35:26 +08:00
wassname db8f3a8272 whole notebook is written, just need to try with more data 2023-06-18 13:18:04 +08:00
wassname fe947cb1e0 kinda works!! 2023-06-16 16:52:28 +08:00
wassname 09004dd077 starcode seems to work 2023-06-13 06:25:20 +08:00
wassname 32f2f69e2a dropout works on the falcan model... I just need to get the prompting right 2023-06-11 18:48:50 +08:00
wassname 62c1a0a582 the models work, lying sometimes works, and lie-dection leaks 2023-06-10 20:35:11 +08:00
wassname 38a5e8a15a still not working 2023-06-10 14:59:57 +08:00
wassname 52c5395fb9 clean notebooks 2023-06-10 13:44:25 +08:00
wassname e113f2172b easy way to download models 2023-06-10 13:44:15 +08:00
wassname 25ebc2a527 measure how often a model/prompt combo follows instructions 2023-06-09 13:03:28 +08:00
wassname 0b1ba11682 notes 2023-06-09 08:27:20 +08:00
wassname 20f07a3774 working on f in prompt 2023-06-09 08:27:15 +08:00
wassname f53fdc05f7 notes 2023-06-05 15:38:13 +08:00
deep1 9cac2c1152 I can't get the model to lie to me 2023-05-29 18:20:59 +08:00
deep1 1c6854437c misc 2023-05-29 12:32:55 +08:00
deep1 7d2d9a4e8d fix the id_n thing
distinguish between _No and No
2023-05-28 19:15:13 +08:00
deep1 0f7b6459f4 4bit hf works better 2023-05-28 14:20:26 +08:00
deep1 61d1833d6d doc_reqs before upgrading to hf 4bit 2023-05-28 14:19:42 +08:00
deep1 e4d009e3d1 I want to use the hs from generate not forward 2023-05-27 20:37:00 +08:00
deep1 56cfb17bca misc 2023-05-22 07:09:05 +08:00
deep1 556e62101b the generation seems to works! 2023-05-21 17:20:18 +08:00
deep1 9dc85682c2 misc 2023-05-21 11:24:47 +08:00
deep1 45c4356a8b 13b 2023-05-20 18:08:51 +08:00
wassname 1c860bbbeb reqs 2023-05-20 10:29:17 +08:00
wassname 32e9fb9440 trying to improve and debug generation 2023-05-20 10:28:37 +08:00