wassname/stampy-chat
1
0
Fork 0
mirror of https://github.com/wassname/stampy-chat.git synced 2026-09-23 13:50:27 +08:00
Code Issues Packages Projects Releases Wiki Activity
46 Commits 1 Branch 0 Tags
e1e6a3e67bbd2c272bd796cefc2c0ba38e32daf6
Commit Graph
46 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Thomas Lemoine e1e6a3e67b refactor of Dataset class 2023-03-20 02:13:39 -04:00
Thomas Lemoine b34b1483c1 lowered dependencies in the notebook 2023-03-17 12:16:21 -04:00
Thomas Lemoine 873c3aeec2 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 19:21:46 -04:00
Thomas Lemoine d284375431 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 19:20:03 -04:00
henri123lemoine b6ad0bb4e0 added tmp.py to .gitignore 2023-03-16 11:33:43 -04:00
henri123lemoine 12137d0ab7 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 11:32:57 -04:00
henri123lemoine 0f61660c0c Added tests 2023-03-16 11:29:58 -04:00
Thomas Lemoine 5a2fb0638b Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 07:48:34 -04:00
Thomas Lemoine 9980deb36b made textsplitter work with tokens, not chars 2023-03-16 07:45:31 -04:00
henri123lemoine ef0a8883ce Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-15 06:05:23 -04:00
henri123lemoine 6d5030d668 Made various unmemorable changes 2023-03-15 06:03:45 -04:00
Thomas Lemoine 50354b2487 path stored as pathlib's Path object 2023-03-15 04:51:00 -04:00
Thomas Lemoine 7ae4441fb4 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-15 04:36:41 -04:00
Thomas Lemoine 4639bb902b removed rawtext to vectorstore as it is useless 2023-03-15 04:36:38 -04:00
henri123lemoine 7a4f6714fe Updated testing.ipynb 2023-03-14 23:41:44 -04:00
henri123lemoine e7979073e7 Updated dataset/semantic search/main for ease of use. 2023-03-14 08:45:33 -04:00
henri123lemoine 344ed281ee Updated the code from dataset.py, semantic_search.py, and main.py, using the code from the testing.ipynb file. 2023-03-14 08:30:53 -04:00
henri123lemoine fbb0c3bbea Updated the text_splitter.py file to remove an unnecessary function, and updated the testing notebook. 2023-03-14 08:18:05 -04:00
Thomas Lemoine 719674541c modified main of textsplitter 2023-03-14 02:21:18 -04:00
Thomas Lemoine 6503a61bd3 created the TextSplitter class 2023-03-14 00:04:05 -04:00
Thomas Lemoine 49b8cd0239 added functionality to textsplitter 2023-03-13 21:19:13 -04:00
Thomas Lemoine e8ee64cd7c raw text can be converted to chunks with signature 2023-03-10 21:09:51 -05:00
Thomas Lemoine ad41e0b08b removed json from requirements.txt 2023-03-10 21:00:39 -05:00
Thomas Lemoine 472902ec91 added requirements.txt 2023-03-09 19:04:42 -05:00
henri123lemoine 8d4a0b9b45 Moved files around, updated semantic search and added prompt search. 2023-03-09 16:20:52 -05:00
henri123lemoine 3b1451bf64 Same 2023-03-09 16:20:33 -05:00
henri123lemoine ced7e927f7 Changing format of folders. 2023-03-09 16:19:40 -05:00
henri123lemoine 47175fe074 Updated readme and testing notebook 2023-02-06 21:22:07 -05:00
henri123lemoine 53965dd15c updated typo in readme 2023-02-06 20:58:27 -05:00
henri123lemoine dac3dc8782 updated readme 2023-02-06 20:56:19 -05:00
henri123lemoine c6dd827c4a added if __name__ 2023-02-06 20:52:52 -05:00
henri123lemoine 82e79354f4 added main.py, do not run 2023-02-06 20:52:21 -05:00
henri123lemoine 59d9f25f65 Added settings.py 2023-02-06 20:51:34 -05:00
henri123lemoine ec03b854cc Added AlignmentSearch class, takes dataset class as input. Does semantic search, question answering and summarization. 2023-02-06 20:50:39 -05:00
henri123lemoine 47cb734bc3 Added helper functions for sentence-splitting and article splitting 2023-02-06 20:49:55 -05:00
henri123lemoine 807a7f066c Added dataset.py from testing.ipynb, gets the data from the jsonl file from wanted sources and gets the embeddings from each paragraph. 2023-02-06 20:48:58 -05:00
henri123lemoine 0155a3cc52 Didn't change much 2023-02-05 01:41:52 -05:00
henri123lemoine 639c11ad1e Added TODO 2023-02-05 01:41:15 -05:00
henri123lemoine f047045208 Added a search+q&a class 2023-02-04 05:11:22 -05:00
henri123lemoine aa39a22bf2 Updated testing.ipynb 2023-02-03 09:53:40 -05:00
henri123lemoine 88d2164d88 Updated the testing considerably. Loading the dataset works pretty well. 2023-02-03 06:37:35 -05:00
henri123lemoine 571d0195f4 OOPed notebook 2023-02-03 01:06:58 -05:00
henri123lemoine 3b603a51fa Updated the testing notebook for extracting the jsonl dataset. 2023-02-01 02:15:10 -05:00
henri123lemoine 44019ee24b Updated README.md description and source. 2023-02-01 02:14:30 -05:00
henri123lemoine f10bc74328 Added .jsonl and config to .gitignore 2023-02-01 02:13:47 -05:00
henri123lemoine a760ace26e Initial commit 2023-01-31 04:15:23 -05:00