wassname/stampy-chat
1
0
Fork 0
mirror of https://github.com/wassname/stampy-chat.git synced 2026-09-22 13:40:44 +08:00
Code Issues Packages Projects Releases Wiki Activity
77 Commits 1 Branch 0 Tags
eaf17cfba0529e1d76e00a3869467d328def1ec8
Commit Graph
51 Commits
Author SHA1 Message Date
henri123lemoine 3e5cfa18f8 Merge remote-tracking branch 'origin/main' into main 2023-03-24 22:23:33 -04:00
henri123lemoine c8a33ff114 Solved dataset.py errors. 2023-03-24 22:23:19 -04:00
Thomas Lemoine a845f90412 modified the textsplitter 2023-03-24 22:22:05 -04:00
henri123lemoine ea5bf2e707 Solved error in dataset.py. 2023-03-24 22:21:29 -04:00
Thomas Lemoine 3dbd0fdb2f updated the dataset 2023-03-24 21:59:49 -04:00
Thomas Lemoine 0f20079a92 removed unused module 2023-03-24 21:24:57 -04:00
Thomas Lemoine 50203f92eb smaller token blocks 2023-03-24 21:22:22 -04:00
Thomas Lemoine 4dc70f7286 removed pinecone 2023-03-24 20:26:52 -04:00
Thomas Lemoine d8c642e576 modified dataset storage of metadata 2023-03-24 18:56:52 -04:00
henri123lemoine e092681346 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-24 17:23:32 -04:00
henri123lemoine ff1a5b5272 Modified text_splitter, added prompts. 2023-03-24 17:22:54 -04:00
henri123lemoine 35da2db2cf Added comments, modified text_splitter. 2023-03-24 17:21:43 -04:00
Thomas Lemoine 3cd271d8d7 introducing pinecone stuff 2023-03-24 17:01:18 -04:00
henri123lemoine c54252e182 Updated folder structure and AlignmentSearch prompt. 2023-03-20 12:48:35 -04:00
Thomas Lemoine 475308c081 refactor Dataset class 2023-03-20 02:14:48 -04:00
Thomas Lemoine e1e6a3e67b refactor of Dataset class 2023-03-20 02:13:39 -04:00
Thomas Lemoine b34b1483c1 lowered dependencies in the notebook 2023-03-17 12:16:21 -04:00
Thomas Lemoine 873c3aeec2 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 19:21:46 -04:00
Thomas Lemoine d284375431 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 19:20:03 -04:00
henri123lemoine 12137d0ab7 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 11:32:57 -04:00
henri123lemoine 0f61660c0c Added tests 2023-03-16 11:29:58 -04:00
Thomas Lemoine 9980deb36b made textsplitter work with tokens, not chars 2023-03-16 07:45:31 -04:00
henri123lemoine ef0a8883ce Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-15 06:05:23 -04:00
henri123lemoine 6d5030d668 Made various unmemorable changes 2023-03-15 06:03:45 -04:00
Thomas Lemoine 50354b2487 path stored as pathlib's Path object 2023-03-15 04:51:00 -04:00
Thomas Lemoine 7ae4441fb4 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-15 04:36:41 -04:00
Thomas Lemoine 4639bb902b removed rawtext to vectorstore as it is useless 2023-03-15 04:36:38 -04:00
henri123lemoine 7a4f6714fe Updated testing.ipynb 2023-03-14 23:41:44 -04:00
henri123lemoine e7979073e7 Updated dataset/semantic search/main for ease of use. 2023-03-14 08:45:33 -04:00
henri123lemoine 344ed281ee Updated the code from dataset.py, semantic_search.py, and main.py, using the code from the testing.ipynb file. 2023-03-14 08:30:53 -04:00
henri123lemoine fbb0c3bbea Updated the text_splitter.py file to remove an unnecessary function, and updated the testing notebook. 2023-03-14 08:18:05 -04:00
Thomas Lemoine 719674541c modified main of textsplitter 2023-03-14 02:21:18 -04:00
Thomas Lemoine 6503a61bd3 created the TextSplitter class 2023-03-14 00:04:05 -04:00
Thomas Lemoine 49b8cd0239 added functionality to textsplitter 2023-03-13 21:19:13 -04:00
Thomas Lemoine e8ee64cd7c raw text can be converted to chunks with signature 2023-03-10 21:09:51 -05:00
henri123lemoine 8d4a0b9b45 Moved files around, updated semantic search and added prompt search. 2023-03-09 16:20:52 -05:00
henri123lemoine 3b1451bf64 Same 2023-03-09 16:20:33 -05:00
henri123lemoine ced7e927f7 Changing format of folders. 2023-03-09 16:19:40 -05:00
henri123lemoine 47175fe074 Updated readme and testing notebook 2023-02-06 21:22:07 -05:00
henri123lemoine c6dd827c4a added if __name__ 2023-02-06 20:52:52 -05:00
henri123lemoine 82e79354f4 added main.py, do not run 2023-02-06 20:52:21 -05:00
henri123lemoine 59d9f25f65 Added settings.py 2023-02-06 20:51:34 -05:00
henri123lemoine ec03b854cc Added AlignmentSearch class, takes dataset class as input. Does semantic search, question answering and summarization. 2023-02-06 20:50:39 -05:00
henri123lemoine 47cb734bc3 Added helper functions for sentence-splitting and article splitting 2023-02-06 20:49:55 -05:00
henri123lemoine 807a7f066c Added dataset.py from testing.ipynb, gets the data from the jsonl file from wanted sources and gets the embeddings from each paragraph. 2023-02-06 20:48:58 -05:00
henri123lemoine 0155a3cc52 Didn't change much 2023-02-05 01:41:52 -05:00
henri123lemoine f047045208 Added a search+q&a class 2023-02-04 05:11:22 -05:00
henri123lemoine aa39a22bf2 Updated testing.ipynb 2023-02-03 09:53:40 -05:00
henri123lemoine 88d2164d88 Updated the testing considerably. Loading the dataset works pretty well. 2023-02-03 06:37:35 -05:00
henri123lemoine 571d0195f4 OOPed notebook 2023-02-03 01:06:58 -05:00