Commit Graph
73 Commits
Author SHA1 Message Date
henri123lemoine ea5bf2e707 Solved error in dataset.py. 2023-03-24 22:21:29 -04:00
henri123lemoine 581604b5b7 Merge remote-tracking branch 'origin/main' into main 2023-03-24 22:12:35 -04:00
Fraser b77f6684ae display list better 2023-03-24 22:12:14 -04:00
henri123lemoine 5637de7d5f Added get_top_k_blocks to the api/embeddings.py file. 2023-03-24 22:10:09 -04:00
Thomas Lemoine 3dbd0fdb2f updated the dataset 2023-03-24 21:59:49 -04:00
Fraser 1b49db526a update embeddings format 2023-03-24 21:46:08 -04:00
Fraser ada1fad00b python layout for embeddings 2023-03-24 21:27:19 -04:00
Thomas Lemoine 0f20079a92 removed unused module 2023-03-24 21:24:57 -04:00
Thomas Lemoine 50203f92eb smaller token blocks 2023-03-24 21:22:22 -04:00
Fraser b853231861 attempt fix A 2023-03-24 21:15:11 -04:00
Fraser 906272075a ignore .vercel 2023-03-24 21:14:27 -04:00
Thomas Lemoine 0438afcb8f added nltk to reqs 2023-03-24 21:06:18 -04:00
Fraser f3c2c3fc8a Merge branch 'web' into main 2023-03-24 21:01:18 -04:00
Fraser e307d30e55 temp 2023-03-24 21:00:37 -04:00
Fraser a0ffdf9a66 python serverless test 2023-03-24 20:59:41 -04:00
Fraser 0e74e340aa add python file 2023-03-24 20:59:02 -04:00
Fraser b116bc75a0 test commit to check redeployment hooks
add padding to body
2023-03-24 20:58:35 -04:00
Fraser 1005db86cc init nextjs webpage 2023-03-24 20:57:23 -04:00
Thomas Lemoine 4dc70f7286 removed pinecone 2023-03-24 20:26:52 -04:00
Thomas Lemoine d8c642e576 modified dataset storage of metadata 2023-03-24 18:56:52 -04:00
henri123lemoine e092681346 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-24 17:23:32 -04:00
henri123lemoine ff1a5b5272 Modified text_splitter, added prompts. 2023-03-24 17:22:54 -04:00
henri123lemoine 35da2db2cf Added comments, modified text_splitter. 2023-03-24 17:21:43 -04:00
Thomas Lemoine 3cd271d8d7 introducing pinecone stuff 2023-03-24 17:01:18 -04:00
Fraser 2415220068 ignore mac metafiles 2023-03-24 15:33:56 -04:00
henri123lemoine c54252e182 Updated folder structure and AlignmentSearch prompt. 2023-03-20 12:48:35 -04:00
Thomas Lemoine 475308c081 refactor Dataset class 2023-03-20 02:14:48 -04:00
Thomas Lemoine e1e6a3e67b refactor of Dataset class 2023-03-20 02:13:39 -04:00
Thomas Lemoine b34b1483c1 lowered dependencies in the notebook 2023-03-17 12:16:21 -04:00
Thomas Lemoine 873c3aeec2 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 19:21:46 -04:00
Thomas Lemoine d284375431 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 19:20:03 -04:00
henri123lemoine b6ad0bb4e0 added tmp.py to .gitignore 2023-03-16 11:33:43 -04:00
henri123lemoine 12137d0ab7 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 11:32:57 -04:00
henri123lemoine 0f61660c0c Added tests 2023-03-16 11:29:58 -04:00
Thomas Lemoine 5a2fb0638b Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-16 07:48:34 -04:00
Thomas Lemoine 9980deb36b made textsplitter work with tokens, not chars 2023-03-16 07:45:31 -04:00
henri123lemoine ef0a8883ce Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-15 06:05:23 -04:00
henri123lemoine 6d5030d668 Made various unmemorable changes 2023-03-15 06:03:45 -04:00
Thomas Lemoine 50354b2487 path stored as pathlib's Path object 2023-03-15 04:51:00 -04:00
Thomas Lemoine 7ae4441fb4 Merge branch 'main' of https://github.com/henri123lemoine/AlignmentSearch 2023-03-15 04:36:41 -04:00
Thomas Lemoine 4639bb902b removed rawtext to vectorstore as it is useless 2023-03-15 04:36:38 -04:00
henri123lemoine 7a4f6714fe Updated testing.ipynb 2023-03-14 23:41:44 -04:00
henri123lemoine e7979073e7 Updated dataset/semantic search/main for ease of use. 2023-03-14 08:45:33 -04:00
henri123lemoine 344ed281ee Updated the code from dataset.py, semantic_search.py, and main.py, using the code from the testing.ipynb file. 2023-03-14 08:30:53 -04:00
henri123lemoine fbb0c3bbea Updated the text_splitter.py file to remove an unnecessary function, and updated the testing notebook. 2023-03-14 08:18:05 -04:00
Thomas Lemoine 719674541c modified main of textsplitter 2023-03-14 02:21:18 -04:00
Thomas Lemoine 6503a61bd3 created the TextSplitter class 2023-03-14 00:04:05 -04:00
Thomas Lemoine 49b8cd0239 added functionality to textsplitter 2023-03-13 21:19:13 -04:00
Thomas Lemoine e8ee64cd7c raw text can be converted to chunks with signature 2023-03-10 21:09:51 -05:00
Thomas Lemoine ad41e0b08b removed json from requirements.txt 2023-03-10 21:00:39 -05:00