Fraser
b292e76fae
fix logging times
2023-07-08 15:36:14 -04:00
Fraser
8e99e566fe
remove information from McGill prototype
...
Now that we're off the old host, we're able to drop this old information and leave the railway site as a historical relic for the mcgill project. Nice stuff!
2023-07-05 02:13:05 -04:00
Henri Lemoine
d9abc7c9bd
Merge pull request #39 from StampyAI/update-sql-and-pinecone
...
Update sql and pinecone
2023-07-04 23:18:44 -04:00
henri123lemoine
511f231872
Uncommented pinecone functionality
2023-07-02 07:23:13 -04:00
henri123lemoine
aeba2fbfb0
bug-fix and fixed device option
2023-07-02 07:22:38 -04:00
henri123lemoine
cdfb5a52a7
Added sentence transformer option
2023-07-02 07:09:06 -04:00
henri123lemoine
0cf2fdad74
Implemented batch updating
2023-07-02 06:03:05 -04:00
henri123lemoine
5321af9813
Implemented upsert_chunks in the sql handler
2023-07-02 06:01:31 -04:00
henri123lemoine
f1f0c8a21b
Implemented upsert_entries in the Pinecone handler
2023-07-02 06:01:03 -04:00
TJ Porter
bae0fcbde8
Merge pull request #44 from StampyAI/make-production-ready
...
Make Production Ready
2023-07-02 02:50:44 -05:00
TJ Porter
e7b86ee84b
Added deployment workflow
...
Fixes #7
2023-07-02 02:03:01 -05:00
TJ Porter
8c2f305424
Fixed syntax error in Pipfile to ensure pip install works in production.
2023-07-02 01:36:48 -05:00
TJ Porter
299e394add
Fixes #43
2023-07-02 01:33:03 -05:00
henri123lemoine
987d565b11
Added retry to the embeddings method
2023-06-27 11:20:41 -04:00
henri123lemoine
2025940db9
Moving Pinecone env variables assignments to settings
2023-06-27 10:36:15 -04:00
henri123lemoine
084b7139a1
Reformatting
2023-06-27 10:19:41 -04:00
henri123lemoine
0ec3a8f5e4
Reorder imports
2023-06-27 07:50:16 -04:00
henri123lemoine
67f0dafd14
Make env var defs fail-fast
2023-06-27 07:48:18 -04:00
henri123lemoine
49e9f08cf5
Removed magic number 3 by using a settings const
2023-06-27 07:34:14 -04:00
henri123lemoine
11dc2dd6c1
Fixed entry typing and renamed var for clarity
2023-06-27 07:26:41 -04:00
henri123lemoine
560b132e67
Added filenames on line 1 and removed RESET_DBS, fixed logging bug
2023-06-27 07:21:45 -04:00
henri123lemoine
abb506511e
Chaining iterable_data calls
2023-06-27 06:41:21 -04:00
henri123lemoine
0204810aa5
Improving naming
2023-06-27 03:09:51 -04:00
henri123lemoine
5900da48bb
Renamed classes, added settings
2023-06-27 02:45:50 -04:00
henri123lemoine
20346d5fa4
Renamed file
2023-06-27 02:40:00 -04:00
henri123lemoine
473b5ed945
Renamed class and file
2023-06-27 02:39:49 -04:00
henri123lemoine
17ca839d54
Removed logs from gitignore
2023-06-27 02:39:17 -04:00
henri123lemoine
2438a2b01f
Added logger to sql and pinecone handlers
2023-06-27 02:15:35 -04:00
henri123lemoine
f45e0c034f
Removed logging file, added reset_dbs method
2023-06-27 02:06:05 -04:00
henri123lemoine
9314de03e5
Removed time logging and show_stats
2023-06-27 01:54:52 -04:00
henri123lemoine
822d958700
bug fix
2023-06-27 01:54:21 -04:00
henri123lemoine
d9e4cb67e0
Utilized settings file for pinecone handler
2023-06-27 01:50:52 -04:00
henri123lemoine
cda0ce44e9
Simplified update_source method, fixed bugs
2023-06-27 01:48:00 -04:00
henri123lemoine
0c97ea61c5
Added settings file
2023-06-27 01:46:19 -04:00
henri123lemoine
4b64f3bae0
Updated .env.example file
2023-06-27 01:45:59 -04:00
henri123lemoine
049aa315e5
Added ARD_LangChain_QA_Chat notebook to gitignore
2023-06-27 01:45:38 -04:00
henri123lemoine
b25777741d
Added main() for modularity
2023-06-24 00:21:12 -04:00
henri123lemoine
d8c6665a51
Deleted unnecessary lines and added replace_current_index functionality to create_index
2023-06-23 18:59:57 -04:00
henri123lemoine
22b912c814
Added convenient __str__ to the pinecone handler
2023-06-23 18:55:57 -04:00
henri123lemoine
61cb161ffc
Improved validate_entry
2023-06-23 18:48:56 -04:00
henri123lemoine
5ba1e0c22d
Removed unused files
2023-06-23 18:27:14 -04:00
henri123lemoine
1c96ca4112
Updated main.py to call update_dataset.py
2023-06-23 18:27:02 -04:00
henri123lemoine
1d8c025d24
Created update_dataset.py
...
It contains a class, ARDUpdater, that deals with upserting entries to both sql and pinecone databases by checking diffs. It deals with splitting chunks and embedding them before upserting to pinecone.
2023-06-23 18:26:45 -04:00
henri123lemoine
c76ad2df28
Added a Pinecone database handler
2023-06-23 18:23:10 -04:00
henri123lemoine
1514e9ec27
Created an sqlite database handler
2023-06-23 18:22:56 -04:00
henri123lemoine
72c28ad133
added example .env in src/
2023-06-23 18:22:33 -04:00
henri123lemoine
27a56b601e
Updated gitignore
2023-06-23 18:22:18 -04:00
Thomas Lemoine
3b667ce16a
simplified validation
2023-06-23 15:00:50 -04:00
Thomas Lemoine
8044111a1b
commented change in authors' type from str to list
2023-06-21 00:45:40 -04:00
Thomas Lemoine
9b8c470438
removed error_count_dict
2023-06-21 00:41:54 -04:00