Commit Graph

17 Commits

Author SHA1 Message Date
brent.edwards f8a7739016 Minor changes. 2025-12-30 18:06:34 -08:00
aditya 2b1537d4f9 fix: fix ruff check errors 2025-12-29 18:49:57 +05:30
aditya 1bb26305ce fix: fix path too long issue; fix pickling issue in unified converter script 2025-12-26 18:21:02 +05:30
aditya 5b215aff76 fix: complete the unified script to add add the new features as streaming parallel; update the upload_all_dataset.py to use the unified script 2025-12-24 21:00:32 +05:30
aditya d564739f72 Merge branch '35-xz-compression' into stream-download-convert-upload 2025-12-23 20:20:36 +05:30
brent.edwards ff3939d937 fix: improve RDF format detection and parsing for UniProt dataset
Co-authored-by: aider (openrouter/anthropic/claude-sonnet-4) <aider@aider.chat>
2025-12-16 19:38:30 -08:00
brent.edwards 0784e3e275 Fixes suggested by Aider. 2025-12-16 18:21:25 -08:00
brent.edwards 4da8793b18 THIS DOES NOT WORK. 2025-12-11 21:26:52 -08:00
brent.edwards 18a724eef9 More changes. 2025-12-09 20:01:45 -08:00
brent.edwards bac71ff1cc Minor improvements. 2025-12-09 13:28:30 -08:00
brent.edwards 37b3ee6e91 Final version; what was used to send wikidata-truthy. 2025-12-07 09:47:04 -08:00
brent.edwards a6928d0ce2 Changes requested by Kyle; thank you! 2025-12-04 14:11:41 -08:00
brent.edwards 9534336c15 Replacing upload_all_datasets.py with the previous
upload_all_datasets.2.py
2025-12-02 14:40:15 -08:00
brent.edwards 6b73289c24 One-half of the conversion is done, and the structure is written. 2025-11-24 18:59:44 -08:00
brent.edwards c776025b0f Changes made to make the downloader work. 2025-11-23 16:25:31 -08:00
brent.edwards e3bee8af4f feat: enhance error handling and reporting in dataset processing scripts
Co-authored-by: aider (openrouter/anthropic/claude-sonnet-4) <aider@aider.chat>
2025-11-20 17:13:26 -08:00
brent.edwards 8784b798a6 Initial checkin with scripts. 2025-11-18 13:18:15 -08:00