 brent.edwards
|
b39495e914
|
Changes to improve pyright results.
CI-always / lint (push) Failing after 54s
CI-always / typecheck (push) Failing after 1m0s
CI-always / lint (pull_request) Failing after 53s
CI-always / behave (3.13) (push) Failing after 1m6s
CI-always / typecheck (pull_request) Failing after 58s
CI-always / behave (3.13) (pull_request) Failing after 1m0s
|
2026-02-05 17:22:59 -08:00 |
|
|
brent.edwards
|
506e85249a
|
fix: handle None cases for rdf_file and field in dataset_validator.py
Co-authored-by: aider (openrouter/openai/o3-mini-high) <aider@aider.chat>
|
2026-02-05 17:21:31 -08:00 |
|
|
brent.edwards
|
c1e8615e8d
|
style: reformat long lines to fit within 88 characters
Co-authored-by: aider (openrouter/google/gemini-2.5-pro) <aider@aider.chat>
|
2026-02-05 15:13:04 -08:00 |
|
|
brent.edwards
|
8341592990
|
style: reorder imports and remove unused variables
|
2026-02-05 15:13:02 -08:00 |
|
|
brent.edwards
|
db74a1ccc4
|
Formatting fixes.
CI-always / lint (push) Failing after 19s
CI-always / typecheck (push) Failing after 25s
CI-always / lint (pull_request) Failing after 17s
CI-always / behave (3.13) (push) Failing after 27s
CI-always / typecheck (pull_request) Failing after 25s
CI-always / behave (3.13) (pull_request) Failing after 27s
|
2026-02-04 17:11:03 -08:00 |
|
|
brent.edwards
|
c3da9ea89c
|
And installing the right software.
CI-always / lint (push) Failing after 16s
CI-always / typecheck (push) Failing after 28s
CI-always / behave (3.11) (push) Failing after 27s
CI-always / behave (3.12) (push) Failing after 28s
CI-always / lint (pull_request) Failing after 19s
CI-always / behave (3.13) (push) Failing after 26s
CI-always / behave (3.11) (pull_request) Failing after 26s
CI-always / typecheck (pull_request) Failing after 27s
CI-always / behave (3.12) (pull_request) Failing after 26s
CI-always / behave (3.13) (pull_request) Failing after 28s
|
2026-02-04 16:23:29 -08:00 |
|
|
brent.edwards
|
d7988427b3
|
This time, putting the extra steps on the correct file.
CI-always / lint (push) Failing after 17s
CI-always / typecheck (push) Failing after 18s
CI-always / behave (3.12) (push) Failing after 16s
CI-always / behave (3.11) (push) Failing after 18s
CI-always / behave (3.13) (push) Failing after 15s
CI-always / lint (pull_request) Failing after 17s
CI-always / typecheck (pull_request) Failing after 16s
CI-always / behave (3.11) (pull_request) Failing after 17s
CI-always / behave (3.12) (pull_request) Failing after 16s
CI-always / behave (3.13) (pull_request) Failing after 17s
|
2026-02-04 16:03:44 -08:00 |
|
|
brent.edwards
|
3b64a7c476
|
Adding nodejs to every build.
CI-always / lint (push) Failing after 3s
CI-always / typecheck (push) Failing after 3s
CI-always / behave (3.12) (push) Failing after 3s
CI-always / behave (3.11) (push) Failing after 3s
CI-always / behave (3.13) (push) Failing after 2s
CI-always / lint (pull_request) Failing after 3s
CI-always / typecheck (pull_request) Failing after 2s
CI-always / behave (3.11) (pull_request) Failing after 2s
CI-always / behave (3.12) (pull_request) Failing after 3s
CI-always / behave (3.13) (pull_request) Failing after 3s
|
2026-02-04 15:50:06 -08:00 |
|
|
brent.edwards
|
f177b6b06a
|
First attempt to always run tests.
CI-always / lint (push) Failing after 3s
CI-always / typecheck (push) Failing after 3s
CI-always / behave (3.11) (push) Failing after 2s
CI-always / behave (3.12) (push) Failing after 3s
CI-always / behave (3.13) (push) Failing after 3s
CI-always / lint (pull_request) Failing after 2s
CI-always / typecheck (pull_request) Failing after 2s
CI-always / behave (3.11) (pull_request) Failing after 3s
CI-always / behave (3.12) (pull_request) Failing after 2s
CI-always / behave (3.13) (pull_request) Failing after 2s
|
2026-02-04 15:26:58 -08:00 |
|
|
brent.edwards
|
4ccee85888
|
Added a try/catch.
|
2026-02-02 10:12:16 -08:00 |
|
|
brent.edwards
|
3022ce4e9e
|
Corrections to code and printing missing fields.
|
2026-02-01 14:53:19 -08:00 |
|
|
brent.edwards
|
45fc504873
|
refactor: extract field generation logic into a generator function
Co-authored-by: aider (openrouter/anthropic/claude-sonnet-4.5) <aider@aider.chat>
|
2026-02-01 14:03:50 -08:00 |
|
|
brent.edwards
|
56b06a9bc3
|
refactor: use os.walk for file traversal in dataset_validator.py
|
2026-02-01 14:03:43 -08:00 |
|
|
brent.edwards
|
6447e1575c
|
KNOWN BUG: This code is supposed to download the structures it doesn't
have, but does not.
|
2026-01-29 17:49:26 -08:00 |
|
|
brent.edwards
|
8393fa3c5d
|
Removed a circular dependency.
|
2026-01-29 17:29:56 -08:00 |
|
|
brent.edwards
|
06d499e4e9
|
Adding assertions to turn off pyright warnings.
|
2026-01-29 14:18:54 -08:00 |
|
|
brent.edwards
|
49f6a288d9
|
Thank you, Aditya, for pointing out missing "not"s.
|
2026-01-29 11:56:33 -08:00 |
|
|
brent.edwards
|
cc1df798db
|
Changes made to correctly use Bloom filters.
|
2026-01-28 18:55:23 -08:00 |
|
|
brent.edwards
|
bc76475087
|
test: add tests for Bloom filter subset functionality
Co-authored-by: aider (openrouter/qwen/qwen3-coder) <aider@aider.chat>
|
2026-01-28 18:52:21 -08:00 |
|
|
brent.edwards
|
6ad7cb2e90
|
Changes requested by Aditya.
|
2026-01-27 18:20:03 -08:00 |
|
|
brent.edwards
|
b250bb79a8
|
feat: add string extraction and validation for datasets
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-26 18:51:08 -08:00 |
|
|
brent.edwards
|
9cee285cca
|
refactor: move REQUIRED_COLUMNS definition in dataset_validator.py
|
2026-01-26 18:50:57 -08:00 |
|
|
brent.edwards
|
60217f48ca
|
Deleting an unnecessary file.
|
2026-01-23 17:14:35 -08:00 |
|
|
brent.edwards
|
597267f4b0
|
fix: escape braces in f-strings within documentation strings
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-23 15:16:02 -08:00 |
|
|
brent.edwards
|
41a6f1a8ce
|
refactor: update validation to return download path and handle multiple parquet files
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-23 15:14:11 -08:00 |
|
|
brent.edwards
|
c0f89a11da
|
feat: add validation for required columns in dataset files
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 17:39:37 -08:00 |
|
|
brent.edwards
|
caf124c13c
|
test: update parquet file validation to use real file creation
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 17:36:12 -08:00 |
|
|
brent.edwards
|
f6a3be2176
|
feat: add pandas to dependencies and import read_parquet directly
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 17:28:32 -08:00 |
|
|
brent.edwards
|
9f902c915a
|
feat: add parquet file validation to dataset validator
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 17:21:58 -08:00 |
|
|
brent.edwards
|
2b562c268a
|
feat: add dataset download validation from HuggingFace
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 17:16:46 -08:00 |
|
|
brent.edwards
|
e8d8c15146
|
refactor: pass mock_api directly to dataset_exists_on_hf function
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 17:01:49 -08:00 |
|
|
brent.edwards
|
97515849e7
|
fix: import HfHubHTTPError from correct module
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 16:41:58 -08:00 |
|
|
brent.edwards
|
e2ae2dec31
|
fix: import HfHubHTTPError from correct module to resolve pyright error
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 16:37:34 -08:00 |
|
|
brent.edwards
|
ad005d9fa8
|
style: reorder imports for clarity
|
2026-01-22 16:37:23 -08:00 |
|
|
brent.edwards
|
a92244852b
|
feat: add HuggingFace dataset existence validator and tests
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
|
2026-01-22 16:18:31 -08:00 |
|
 aditya
|
415ce6baaf
|
Docker: add entrypoint script for upload single dataset
|
2026-01-22 15:42:42 +05:30 |
|
|
aditya
|
e2ddbd58a0
|
fix: fix minor bugs; add multiprocessing for ttl format datasets
|
2026-01-21 20:06:49 +05:30 |
|
|
aditya
|
02c9f12aee
|
fix: fix resume functionality in .ttl fomat dataset
|
2026-01-21 20:02:33 +05:30 |
|
|
aditya
|
cb25f4dea1
|
fix: fix xml:base not getting added with subject; implement checkpoint in google sheet
|
2026-01-16 18:25:04 +05:30 |
|
|
aditya
|
001e3d3f4f
|
fix: implement multithreading for parsing of description and skip parsing of description
|
2026-01-16 18:20:13 +05:30 |
|
|
aditya
|
53fcbbbb04
|
feat: integrate google sheet tracker in rdf_to_hf_incremental.py
|
2026-01-14 19:47:05 +05:30 |
|
|
aditya
|
c21be4fe14
|
fix: fix sheet updation logic; update README.md for pycharm devcontainer
|
2026-01-14 19:33:01 +05:30 |
|
|
aditya
|
42cadec23f
|
fix: fix issues as per review feedback
|
2026-01-14 19:33:01 +05:30 |
|
|
aditya
|
91900c6a6b
|
fix: fix push to hub in unified converter script
|
2026-01-14 19:33:00 +05:30 |
|
|
aditya
|
c3da1a0ff1
|
feat: add devcontainer setup for vscode
|
2026-01-14 19:33:00 +05:30 |
|
|
aditya
|
b11910103a
|
feat: integrate excel integration using gcp
|
2026-01-14 19:32:56 +05:30 |
|
|
aditya
|
b696d86835
|
fix: fix minor decompressed_byte bug
|
2026-01-14 18:14:11 +05:30 |
|
|
aditya
|
255ccad4d4
|
fix: some minor fixes
|
2026-01-13 17:19:54 +05:30 |
|
|
aditya
|
9ccdd38e91
|
fix: parse xml file with xml.etree.ElementTree; fix ruff and pyright errors
|
2026-01-13 17:19:50 +05:30 |
|
|
aditya
|
6ff2719a8e
|
feat: add streaming of rdf xml dataset with resume functionality
|
2026-01-13 17:18:09 +05:30 |
|