Commit Graph

22 Commits

Author SHA1 Message Date
brent.edwards 506e85249a fix: handle None cases for rdf_file and field in dataset_validator.py
Co-authored-by: aider (openrouter/openai/o3-mini-high) <aider@aider.chat>
2026-02-05 17:21:31 -08:00
brent.edwards c1e8615e8d style: reformat long lines to fit within 88 characters
Co-authored-by: aider (openrouter/google/gemini-2.5-pro) <aider@aider.chat>
2026-02-05 15:13:04 -08:00
brent.edwards 8341592990 style: reorder imports and remove unused variables 2026-02-05 15:13:02 -08:00
brent.edwards db74a1ccc4 Formatting fixes.
CI-always / lint (push) Failing after 19s
CI-always / typecheck (push) Failing after 25s
CI-always / lint (pull_request) Failing after 17s
CI-always / behave (3.13) (push) Failing after 27s
CI-always / typecheck (pull_request) Failing after 25s
CI-always / behave (3.13) (pull_request) Failing after 27s
2026-02-04 17:11:03 -08:00
brent.edwards 4ccee85888 Added a try/catch. 2026-02-02 10:12:16 -08:00
brent.edwards 3022ce4e9e Corrections to code and printing missing fields. 2026-02-01 14:53:19 -08:00
brent.edwards 45fc504873 refactor: extract field generation logic into a generator function
Co-authored-by: aider (openrouter/anthropic/claude-sonnet-4.5) <aider@aider.chat>
2026-02-01 14:03:50 -08:00
brent.edwards 56b06a9bc3 refactor: use os.walk for file traversal in dataset_validator.py 2026-02-01 14:03:43 -08:00
brent.edwards 6447e1575c KNOWN BUG: This code is supposed to download the structures it doesn't
have, but does not.
2026-01-29 17:49:26 -08:00
brent.edwards 8393fa3c5d Removed a circular dependency. 2026-01-29 17:29:56 -08:00
brent.edwards 6ad7cb2e90 Changes requested by Aditya. 2026-01-27 18:20:03 -08:00
brent.edwards b250bb79a8 feat: add string extraction and validation for datasets
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-26 18:51:08 -08:00
brent.edwards 9cee285cca refactor: move REQUIRED_COLUMNS definition in dataset_validator.py 2026-01-26 18:50:57 -08:00
brent.edwards 41a6f1a8ce refactor: update validation to return download path and handle multiple parquet files
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-23 15:14:11 -08:00
brent.edwards c0f89a11da feat: add validation for required columns in dataset files
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 17:39:37 -08:00
brent.edwards f6a3be2176 feat: add pandas to dependencies and import read_parquet directly
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 17:28:32 -08:00
brent.edwards 9f902c915a feat: add parquet file validation to dataset validator
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 17:21:58 -08:00
brent.edwards 2b562c268a feat: add dataset download validation from HuggingFace
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 17:16:46 -08:00
brent.edwards 97515849e7 fix: import HfHubHTTPError from correct module
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 16:41:58 -08:00
brent.edwards e2ae2dec31 fix: import HfHubHTTPError from correct module to resolve pyright error
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 16:37:34 -08:00
brent.edwards ad005d9fa8 style: reorder imports for clarity 2026-01-22 16:37:23 -08:00
brent.edwards a92244852b feat: add HuggingFace dataset existence validator and tests
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 16:18:31 -08:00