Commit Graph

12 Commits

Author SHA1 Message Date
brent.edwards 6ad7cb2e90 Changes requested by Aditya. 2026-01-27 18:20:03 -08:00
brent.edwards b250bb79a8 feat: add string extraction and validation for datasets
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-26 18:51:08 -08:00
brent.edwards 9cee285cca refactor: move REQUIRED_COLUMNS definition in dataset_validator.py 2026-01-26 18:50:57 -08:00
brent.edwards 41a6f1a8ce refactor: update validation to return download path and handle multiple parquet files
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-23 15:14:11 -08:00
brent.edwards c0f89a11da feat: add validation for required columns in dataset files
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 17:39:37 -08:00
brent.edwards f6a3be2176 feat: add pandas to dependencies and import read_parquet directly
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 17:28:32 -08:00
brent.edwards 9f902c915a feat: add parquet file validation to dataset validator
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 17:21:58 -08:00
brent.edwards 2b562c268a feat: add dataset download validation from HuggingFace
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 17:16:46 -08:00
brent.edwards 97515849e7 fix: import HfHubHTTPError from correct module
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 16:41:58 -08:00
brent.edwards e2ae2dec31 fix: import HfHubHTTPError from correct module to resolve pyright error
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 16:37:34 -08:00
brent.edwards ad005d9fa8 style: reorder imports for clarity 2026-01-22 16:37:23 -08:00
brent.edwards a92244852b feat: add HuggingFace dataset existence validator and tests
Co-authored-by: aider (openrouter/openai/gpt-5.2-codex) <aider@aider.chat>
2026-01-22 16:18:31 -08:00