CleverDatasets needs a way to override Skipping... Already exists on. #55

Open
opened 2026-01-26 23:40:27 +00:00 by brent.edwards · 0 comments
Member

We've found errors in the early versions of the uploads.

Therefore, there needs to be a way to override messages like

❯ uv run python scripts/upload_all_datasets.py --dataset fb15k-237
`get_datasets_to_process` took 0.00 seconds:
⊘ Skipping 'fb15k-237': Already exists on HuggingFace as 'CleverThis/fb15k-237'
Validating fb15k-237...
Fetching 3 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:02<00:00,  1.44it/s]
Download complete: : 1.63MB [00:02, 447kB/s]                                                                                                                                      All done!
`main` took 2.83 seconds:
We've found errors in the early versions of the uploads. Therefore, there needs to be a way to override messages like ``` ❯ uv run python scripts/upload_all_datasets.py --dataset fb15k-237 `get_datasets_to_process` took 0.00 seconds: ⊘ Skipping 'fb15k-237': Already exists on HuggingFace as 'CleverThis/fb15k-237' Validating fb15k-237... Fetching 3 files: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 3/3 [00:02<00:00, 1.44it/s] Download complete: : 1.63MB [00:02, 447kB/s] All done! `main` took 2.83 seconds: ```
brent.edwards added the
State
Unverified
Type
Bug
Priority
Medium
labels 2026-01-26 23:40:27 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: cleverdatasets/dataset-uploader#55