Integrate Google Sheets for Dataset Processing Status Tracking #51

Open
opened 2026-01-16 14:27:50 +00:00 by aditya · 0 comments
Member

Description:
Add optional Google Sheets integration to track dataset processing status (NOT STARTED, IN PROGRESS, DONE) and checkpoint data (last completed shard, total rows, skip counts). The system should automatically update status during processing and enable resume from sheet-stored checkpoints.

Acceptance Criteria:

  • Track processing status in Google Sheets
  • Store checkpoint data (shard number, row count, skip count) in sheet columns
  • Auto-reset to NOT STARTED with error message on failures
  • Support resume from sheet checkpoints when local checkpoint file unavailable
**Description:** Add optional Google Sheets integration to track dataset processing status (NOT STARTED, IN PROGRESS, DONE) and checkpoint data (last completed shard, total rows, skip counts). The system should automatically update status during processing and enable resume from sheet-stored checkpoints. **Acceptance Criteria:** - Track processing status in Google Sheets - Store checkpoint data (shard number, row count, skip count) in sheet columns - Auto-reset to NOT STARTED with error message on failures - Support resume from sheet checkpoints when local checkpoint file unavailable
aditya added the
Priority
Medium
Points
13
labels 2026-01-16 14:27:50 +00:00
aditya self-assigned this 2026-01-16 14:27:51 +00:00
aditya added this to the Sprint Jan 1st- 14th project 2026-01-16 14:27:51 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: cleverdatasets/dataset-uploader#51