memory-issue-fix #33

Open

aditya wants to merge 2 commits from memory-issue-fix into 30-temporary-files

aditya commented

2025-12-11 15:05:03 +00:00

Member

This PR fixes a PicklingError encountered during the RDF to Hugging Face dataset streaming conversion. The issue was caused by the Dataset.from_generator() method attempting to pickle a generator function that captured a rich.progress.Progress object in its closure, which is not serializable

aditya added 2 commits

2025-12-11 15:05:03 +00:00

fix: resolve pickling error in streaming converter generator 5a3b22d47f

fix: fix minor linting errors efa08d5c7d

This pull request can be merged automatically.

You are not authorized to merge this pull request.

View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u origin memory-issue-fix:memory-issue-fix

git switch memory-issue-fix

Merge

Merge the changes and update on Forgejo.

Warning: The "Autodetect manual merge" setting is not enabled for this repository, you will have to mark this pull request as manually merged afterwards.

git switch 30-temporary-files

git merge --no-ff memory-issue-fix

git switch memory-issue-fix

git rebase 30-temporary-files

git switch 30-temporary-files

git merge --ff-only memory-issue-fix

git switch memory-issue-fix

git rebase 30-temporary-files

git switch 30-temporary-files

git merge --no-ff memory-issue-fix

git switch 30-temporary-files

git merge --squash memory-issue-fix