Python

3235 readers

1 users here now

News and discussions about the programming language Python

founded 5 years ago

MODERATORS

MinutePhrase@lemmy.ml

pickling large objects (lemmy.ml)

submitted 1 year ago by lntl@lemmy.ml to c/python@lemmy.ml

9 comments fedilink hide all child comments

I have a large object that I want to save to the disk because it takes a minute to generate. The OOM reaper kills the process while pickle.dump ing the object.

It's a tuple of dicts of tuple of array.array.

Can pickle dump in chunks? If not, is there another technique I can use?

no comments (yet)

sorted by: hot top controversial new old

there doesn't seem to be anything here