question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Pickled solutions are very large

See original GitHub issue

SolutionArray.save() is a wonderful feature but it can produce some seriously big files. I recently solved a 42000 free variable model and the pickle file was 110 MB! Even the models I solve on a more frequent basis yield 10-20 MB pickle files. In case anyone is curious the simple text file representation of the solution (output of SolutionArray.savetxt() is ~700 kB.

I previously spoke to @bqpd about this and he mentioned that it should be possible to make these files smaller. If it is a trade-off between how much original model data/functionality is preserved and file size, it would be great if there was an argument to specify tiers of data preservation.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:11 (11 by maintainers)

github_iconTop GitHub Comments

1reaction
bqpdcommented, Jul 10, 2020

(note: down to 1.9MB, much faster loads in lastest commit on https://github.com/convexengineering/gpkit/pull/1498)

0reactions
bqpdcommented, Jul 15, 2020

nice!!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Troubleshooting common problems with home canned pickles
If the cucumber is too large, over 2 inches across, the pickling solution is not able to penetrate the core properly. Use smaller...
Read more >
Pickle File too large to load - Stack Overflow
The problem that I am having is that I have a very large pickle file (2.6 Gb) that I am trying to open...
Read more >
How to Make Pickles: Step-by-Step Pickling Guide
Shriveled pickles: allowing too much time between gathering and pickling; pickling solution too sweet or too strong in vinegar; brine too salty at...
Read more >
The Best Ever Pickling Liquid | Arctic Grub
Pickling liquid: · 1 cup white vinegar or sub rice vinegar · 1 cup sugar · 1 cup water · 2 bay leaves...
Read more >
Common Pickle Problems | Home & Garden Information Center
The plastic needs to be food-grade. Pickles and sauerkraut can be fermented in large stoneware crocks, large glass jars, or food-grade plastic ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found