Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

how about replace pickle with dill? or at least make it an option?

See original GitHub issue

Queue object couldn’t be pickled by pickle, which would raise:

TypeError: can't pickle _thread.lock objects

luckily, dill is API-compatible with pickle, and it could pickle (almost) anything in python, including Queue

so, could you please add an option for that?

Issue Analytics

State:
Created 3 years ago
Comments:6 (3 by maintainers)

Top GitHub Comments

1reaction

piskvorkycommented, Nov 1, 2020

I didn’t know what your comment-less link was supposed to show me.

We do not include patches without a clear motivation. Especially ones with dangerous side effects.

If dill works for you, great – but in case anyone stumbles upon this ticket in the future, please mind the caveats above.

0reactions

mo-hancommented, Nov 1, 2020

def sqlitedict_with_dill():
    import dill
    import sqlitedict
    sqlitedict.dumps = dill.dumps
    sqlitedict.loads = dill.loads
    sqlitedict.PICKLE_PROTOCOL = dill.HIGHEST_PROTOCOL
    return sqlitedict


import queue

sqlitedict = sqlitedict_with_dill()
q = queue.Queue()
q.put(1)
with sqlitedict.SqliteDict('tmp.db', autocommit=True) as sd:
    sd['q'] = q
with sqlitedict.SqliteDict('tmp.db', autocommit=True) as sd:
    print(sd['q'].get() == 1)