Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

joblib crashes when function name to cache is too long

See original GitHub issue

I am using joblib to cache the results of a function and joblib crashes with the following error message:

OSError: [Errno 36] File name too long: '.joblib/joblib/__main__--home-nelle-Projects-EPICON-epiconWorkRepos-integration-scripts-mediation_bootstrapped_nnls-test_model_mrna_TFs_mirna_meth_bootstrapped_nnls'

Issue Analytics

State:
Created 7 years ago
Comments:9 (4 by maintainers)

Top GitHub Comments

1reaction

ethanjahncommented, Aug 15, 2019

I am having this issue on Windows 10, but it does not throw an error. The cache is not used, but does not let the user know that the caching has failed.

At minimum, it would be beneficial if the user was warned that the cache directory path name is too long.

0reactions

techniccommented, Dec 5, 2019

Apparently this is important for jupyter notebooks where the whole path to the notebook ends up in the cache file name. With scripts it is not so bad because it is usually shorter i.e. lib.module.file

Top Results From Across the Web

Joblib crashes after 2x n_jobs - Stack Overflow

The interesting part is it always crashes after calling pullSummaryData exactly 2* n_jobs . If n_jobs=3 , pullSummaryData will be called 6 times ......

joblib Documentation - Read the Docs

Using joblib's caching mechanism avoids hand-written persistence and implicitly links the file on disk to the execution context of the original ...

Development — joblib 1.3.0.dev0 documentation

Memory to properly handle caching for functions defined interactively in a ... Windows and large leaked files in /dev/shm under Linux in case...

Ray Core API — Ray 2.2.0 - the Ray documentation

For testing purposes ONLY. _tracing_startup_hook – If provided, turns on and sets up tracing for Ray. Must be the name of a function...

METADATA · aaronreidsmith/joblib - Gemfury

Metadata-Version: 2.1 Name: joblib Version: 0.14.1 Summary: Lightweight pipelining: ... In particular: 1. transparent disk-caching of functions and lazy ...