question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

can we replace tablib dependency with pyexcel

See original GitHub issue

The downside of using tablib are that all data is processed in-memory. It is not good for large datasets. Can we replace the dependency with pyexcel.

  • it supports django models natively.
  • it has stream APIs to support large files

Issue Analytics

  • State:open
  • Created 3 years ago
  • Reactions:1
  • Comments:12 (7 by maintainers)

github_iconTop GitHub Comments

2reactions
andrewgy8commented, Aug 21, 2020

Thanks @jnoortheen for the transparency. And I agree, its a major change that will require multiple changes.

However, if someone wants to get started, they could start with one piece of functionality and move it to a pluggable backend. No need to have settings or anything. If I get some time soon, I will try to come up with a little working example, as this sounds like a fun challenge. 😍

1reaction
jnoortheencommented, Jul 29, 2020

@rhunwicks I think a backend architecture will work in this. using any one of available dependency. Pandas still has difficulty installing and finding the runtime dependencies in some operating systems. A pure Python package is truly portable.

Read more comments on GitHub >

github_iconTop Results From Across the Web

tablib - PyPI
Fixed minimal openpyxl dependency version to 2.6.0 (#457). ... If you count on the broken behavior, please update your code when you upgrade...
Read more >
Installation — Tablib 3.2.1 documentation
This part of the documentation covers the installation of Tablib. ... You can also choose to install more dependencies to have more import/export...
Read more >
pyexcel - Let you focus on data, instead of file formats ...
This library focuses on data processing using excel files as storage media hence fonts, colors and charts were not and will not be...
Read more >
Guidelines and HOWTOs/Build from source/Install the ...
Some operating systems also require that you enable on the source repositories before you can install build dependencies. Do that now, if ...
Read more >
How "Export to Excel" Almost Killed Our System | Haki Benita
tablib (and django-import-export ) can be patched to use pyexcelerate and produce excel files faster. Table of Contents.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found