question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

What to do with "pure" pypi packages?

See original GitHub issue

There are a lot of python pacakges that “jsut work” with plain old:

pip install the_package

These are pure python packages with non-complex dependencies.

So some folks use a mixture of conda and pip to install stuff, but this gets ugly with the dependency resolution, etc.

I’ve dealt with this so far by making conda packages for these, but there are a LOT of them – and as this is an easy lift, it would be do-able to automate it all. I’ve always thought that Anaconda-org should have a PyPi bridge – someone looks for a package, it’s not there, it looks for a pypi package and builds a conda pacakge on the fly and away we go!

But that wold require Continuum to do it, and maybe would be too much magic.

But maybe we could have a set of conda packages that are auto-built from PyPi (conda skeleton mostly works) and then have an automated system that goes through and looks to see if there are newer versions of any of them, and auto-update those. So in theory, all we’d need to do by hand was keep a list of packages to monitor (probably keep up with whether it had been added to the default channel).

I started down this track before I discovered obvious-ci – running conda skeleton, and building the package on the fly. Then I decided that it was easier to simply maintain by hand the half a dozen packages I needed. But it would be nice to cover a much larger range of packages…

Thoughts?

Issue Analytics

  • State:open
  • Created 8 years ago
  • Reactions:1
  • Comments:24 (16 by maintainers)

github_iconTop GitHub Comments

3reactions
takluyvercommented, Jan 19, 2017

Now that Travis OSX builds are waiting in the queue for many hours to complete a build, I feel like reminding people that wheel2conda can convert a pure-Python wheel to a set of conda packages on a single system in a few seconds.

It’s at a prototype stage at the moment, and it would need more work to turn it into a complete solution, but if we’re routinely going to be waiting hours for an OSX buildbot, building OSX packages from Linux seems rather attractive. And if we could do this for all the pure Python packages, it could free up conda-forge’s ration of OSX buildbots to build more complex packages.

2reactions
ocefpafcommented, Feb 16, 2016

gets ugly with the dependency resolution, etc.

I am not so sure this is as ugly as a before [citation needed]. The integration with pip has improved a lot. (Even Linux distros are now allowing a mixture of PyPI and system packages!)

Maybe we are just missing something like:

conda install --from pypi <some package>
Read more comments on GitHub >

github_iconTop Results From Across the Web

pure - PyPI
Pretty, minimal and fast prompt for various shells.
Read more >
Packaging and distributing projects
To have your project installable from a Package Index like PyPI, you'll need to create a Distribution (aka “Package”) for your project. Before...
Read more >
What Are Python Wheels and Why Should You Care?
In this tutorial, you'll learn what Python wheels are and why you should care as both a developer and end user of Python...
Read more >
Building and Uploading to PyPi - The Sheer Joy of Packaging!
TestPyPI : a separate instance of the Python Package Index (PyPI) that allows you to try out the distribution tools and process without...
Read more >
How do I tell if a PyPI package is pure python or not?
"…install pure python things with pip and other stuff (eg with C deps) with conda." I'm not sure it's possible. There're pure-python ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found