question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

`cupyx.scipy.spatial` and `cupyx.scipy.spatial.distance` packages

See original GitHub issue

Description

The RAFT project (https://github.com/rapidsai/raft) has several building blocks for different algorithms in the RAPIDS Analytics ecosystem and among these building blocks are spatial distance and nearest neighbors algorithms. The can be very useful for building out cupy.spatial and cupy.spatial.distance packages. I’m thinking RAFT might be able to provide a libraft package, which would include cython wrappers for direct consumption by cupy in a similar manner pylibcugraph is used by cupy.

Additional Information

No response

Issue Analytics

  • State:open
  • Created 2 years ago
  • Reactions:7
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

5reactions
cjnoletcommented, Mar 15, 2022

Providing an update here. We have a PR open for the pylibraft packaging and our first pytest to compute Euclidean pdist is passing.

https://github.com/rapidsai/raft/pull/540

We are pushing to get this integrated (early) in the RAPIDS 22.06 release. Once pylibraft is integrated into cupy, it should be straightforward to integrate other namespaces.

2reactions
cjnoletcommented, Apr 25, 2022

Cross linking prioritized issue on raft side: https://github.com/rapidsai/raft/issues/622

Read more comments on GitHub >

github_iconTop Results From Across the Web

cupyx.scipy.spatial.distance.minkowski — CuPy 12.0.0b2 ...
cupyx.scipy.spatial.distance.minkowski#. cupyx.scipy.spatial.distance.minkowski(u, v, p)[source]#. Compute the Minkowski distance between two 1-D arrays.
Read more >
CuPy v11 is now available - Medium
Distributed Collective & P2P Primitives for Sparse Matrix. First introduced in CuPy v10, cupyx.distributed package now supports sparse matrices ( cupyx.scipy.
Read more >
scipy.spatial.distance.cdist — SciPy v1.9.3 Manual
scipy.spatial.distance.cdist(XA, XB, metric='euclidean', *, out=None, ... Compute distance between each pair of the two collections of inputs.
Read more >
Using cupy to create a distance matrix from another matrix on ...
Why aren't you using scipy.spatial.distance.cdist? That would have to be 5 to 10 times faster than your CPU loops.
Read more >
CuPy Documentation - Read the Docs
Multidimensional Image Processing (cupyx.scipy.ndimage.*) ... and cupy package (source installation) conflict with each other.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found