Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Implementing `tofile` and `fromfile` to use GPUDirect

See original GitHub issue

Recently GPUDirect Storage added support for reading and writing directly using the GPU. It would be useful if tofile and fromfile were implemented to use this functionality (possibly falling back to their current behavior).

Issue Analytics

State:
Created 4 years ago
Reactions:1
Comments:6 (4 by maintainers)

Top GitHub Comments

3reactions

cnewburncommented, Oct 22, 2020

And the Design Guide Kushal pointed to describes system support and what GDS is validated on. A third party at NERSC has been experimenting with HDF5 here: https://github.com/hpc-io/hdf5/tree/cu_dev. Please let us know what other readers you have interest in.

2reactions

jakirkhamcommented, Oct 4, 2022

KvikIO PR ( https://github.com/rapidsai/kvikio/pull/135 ) is adding this functionality, which CuPy could in turn use. Thoughts welcome on that PR 🙂

Top Results From Across the Web

NVIDIA GPUDirect Storage Overview Guide

Supports interoperability with other OS-based file access, which enables data to be transferred to and from the device by using traditional file IO, ......

NVIDIA GPU Direct Storage with IBM Spectrum Scale

The Spectrum Scale (GPFS) User Group is free to join and open to all using, interested in using or integrating IBM Spectrum Scale....

GPU Direct IO with HDF5 - The HDF Group

With large-scale computing systems are moving towards using GPUs as workhorses of computing. • file I/O to move data between GPUs and storage...

GPU Direct I/O with HDF5

As mentioned earlier, without the GDS VFD, applications have to transfer data explicitly from the GPU memory buffer to CPU memory and write...

Introduction to GPU Direct Storage with NVIDIA and VAST Data

CJ Newburn, Magnum IO Architect, NVIDIA GPU Cloud, gives an introduction to NVIDIA GPU Direct Storage, the ecosystem and a look at the...