Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Using `-Xfatbin=-compress-all` for kernel compilation

See original GitHub issue

Not sure how relevant this is for how CuPy compiles things, but something we have been exploring in RAPIDS that may be of interest is building with -Xfatbin=-compress-all. In some cases this can make for quite dramatic reductions in compiled kernel sizes. For an example please see PR ( ). Again not sure if this is relevant for how CuPy is building things, but just wanted to mention it in case it is.

Issue Analytics

  • State:open
  • Created 3 years ago
  • Reactions:2
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

kmaehashicommented, Mar 15, 2021

Thanks for sharing this! I tried this locally (my environment uses export CUPY_NVCC_GENERATE_CODE=arch=compute_60,code=sm_60;arch=compute_70,code=sm_70;arch=compute_80,code=sm_80) and measured du -csh cupy cupyx cupy_backends:

  • with compression: 95MB
  • without compression: 102MB

In CuPy it seems the effect is limited because nvcc is only used for a few modules (cub/thrust/random).

Moreover, after compressing files into a wheel (ie ZIP), the compressed one was 262 KB larger.

leofangcommented, Aug 5, 2022

It’s another 15-25M for the cub module and I didn’t check other modules. I don’t see the build time increased, and the runtime overhead for decompression is negligible based on an internal discussion (though likely outdated). For reference, all RAPIDS binaries are built with this option.

Though, to be fair, it does not always help. For example, with this feature I see cub inflates to 190M+, and the compression only brings it down to 170M+, not a significant change.

Read more comments on GitHub >

github_iconTop Results From Across the Web

How to compile and install Linux Kernel 5.16.9 from source code
This page explains how to compile and install Linux Kernel 5.16.9 running on modern Linux distro such as Fedora, Ubuntu, Debian and others....
Read more >
Kernel/Traditional compilation - ArchWiki - Arch Linux
This article is an introduction to building custom kernels from sources. This method of compiling kernels is the traditional method common to...
Read more >
How to Compile a Linux Kernel
How to Compile a Linux Kernel · The first thing to do is download the kernel source file. · Change into the newly...
Read more >
8.10. Compiling a Kernel
Getting the Sources. Like anything that can be useful on a Debian system, the Linux kernel sources are available in a package. To...
Read more >
Kernel/BuildYourOwnKernel - Ubuntu Wiki
This page describes how to build the kernel. The majority of users that are interested in building their own kernel are doing so...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Post

No results found

github_iconTop Related Hashnode Post

No results found