Add support for `zstd` compression
See original GitHub issueIt’d be really nice to add support for zstd
compression now that this is an officially supported codec (KIP-110).
Issue Analytics
- State:
- Created 4 years ago
- Reactions:8
- Comments:5 (2 by maintainers)
Top Results From Across the Web
[GIT PULL][PATCH v6 0/8] Add support for ZSTD-compressed ...
Hi all, This patch set adds support for a ZSTD-compressed kernel, ramdisk, and initramfs in the kernel boot process. ZSTD-compressed ramdisk and initramfs ......
Read more >Add support for ZSTD-compressed kernel and initramfs
Add support for ZSTD -compressed kernel and initramfs ; Date: Wed, 8 Jul 2020 11:50:17 -0700 ; Message-ID: <20200708185024.2767937-1-nickrterrell@gmail.com>.
Read more >Add support for Zstandard to System.IO.Compression #59591
The library supports regular compression levels from 1 up to ZSTD_maxCLevel(), which is currently 22. Levels >= 20, labeled --ultra , should be ......
Read more >0003-Add-support-for-ZSTD-compressed-kernel.patch - aur.git
+config KERNEL_ZSTD + bool "ZSTD" + depends on HAVE_KERNEL_ZSTD + help + ZSTD is a compression algorithm targeting intermediate compression + with fast ......
Read more >WL#12039: Add support for zstd compression to classic ...
The goal of this worklog is to add support to specify zstd compression algorithm in the network communication between client and server.
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Agreed. However, there is still protocol-level considerations since the producer has to signal to the broker what compression format was used (which it, in turn, passes to downstream consumers).
What would be a good interface?
I’m thinking the consumer/producer can pass in a custom class. And that class has four pieces:
compress()
decompress()
None
/gzip
/snappy
/other broker-supported valuesCan close, merged in https://github.com/dpkp/kafka-python/pull/2021