gzip compression unavailable within Docker (and no zstd)

Hi, I’m pretty new to use node-rdkafka.

When I run my node-rdkafka app within a Docker container I get the following output from

console.log(Kafka.features);

Output:

[ 'snappy', 'sasl', 'regex', 'lz4', 'sasl_plain', 'plugins' ]

The only one compression method available is lz4.

When I run the same app into my machine I get the output:

[ 'gzip', 'snappy', 'sasl', 'regex', 'lz4', 'sasl_gssapi', 'sasl_plain', 'plugins' ]

It seems that the library compilation within Docker fails to add the gzip compression. The compilation output is pretty long so I prefer to link the Dockerfile.

Aside: no zstd library available in both cases.

What’s going on? Let me know if further information are needed.

Environment Information

• OS: Mac
• Node Version: 12
• NPM Version [e.g. 5.4.2]: 6.14.4
• C++ Toolchain: g++
• node-rdkafka version: 2.8.1

Steps to Reproduce

Run this project https://github.com/ccarcaci/spike-node-kafka

[sam-github]

Why are you using node-slim? The main thing that makes it slim is not having the build tools, which you add back in.

Consider a multi-stage build, something like:

# Install the app dependencies in a full Node docker image
FROM node:12

# librdkafka builds against libssl-dev
RUN apt-get update && apt-get install -y libssl-dev && apt-get clean

WORKDIR /project
RUN npm install --production

# Copy the dependencies into a slim Node docker image
FROM node:12-slim

# librdkafka links against libssl
RUN apt-get update && apt-get install -y libssl1.1 && apt-get clean

COPY --chown=node:node --from=0 /project /project  # or whatever is right for you

If that doesn’t get you more features, you have to find and add the relevant -dev packages to the build image, libsasl for example (I haven’t checked).

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.