question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Souce connector can not be created successfully on pulsar cluster that installed by the offical helm chart

See original GitHub issue

Describe the bug I install pulsar on kubernetes using official helm chart . All my connector can not created successfully, even the builtin( for example debezium-mysql ). I found the OutOfDirectMemoryError of direct memory in the log of broker. But the exception still exists after increate direct memory from 256MB to 2GB.

But the connector runs in local mode normally.

To Reproduce

  1. helm upgrade --install pulsar apache/pulsar --timeout 10m --set initialize=true 2
 bin/pulsar-admin source create --tenant iot --namespace pipe  \
--name xxxxx --destination-topic-name xxx/xxx/xxx --parallelism 1 --archive builtin://debezium-mysql \
--source-config  '{ "database.hostname": "mysql", "database.port": "3306", "database.user": "xxxx", "database.password": "xxxxx","database.server.id": "1","database.server.name": "xxxxx","database.whitelist": "xxxx", "table.whitelist": "xxxxxx","schemas.enable":false,"pulsar.service.url": "pulsar://pulsar-proxy:6650" }'

  1. the broker log
06:24:14.597 [DL-io-0] ERROR org.apache.bookkeeper.common.allocator.impl.ByteBufAllocatorImpl - Unable to allocate memory
io.netty.util.internal.OutOfDirectMemoryError: failed to allocate 16777216 byte(s) of direct memory (used: 251658247, max: 268435456)
	at io.netty.util.internal.PlatformDependent.incrementMemoryCounter(PlatformDependent.java:742) ~[io.netty-netty-common-4.1.48.Final.jar:4.1.48.Final]
	at io.netty.util.internal.PlatformDependent.allocateDirectNoCleaner(PlatformDependent.java:697) ~[io.netty-netty-common-4.1.48.Final.jar:4.1.48.Final]
	at io.netty.buffer.PoolArena$DirectArena.allocateDirect(PoolArena.java:758) ~[io.netty-netty-buffer-4.1.48.Final.jar:4.1.48.Final]
	at io.netty.buffer.PoolArena$DirectArena.newChunk(PoolArena.java:734) ~[io.netty-netty-buffer-4.1.48.Final.jar:4.1.48.Final]
	at io.netty.buffer.PoolArena.allocateNormal(PoolArena.java:245) ~[io.netty-netty-buffer-4.1.48.Final.jar:4.1.48.Final]
	at io.netty.buffer.PoolArena.allocate(PoolArena.java:227) ~[io.netty-netty-buffer-4.1.48.Final.jar:4.1.48.Final]
	at io.netty.buffer.PoolArena.allocate(PoolArena.java:147) ~[io.netty-netty-buffer-4.1.48.Final.jar:4.1.48.Final]

Expected behavior The source connector created successfully.

Additional context helm chart version: 2.7.0 and 2.6.3-2 kubernetes:v1.18.10

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:6 (1 by maintainers)

github_iconTop GitHub Comments

1reaction
xiemeilongcommented, Jan 15, 2021

This is my chart values

initialize: true
clusterDomain: yunmotec-dev.local
proxy:
  replicaCount: 1
broker:
  replicaCount: 1
  resources:
    requests:
      memory: 2Gi
      cpu: 2
  configData:
    nettyMaxFrameSizeBytes: "104857600"
    PULSAR_MEM: >
      -Xms256m -Xmx2048m -XX:MaxDirectMemorySize=2048m
zookeeper:
  replicaCount: 1
bookkeeper:
  replicaCount: 4
  resources:
    requests:
      memory: 1Gi
      cpu: 1
  configData:
    nettyMaxFrameSizeBytes: "104857600"
    PULSAR_MEM: >
      -Xms256m -Xmx1024m -XX:MaxDirectMemorySize=1024m
0reactions
armangurkancommented, Jun 13, 2022

This should be open we have the same issue in 2.8.2

Read more comments on GitHub >

github_iconTop Results From Across the Web

Deploy Pulsar cluster using Helm
To use the Pulsar Helm chart to create the Kubernetes namespace automatically, you can include this option in the helm install command.
Read more >
Get Started | StreamNative Documentation
This document guides you through every step of installing and running StreamNative Platform with operators on Kubernetes quickly. It includes the following ...
Read more >
Comparing Apache Kafka and Apache Pulsar
There is no official binary Helm package, so one has to clone the whole Pulsar repository to install it — the Helm chart...
Read more >
Mastering Apache Pulsar
Jowanza Joseph, staff software engineer at Finicity, explains how to deploy production Pulsar clusters, write reliable event streaming ...
Read more >
Luna Streaming FAQs - DataStax Documentation
How do I install DataStax Luna Streaming in my Kubernetes cluster? ... DataStax Luna Streaming provide that I cannot get with open-source Apache...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found