question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

@google-cloud/PubSub@1.x has increased memory usage compared to 0.29.1

See original GitHub issue

@pmcnr-hx this memory issue sounds a bit different than what folks were initially seeing in #770 (which was a ceasing up of message processing), so I’ve created this new tracking issue.

Running In Debug Mode

If it’s not too much of a bother, could I get you to run your system with debugging enabled:

process.env.GRPC_TRACE = 'all';
process.env.GRPC_VERBOSITY = 'DEBUG';
const {PubSub} = require('@google-cloud/pubsub');

☝️ I’m curious to see if there is any odd behavior immediately before the message fails to process.

Memory Usage

Do you have any graphs you could share of the memory spiking behavior caused by @grpc/grpc-js, vs., grpc.

Environment details

@pmcnr-hx mind providing this information, with regards to OS/Runtime, are you on Google App Engine, Kubernetes Engine?

  • OS/Runtime: ?
  • Node.js version: ?
  • @google-cloud/pubsub version: 1.1.3

Steps to reproduce

@pmcnr-hx it sounds like the memory issue you run into happens after a few hours of processing, what does the workload look like?, e.g., messages per minute, what type of work happens as the result of a message.

  1. ?

see #770

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Reactions:5
  • Comments:20 (11 by maintainers)

github_iconTop GitHub Comments

2reactions
bcoecommented, Nov 19, 2019

@Legogris @vigandhi @ibarsi @bsato212 if anyone has the cycles to test the dependency out, could I bother you to try the dependency:

npm i @google-cloud/pubsub@next

☝️ I’ve released version 1.1.6-beta.0 of PubSub, which hopefully addresses some lingering memory issues that folks were seeing.


@ibarsi @vigandhi I have not floated a similar patch for @google-cloud/logging-bunyan, if this seems to be where you’re seeing the issue, I can do so, but let’s move the conversation to that repository.

0reactions
feywindcommented, May 14, 2020

I’m going to go ahead and close this for now since it’s been idle, but please do re-open/comment if needed.

Read more comments on GitHub >

github_iconTop Results From Across the Web

google-cloud/PubSub@1.x has increased memory usage ...
@google-cloud/PubSub@1.x has increased memory usage compared to 0.29.1 #787 ... api: pubsub Issues related to the googleapis/nodejs-pubsub API.
Read more >
View memory usage in Activity Monitor on Mac - Apple Support
In Activity Monitor, view the amount of system memory being used on your Mac, including physical, compressed, wired, and app memory.
Read more >
Memory Allocation — Cython 3.0.0a11 documentation
Everything is an object, and the reference counting system and garbage collector automatically return memory to the system when it is no longer...
Read more >
Analyze memory usage in the Performance Profiler - Visual ...
Learn how to use the Memory Usage tool without the debugger in the Visual Studio Performance Profiler to monitor your app's memory use....
Read more >
High MP Memory consumption on PA-5200 Series firewall
When running the command show system resources from the CLI, high physical memory consumption is seen on the management plane. Example:
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found