question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Memory leak in v3.28.0

See original GitHub issue

Describe the bug

High memory usage in v3.28.0, up to a point where the Node processes become unresponsive. Restarting reproduces.
I just reverted to v3.27.0 and will observe charts for a few hours. I’ll report here

In the screenshot below (from Kibana APM app itself), elastic-apm-node upgrade was merged on Feb. 9th at 3am (Paris time).This process is automatic. The app was restarted the same day at around 1pm

screenshot-kibana-01 storcloud org-2022 02 10-09_24_27

To Reproduce

Steps to reproduce the behavior:

  1. Upgrade a running application using elastic-apm-node v3.27.0 to v3.28.0

Expected behavior

Nothing special, APM keeps on collecting data as usual.

Environment (please complete the following information)

  • OS: Ubuntu 18.04
  • Node.js version: 16.13.0
  • APM Server version: 7.13.3
  • Agent version: 3.28.0

How are you starting the agent? (please tick one of the boxes)

  • Calling agent.start() directly (e.g. require('elastic-apm-node').start(...))
  • Requiring elastic-apm-node/start from within the source code
  • Starting node with -r elastic-apm-node/start

Additional context

  • Agent config options No options, we use all defaults
  • package.json dependencies:
   "@aws-sdk/client-s3": "3.50.0",
   "@elastic/ecs-winston-format": "1.3.1",
   "@elastic/elasticsearch": "7.17.0",
   "@fortawesome/fontawesome-free": "6.0.0",
   "angular": "1.8.2",
   "angular-animate": "1.8.2",
   "angular-aria": "1.8.2",
   "angular-chart.js": "1.1.1",
   "angular-file-saver": "1.1.3",
   "angular-i18n": "1.8.2",
   "angular-material": "1.2.4",
   "angular-material-data-table": "0.10.10",
   "angular-messages": "1.8.2",
   "angular-sanitize": "1.8.2",
   "angular-translate": "2.19.0",
   "angular-translate-loader-static-files": "2.19.0",
   "angular-ui-router": "1.0.30",
   "angulartics": "1.6.0",
   "angulartics-google-analytics": "0.5.0",
   "axios": "0.25.0",
   "basic-auth": "2.0.1",
   "body-parser": "1.19.1",
   "bull": "4.5.1",
   "bunyan-winston-adapter": "0.2.0",
   "chart.js": "2.9.4",
   "chartjs-plugin-annotation": "0.5.7",
   "chartjs-plugin-datalabels": "1.0.0",
   "cheerio": "1.0.0-rc.10",
   "cls-hooked": "4.2.2",
   "connect-flash": "0.1.1",
   "connect-multiparty": "2.2.0",
   "connect-redis": "6.1.1",
   "d3plus": "1.9.8",
   "dpkg-compare-versions": "1.0.1",
   "elastic-apm-node": "3.28.0",
   "email-templates": "8.0.8",
   "express": "4.17.2",
   "express-session": "1.17.2",
   "file-saver": "2.0.5",
   "form-data": "4.0.0",
   "google-palette": "1.1.0",
   "he": "1.2.0",
   "i18n-2": "0.7.3",
   "ioredis": "4.28.5",
   "jquery": "3.6.0",
   "js-yaml": "4.1.0",
   "jsonwebtoken": "8.5.1",
   "jstransformer-less": "2.3.0",
   "less": "4.1.2",
   "lodash": "4.17.21",
   "marked": "4.0.12",
   "method-override": "3.0.0",
   "mjml": "4.12.0",
   "moment": "2.29.1",
   "moment-duration-format": "2.3.2",
   "moment-timezone": "0.5.34",
   "mysql2": "2.3.3",
   "ng-file-upload": "12.2.13",
   "node-jose": "2.1.0",
   "node-stream-zip": "1.15.0",
   "nodemailer-stub": "1.2.2",
   "oidc-provider": "7.10.6",
   "openid-client": "5.1.3",
   "otplib": "12.0.1",
   "passport": "0.5.2",
   "passport-http": "0.3.0",
   "passport-jwt": "4.0.0",
   "passport-local": "1.0.0",
   "pug": "3.0.2",
   "puppeteer-core": "5.2.1",
   "qrcode": "1.5.0",
   "sequelize": "6.16.1",
   "sequelize-temporal": "1.0.8",
   "sha512crypt-node": "1.0.1",
   "svg-captcha": "1.4.0",
   "swagger-ui-express": "4.3.0",
   "tempy": "1.0.1",
   "umzug": "3.0.0",
   "uuid": "8.3.2",
   "winston": "3.5.1",
   "xlsx": "0.18.0",
   "zabbix-promise": "2.0.2"

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:9 (9 by maintainers)

github_iconTop GitHub Comments

1reaction
ddolcimascolocommented, Feb 11, 2022

@trentm I can confirm that v3.29.0 fixes it. Thx again

0reactions
trentmcommented, Feb 11, 2022

elastic-apm-node@3.29.0 has been published with what I understand to be a fix for this.

Read more comments on GitHub >

github_iconTop Results From Across the Web

emacs 28 - massive memory leak - Reddit
Running as a daemon, no windows open. After a couple of hours it got to 4gb and I rebooted. As can be seen...
Read more >
Java agent v3.28.0 - New Relic Documentation
Fixed a bug that could cause highly asynchronous applications to experience a memory leak in the NewRelic TransactionService.
Read more >
Memory Leak on High Sierra 10.13.3 - Apple Community
Memory Leak on High Sierra 10.13.3. I have a MB Pro (2016) with 16GB RAM. Ever since upgrading, performance has been wonky.
Read more >
JavaScript Closure Memory Leak - google chrome
I'm using Chrome 28.0.1500.71 on OS X 10.8.4. The following code never deallocates the space that was held by me and I'm clueless...
Read more >
3 Troubleshoot Memory Leaks - Java - Oracle Help Center
If your application's execution time becomes longer, or if the operating system seems to be performing slower, this could be an indication of...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found