question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Newman sends report summary and custom report after 180 sec and continues to run.

See original GitHub issue
  1. Newman Version (can be found via newman -v):3.9.x
  2. OS details (type, version, and architecture):confirmed on Linux Mint and Mac
  3. Are you using Newman as a library, or via the CLI? library
  4. Did you encounter this recently, or has this bug always been there: recently
  5. Expected behaviour: newman should report after the run is completed
  6. Command / script used to run Newman: node script
  7. Sample collection, and auxiliary files (minus the sensitive details):
  8. Screenshots (if applicable):

When executing a script which runs newman and interprets the newman run, then sends a custom report to Testrail, we found that during the test run (180 sec into the run) newman triggers the cli reporter, which triggers our custom reporter, but the newman run continues to execute in CLI. This results in incomplete reports. Our collection is quite big with up to 13 different iterations and up to 2K assertions so it takes way longer than 180 sec to complete all iterations.

I found that this behavior is present in 3.9.x newman versions.

Rolling back to v3.8.3 fixed our issue!

Placed this issue here in hope that someone will find this to be the solution for their issue.

Issue Analytics

  • State:closed
  • Created 6 years ago
  • Comments:7 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
bbartonicommented, Jul 23, 2018

This is not an issue for me any longer, @kunagpal . after temporary roll-back to v3.8.3, we recently added explicit timeout: 120000 (which suites our needs, but still limits the exec), I then updated to newman -v 3.9.3 and been running without any problems to this day.

0reactions
kunagpalcommented, Jul 23, 2018

@shamasis Yes, that is also a possibility. We need to confirm the exact underlying cause.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Reporting Templates With Newman Command Line Runner In ...
This Tutorial will Cover Reporting Templates that can be used with the Newman Command Line Runner to Generate Templated Reports of Postman ...
Read more >
Reports overview - Postman Learning Center
Postman reports only track data sent through the request builder, and not data sent through Newman, collection runs, or monitors.
Read more >
Reports Guide - Blackbaud
“Creating and Running Reports” on page 116 ... “Sending a Report using E-Mail” on page 130 ... The Summary report type displays the...
Read more >
Reports Guide
ATD608 – Monthly ADM Summary. 98. ATD610 – ADA / ADM Enrollment Summary Report. 100. General Attendance Reports. 103. ATD616 – Student Attendance...
Read more >
Continuous Delivery Director 8.3 - TechDocs
The following section is a summary of Continuous Delivery Director key features ... Reports. The REPORTS tab lets you create, save, and access...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found