question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Support for event.ingested and event.processed

See original GitHub issue

event.created is described as the time when the event was first read by an agent or by a pipeline. In a distributed setup however that means that information is lost about the time taken to process an event at the various stages.

Would it be possible to add new fields to event to keep that information? For example, event.processed can hold the time when e.g. logstash (the last one in a chain or maybe an array) actually processes the event, and event.ingested when an ingest pipeline handles it.

Does this make sense?

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:12 (7 by maintainers)

github_iconTop GitHub Comments

3reactions
webmatcommented, Dec 13, 2019

does #582 close this?

Not fully. We’ve merged and released event.ingested, but we haven’t addressed the pipeline timestamp yet. Let’s keep it open for now.

2reactions
ruflincommented, May 9, 2019

It’s something we discussed in the past on goes a bit into event tracing. I can definitively see the value of these “measurements” on the event. I wonder if we could come up with a more generic way of storing multiple timestamps and we could let everyone add as many timestamps he needs.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Event Fields | Elastic Common Schema (ECS) Reference [8.5]
The event fields are used for context information about the log or metric event itself. A log is defined as an event containing...
Read more >
Event ingestion explained - Handbook - PostHog
This document gives an overview of how data ingestion… ... Decompressing and normalizing the shape of event data for the rest of the...
Read more >
Event ingestion | Camunda Platform 8 Docs
The Event Ingestion REST API ingests business process related event data from any third-party system to Camunda Optimize. These events can then be ......
Read more >
Ingest from event hub - Azure Data Explorer - Microsoft Learn
This article describes how to ingest data from Azure Event Hubs into Azure Data Explorer.
Read more >
Ingested raw event types - IBM
Business Automation Insights can ingest specific types of raw events. Ingestion. The event types and the description of the raw events that can...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found