Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Event Manifest Populator: support pre-R83 enriched events

See original GitHub issue

According to https://github.com/snowplow/snowplow/issues/2679 until R83 we dumped enriched files with .gzip extension, which is not recognized by Spark and therefore EMP, it fails with cryptic exception and effectively cannot load dupe-storage with pre-R83 events.

Issue Analytics

State:
Created 6 years ago
Comments:5 (5 by maintainers)

Top GitHub Comments

1reaction

chuwycommented, Jul 14, 2017

I think this can be used as solution inside Spark https://medium.com/@samuelboyd/spark-reading-gzipped-files-from-s3-without-the-gz-extension-58cc78e6a09d

Will test it now.

0reactions

alexanderdeancommented, Jul 14, 2017

Yes agree

Top Results From Across the Web

Events Manifest Populator | Snowplow Documentation

Event Manifest Populator is an Apache Spark job allowing you to ... the metadata of some or all enriched events from your archive...

Enriched Events Export - Optimizely

How to use Enriched Events Export, which gives you secure access to your Optimizely enriched event data so you can analyze your experiment...

snowplow/snowplow r90-lascaux on GitHub - NewReleases.io

latest releases: snowplow-micro/1.3.3, enrich/3.3.2, ... Event Manifest Populator. Support pre-R83 enriched events (#3293); Bump to 0.1.1 (#3295) ...

Search Fields - Processes and Enriched Events

Field Name Definition Values crossproc_cmdline Command line of the cross‑process command TOKENIZED String process_sha256 SHA‑256 hash of the actor process binary String report_watchlist_id Searchable. Deprecated; use...

Writing Manifest-based Events - Win32 apps - Microsoft Learn

A manifest-based provider can simply write events and ETW will decide if the event gets logged to a trace session. If an event...