Scala Stream Collector: provide a way to specify custom path mappings
See original GitHub issuee.g.
com.acme/track -> com.snowplowanalytics.snowplow/tp2
com.acme/redirect -> r/tp2
com.acme/iglu -> com.snowplowanalytics.iglu/v1
Issue Analytics
- State:
- Created 4 years ago
- Reactions:2
- Comments:5 (5 by maintainers)
Top Results From Across the Web
Configure the Stream Collector - Snowplow Documentation
This is for customising the collector's endpoints. You can also map any valid (ie, two-segment) path to one of the three default paths....
Read more >How to convert a Java Stream to a Scala Stream?
Basically just use an iterator: import java.nio.file.{Files, Paths} import scala.collection.JavaConverters._ Files.list(Paths.get(".
Read more >Structured Streaming Programming Guide - Apache Spark
You can use the Dataset/DataFrame API in Scala, Java, Python or R to express streaming aggregations, event-time windows, stream-to-batch joins, etc.
Read more >Streams Cookbook - Documentation - Akka
DebugLevel)) .map(analyse) // or provide custom logging adapter implicit val ... as a stream, which needs to be collected into a Scala collection...
Read more >AWS Glue job parameters
Specifies a custom CloudWatch log stream prefix for a job enabled for ... The Amazon S3 paths to additional Python modules that AWS...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
I think I get it - so you are saying that any given X -> Y mapping at a point in time should be “locked” into the raw event rather than be an at-enrich overlay?
@dilyand that’s absolutely fine - we just need to make it clear in the documentation that custom paths must be of the form
string1/string2