Microsoft.Analytics.Samples.Formats.Avro is broken
See original GitHub issueThe AvroExtractor.Extract method, public override IEnumerable<IRow> Extract(IUnstructuredReader input, IUpdatableRow output)
, uses the Length of the input stream. However, the Length property on the BaseStream is no longer supported, and when I try to run it I get this error:
The [Length] property of [IUnstructuredReader.BaseStream] is intentionally not supported to avoid ambiguity between the physical length of [IUnstructuredReader.BaseStream] and the logical length of the split of the entire input stream assigned to a vertex.
The solution is available in this repo here: https://github.com/Azure/usql/tree/master/Examples/DataFormats
Issue Analytics
- State:
- Created 6 years ago
- Comments:5
Top Results From Across the Web
Reading Avro format in Synapse Analytics - Microsoft Q&A
I am trying to read and process avro files from ADLS using a Spark pool notebook in Azure Synapse Analytics. The avro files...
Read more >AVRO parsing suddenly not working?
Hi,. We have a setup where we send IoT data to Azure IoT Hub, which then stores this data as AVRO blobs to...
Read more >Avro format in Azure Data Factory and Synapse Analytics
This topic describes how to deal with Avro format in Azure Data Factory and Synapse Analytics.
Read more >Troubleshooting Inputs for Azure Stream Analytics
This article describes common issues with Azure Stream Analytics input ... Using Event Hub capture blob in Avro format as input in your...
Read more >Serverless SQL pool self-help - Azure Synapse Analytics
The table has a format that isn't supported in serverless SQL pool. Examples are Avro or ORC. String or binary data would be...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Will be obsolete when https://github.com/Azure/usql/pull/98 has been merged because it uses a different Avro Library.
I can not reproduce the problem anymore. I guess either because I did it differently this time or because the data format sample code got updated. ( #88 is still an issue )