question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add more JSON parsing capability to the DelimitedJsonDialect class for querying blob storage JSON files

See original GitHub issue

Is your feature request related to a problem? Please describe. I am trying to query a json file that sits in blob storage. I get a null response no matter what I delimit it by because of (I think) the way the json is formatted. The json file is a list of json’s. For example:

[
   {id:1,
   name: bob,
   shirt: tee}   ,

   {id:2,
   name: time,
   shirt: button} 
]

The query i’m trying to run is “SELECT COUNT(*) FROM BlobStorage”

Describe the solution you’d like I would like the capability to parse this type of json and return the row counts. Similar to pandas " orient=‘records’ " parameter in the read_json function. (i.e. pd.read_json(‘file.json’, orient=‘records’) )

Describe alternatives you’ve considered I have tried DelimitedJsonDialect(delimiter=‘,’) as the blob_format.

Issue Analytics

  • State:open
  • Created 10 months ago
  • Comments:6 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
xiangyan99commented, Nov 15, 2022

Thanks for the feedback, we’ll investigate asap.

0reactions
galtman5commented, Dec 15, 2022

Any update?

Read more comments on GitHub >

github_iconTop Results From Across the Web

azure.storage.blob.DelimitedJsonDialect class | Microsoft Learn
Defines the input or output JSON serialization for a blob data query. keyword str delimiter: The line separator character, default value is '...
Read more >
Append more data to serialized json blobs - Stack Overflow
I see that there's support for Append Blob Storage which is what I plan to use in my app, however I cannot understand...
Read more >
How to Load JSON File From Blob Storage to a Row in SQL ...
How to Load JSON File From Blob Storage to a Row in SQL Table by Using Azure Data Factory | ADF Tutorial 2022,...
Read more >
azure.storage.blob package - NET
The value can be a SAS token string, an account shared access key, or an instance of a TokenCredentials class from azure.identity. Credentials...
Read more >
Azure Data Lake Series: Working with JSON - Part 1 - Taygan
In part 1, we begin by learning how to set up our environment in order to query JSON documents using U-SQL via Azure...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found