question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Large Xml to csv is tooo slow(Json to csv)

See original GitHub issue

when try with large xml to csv or json to csv it take more time. code is


  StringBuilder csvData = new StringBuilder();
            using (var r = new ChoJSONReader(Json))
            {
                using (var w = new ChoCSVWriter(csvData).WithFirstLineHeader())
                {
                    w.Write(r);
                }
            }

or

            StringBuilder sb = new StringBuilder();
            using (var p = ChoXmlReader.LoadText(doc.InnerXml))
            {
                using (var w = new ChoCSVWriter(sb).WithFirstLineHeader())
                    w.Write(p);
            }

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

2reactions
Cinchoocommented, Dec 31, 2019

Please try installing prerelease packages. try.

Install-Package ChoETL.NETStandard -Version 1.1.0.5-alpha8
Install-Package ChoETL.JSON.NETStandard -Version 1.1.0.5-alpha8
0reactions
neuli1980commented, Jan 1, 2020

found the issue, fixed and pushed new package. Please take the latest and try it.

Thanks for reporting it.

Where is the source for this fix? There is no new commit for this issue.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Converting very large files from xml to csv
For a 1 GB .txt file with xml data, my old method took around ~25-30 minutes, this method takes ~45 seconds. What a...
Read more >
Efficient way to convert a large xml file to csv
It will depend on the structure of your xml file (next time a short sample would be helpfull). Usually, you can do it...
Read more >
Read large amount of XMLs and load into single csv
The code gives the result that I want: Each row is a single XML while columns are the categories/variable names coming from the...
Read more >
How to convert large xml file to csv/sheet format : r/rstats
I'm trying to convert the large FDA Adverse Drug event data available in a large xml format to a user-friendly format for my...
Read more >
How to Convert Large XML to CSV Format?
This write-up is going to explain the methods to convert large XML to CSV format in bulk using the best and fastest methods....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found