question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Benchmark Page is confusing, possibly incorrect?

See original GitHub issue

The benchmark page seems to be claiming that the LocalWeatherReadTest in the source code completes four passes in a total of 10.5 seconds.

The sample code in TinyCsvParserBenchmark() on that page appears to match the code in LocalWeatherReadTest().

I downloaded the exact same 201503hourly.txt file used in the example, 557 MB.

The test took 4 minutes to run, not 10.5 seconds. If I set the degreeOfParallelismList to only have one item in it, it still took a bit over 1 minute to run. Not 10.5 seconds.

Granted we’re not running these tests on the same computer, but I have a really hard time believing your computer is 23 times faster than mine.

Can you shed any light on this? I’m unable to get results that are even slightly close to as fast as what’s being claimed here. The only thing that’s close is the SeqReadTest, which completes in 9-14 seconds for me, depending on what .NET Core runtime I use, but while that test uses the same input file, it doesn’t use any TinyCsvParser code.

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:13

github_iconTop GitHub Comments

1reaction
jtmuellercommented, Aug 4, 2018

I’ve been making some pretty good progress with a fork of your parser that I’ve converted to be based on Span<T>. As a result, it only runs on .NET Core 2.1 or better, but I’m seeing some great results so far.

https://gist.github.com/jtmueller/4e6ab27a3fe82c97e0f315c99123c494

0reactions
bytefishcommented, Aug 6, 2018

Sounds good! I have a lot of work this week, so I won’t have much time before the weekend. I will merge the BenchmarkDotNet code most probably on the weekend. That means you have all the time you need to create a repository. ☺️

Read more comments on GitHub >

github_iconTop Results From Across the Web

Is GPU.userbenchmark a misleading/biased site? : r/Amd
I'm asking because I hear that user benchmarks comparison of CPUs is highly biased. However whenever I google comparisons of graphics cards GPU....
Read more >
Benchmarking site performance can be misleading
Although it is obviously interesting and insightful to compare how your website is performing against your peers and competitors, it can be a ......
Read more >
"Benchmarking: You're Doing It Wrong" by Aysylu Greenberg
Knowledge of how to set up good benchmarks is invaluable in understanding performance of the system. Writing correct and useful benchmarks ...
Read more >
The Problem With Benchmarks
What makes a good benchmark and who should create it? This is an issue the industry has been slow to address, but progress...
Read more >
The Biggest Benchmarking Mistakes And Pitfalls You Must ...
Benchmarking – the process of comparing business performance against the performance of others – is a popular performance management tool.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found