question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Work out how to scale `.verify()` to lots of inits

See original GitHub issue

Right now .verify() does not scale well to many inits. Currently I am trying to verify an S2S system (that was setup like SubX) with ~1,000 inits and 45 leads. I am just working with a time series and it’s prohibitively slow to even set up the dask graph or to just do in-memory. I think this has to do with constructing a huge dictionary that has the right dates at every init to align.

I think we need to evaluate the shift in datetimes while evaluating to make dask happier. Although I think I went with this dictionary method since you’d only have to do the shifting once, and to figure out which inits to keep for the various alignment strategies.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:29 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
ahuang11commented, Nov 10, 2020

I think you need to do %lprun -f he.verify he.verify(**kw).compute() for lprun to work

0reactions
aaronspringcommented, Jan 26, 2022

.isin() is the bottleneck here. Maybe dict helps, see https://twitter.com/jesperdramsch/status/1486235033153282049?s=21

Read more comments on GitHub >

github_iconTop Results From Across the Web

What Is a Scale Factor? - Video & Lesson Transcript
To write the scale factor of any scaled copy to the original, find the corresponding sides and write a ratio of the original...
Read more >
Scale Calculator
Scale calculator determines the size of scaled/real structures for a given scale or evaluates the scale between two objects.
Read more >
How a PLC do the Scaling for a Sensor
PLC Scaling a Sensor : PLC do the analog input scaling for a transmitter and displays the Process Variable reading in Operator Workstation....
Read more >
Lesson 19: Computing Actual Areas from a Scale Drawing
Calculate the area of the scale drawing, and then multiply by the square of the scale (or scale factor) to determine the actual...
Read more >
How to Determine Returns to Scale: Table-Type Problem
A look at increasing returns to scale, constant returns to scale, ... Increasing returns to scale : If all inputs increase X%, out......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found