Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Expected performance

See original GitHub issue

If we run the three experiments from the README:

# Exp. 1
./scripts/ptb_search.sh
./scripts/ptb_final.sh

# Exp. 2
./scripts/cifar10_macro_search.sh
./scripts/cifar10_macro_final.sh

# Exp 3.
./scripts/cifar10_micro_search.sh
./scripts/cifar10_micro_final.sh

what should we expect the final performance metrics to be? Are you able to post the expected results either here or in the README?

Thanks

Issue Analytics

State:
Created 5 years ago
Comments:12

Top GitHub Comments

1reaction

bkjcommented, Apr 3, 2018

Fantastic – thank you. I’m running the cifar10_micro_search.sh now, and will post here to confirm once I get some results.

~ Ben

0reactions

chg0901commented, Oct 3, 2019

@upwindflys @axiniu I also just get the same 12 cell but my macro search get very high accuracy like

[2]
[3 0]
[5 1 0]
[5 0 0 1]
[2 0 0 0 1]
[1 0 0 0 0 0]
[5 1 0 1 0 0 0]
[1 0 0 0 1 0 0 0]
[1 0 0 0 0 1 0 0 0]
[5 0 1 0 0 0 1 1 0 1]
[4 0 0 0 1 0 1 0 1 0 0]
[1 0 0 0 0 0 0 1 1 0 1 1]
val_acc=0.8125
--------------------------------------------------------------------------------
Epoch 310: Eval
Eval at 109120
valid_accuracy: 0.8154
Eval at 109120
test_accuracy: 0.8080

But did you know the difference between 12 and 24 cell?

Top Results From Across the Web

Performance Expectations = Results + Actions & Behaviors

Performance objectives express mutually understood agreements for results that an employee is expected to produce during the performance review period.

What is 'expected performance'? | OneUp Sales Help Center

The expected performance indicator can be found across the platform in areas such as the Dashboard or the Matrix. Think of your expected...

A comparison of observed performance and expected ...

The expected performance is based on the overall distribution that is fit to your data and estimates the nonconforming parts that you can...

Performance Expectation Definition | Law Insider

Performance Expectation means a goal, value, or both, defining outcomes and behaviors that are documented on a performance plan to identify results to...

SAMPLE PERFORMANCE EXPECTATIONS

You will be expected to work toward professional certification in your field/discipline. You will be expected to participate in 40 hours of job...