NASBench201 KeyError
See original GitHub issueThanks for sharing the great repo. I tried to access the accuracy of ‘x-valid’ on CIFAR10 dataset but failed because of the key error.
>>> results = api.query_by_index(0, 'cifar10')
>>> results.keys()
dict_keys([777, 888, 999])
>>> results[888].get_eval('x-valid')
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/home/yangzhaohui/anaconda3/lib/python3.7/site-packages/nas_201_api/api.py", line 885, in get_eval
'loss' : self.eval_losses['{:}@{:}'.format(name,iepoch)],
KeyError: 'x-valid@199'
Issue Analytics
- State:
- Created 3 years ago
- Comments:6 (3 by maintainers)
Top Results From Across the Web
NAS-Bench-201 API and Instruction - GitHub
We propose an algorithm-agnostic NAS benchmark (NAS-Bench-201) with a fixed search space, which provides a unified benchmark for almost any up-to-date NAS ...
Read more >nes.darts.baselearner_train.oneshot.darts_wrapper_discrete ...
... i.e. when querying nasbench201 if not nb201: # seed_init can be anything ... seed)] except KeyError: seed_list.remove(seed) seed = seed_list[0] try: ...
Read more >KeyError raised when training a neural network with Nolearn
I have solved the problem myself. The data types had to be numpy arrays instead of pandas dataframes.
Read more >NAS Benchmarks - Neural Network Intelligence - Read the Docs
The directory that stores the benchmark file can be configured with NASBENCHMARK_DIR environment variable, which defaults to ~/.nni/nasbenchmark . Note that the ...
Read more >KeyError error message in master head? - Deep Graph Library
Have a model that works with 0.7 release, then switch to master head b/c we need distributed engative sampler feature.
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
You are welcome! Thanks for using our benchmark 😃
It’s a great work and everyone should use the benchmark to verify their search algorithm!