question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

time_limit and metric arguments are no longer available?

See original GitHub issue

Greetings to everyone,

As a part of an evaluation I wanted to try autokeras on multiple different datasets. My data are tabular, so I use StructuredDataClassifier and StructuredDataRegressor. The problem is that I cannot set a custom evaluation metric, nor set the time_limit of the model.fit function. In the examples I found online, everyone is setting their desired time_limit, but when I try to run a fit function with this parameter, it outputs the error: Unrecognized keyword arguments: {'time_limit': 360}. Is this functionality removed from the newest version of autokeras? Also, about the metric, I want to use AUC, as the performance metric, but neither the metric variable is recognized.

autokeras 1.0 python 3.6.9 OS Ubuntu 18.04

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:6 (3 by maintainers)

github_iconTop GitHub Comments

2reactions
iXanthoscommented, Jan 22, 2020

@haifeng-jin so is there a way to set a strict time limit? If not, this is a step backwards in my opinion, as it makes autokeras unavailable for quantitative performance evaluation under strict time restrictions (99% of all the published works evaluate a tool or library under some time constraints). Also, when you talk about the initializer, you mean the StructuredDataClassifier call, correct?

Thank you in advance.

1reaction
haifeng-jincommented, Mar 10, 2020

Currently, the is no way to limit the time. However, all the intermediate results and models are saved on disk. You may try to see what’s in the folder. Those kids and models are generated by KerasTuner. Thanks.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Jobs - AWS Glue
For information about the key-value pairs that AWS Glue consumes to set up your job, see the Special Parameters Used by AWS Glue...
Read more >
Resource: newrelic_nrql_alert_condition - Terraform Registry
Sets a time limit, in hours, that will automatically force-close a long-lasting incident after the time limit you select. Possible values are ONE_HOUR ......
Read more >
APIs — AutoSklearn 0.15.0 documentation
All parameters are None by default. If no other value is given, the default values which were set in a call to fit()...
Read more >
Customize pipeline configuration - GitLab Docs
The CI/CD permissions table lists the pipeline features non-project members can ... If the configuration file is in a separate project, you can...
Read more >
azureml.train.automl.automlconfig.AutoMLConfig class
Automated Machine Learning collects more metrics than it can optimize. ... If not specified, accuracy is used for classification tasks, normalized root mean ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found