question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[FR] add a "name" parameter when creating runs from `client.create_run()`

See original GitHub issue

Willingness to contribute

The MLflow Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature (either as an MLflow Plugin or an enhancement to the MLflow code base)?

  • Yes. I can contribute this feature independently.
  • Yes. I would be willing to contribute this feature with guidance from the MLflow community.
  • No. I cannot contribute this feature at this time.

Proposal Summary

When creating a run using the mlflow client, it will be useful to provide a custom name.

client = MlflowClient()
experiment_id = "0"
run = client.create_run(experiment_id, tags=tags, name="My custom run name")

Motivation

  • What is the use case for this feature?

I run hyper-parameter search with ray[tune] package using their MLflow Autologging and then when I analyze metric plots it’s hard to tell runs apart (screenshot attached). Their code uses mlflow’s client.create_run()

  • Why is this use case valuable to support for MLflow users in general?

It will eliminate the need for manual clicking on each run to find out its details.

  • Why is it currently difficult to achieve this use case? (please be as specific as possible about why related MLflow features and components are insufficient)

Currently there’s no option of adding a custom run name, whilst the option is present in mlflow.start_run().

What component(s), interfaces, languages, and integrations does this feature affect?

Components

  • area/artifacts: Artifact stores and artifact logging
  • area/build: Build and test infrastructure for MLflow
  • area/docs: MLflow documentation pages
  • area/examples: Example code
  • area/model-registry: Model Registry service, APIs, and the fluent client calls for Model Registry
  • area/models: MLmodel format, model serialization/deserialization, flavors
  • area/projects: MLproject format, project running backends
  • area/scoring: MLflow Model server, model deployment tools, Spark UDFs
  • area/server-infra: MLflow Tracking server backend
  • area/tracking: Tracking Service, tracking client APIs, autologging

Interfaces

  • area/uiux: Front-end, user experience, plotting, JavaScript, JavaScript dev server
  • area/docker: Docker use across MLflow’s components, such as MLflow Projects and MLflow Models
  • area/sqlalchemy: Use of SQLAlchemy in the Tracking Service or Model Registry
  • area/windows: Windows support

Screen Shot 2022-03-23 at 12 08 46

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:1
  • Comments:9 (5 by maintainers)

github_iconTop GitHub Comments

2reactions
dbczumarcommented, Mar 24, 2022

@Rusteam thank you for filing this, and, @tahesse, thank you for responding. We have merged https://github.com/mlflow/mlflow/pull/5187 to address this issue. Thank you for using MLflow!

0reactions
dbczumarcommented, Dec 20, 2022

That’s what I was gonna do. In that case it wouldn’t be handled by FileStore and SQLAlchemyStore, would it?

Hi @Rusteam , apologies for the delay. MlflowClient.create_run() now accepts the run_name argument: https://github.com/mlflow/mlflow/blob/37f4bbe69e975a505a0b61bc7509bad3f784efdf/mlflow/tracking/client.py#L224. Thank you for using MLflow!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Pipelines - Create Run - REST API (Azure Data Factory)
Parameters of the pipeline run. These parameters will be used only if the runId is not specified. Responses. Name, Type, Description.
Read more >
Create, run, and manage Databricks Jobs
Learn how to create, run, schedule, and manage workflows in the Databricks Jobs UI. ... Replace Add a name for your job… with...
Read more >
MLflow Tracking — MLflow 2.0.1 documentation
The MLflow Tracking component is an API and UI for logging parameters, ... set within mlflow.start_run() , a unique run name will be...
Read more >
docker create - Docker Documentation
For example uses of this command, refer to the examples section below. Options . Name, shorthand, Default, Description. --add-host, Add a custom...
Read more >
PyCharm - Run/Debug Configuration: Flask Server - JetBrains
Use this dialog to create run/debug configuration for Flask server and ... This value will be put into the FLASK_APP variable during the...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found