question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

String to int conversion issue when config is loaded into the Dagit Launchpad

See original GitHub issue

Issue from the Dagster Slack

This issue was generated from the slack conversation at: https://dagster.slack.com/archives/C01U954MEER/p1653825757813719?thread_ts=1653825757.813719&cid=C01U954MEER


Conversation excerpt

U02PY9R25PT: Hey - we ran into one of the weirdest bugs I’ve seen in PyYAML (https://github.com/yaml/pyyaml/issues/98) as part of Dagster run config. We have a resource with a field configured to be a string (using str annotation or a Field(String) as well), and a string value starting with zero. When running Dagit, the string is being converted to integer. For example, using value “0345” lead to: Invalid scalar at path root:resources:x. Value "345" of type "&lt;class 'int'&gt;" is not valid for expected type "String". Thanks U01J51Y6B9D: hi <@U02PY9R25PT>, thanks for the report! Just to nail down exactly what’s happening, where is your run config originally defined in this case? Do you have a dictionary in your python code which is then being modified in the Launchpad view in Dagit, or is the config being defined directly/entirely in Dagit? U02PY9R25PT: Hi <@U01J51Y6B9D>, thanks for the response. We have a Python dict , related to a resource (with config schema definition as part of the resource) appropriately loaded into the job config (as part of the JobDefinition). Scheduling that job works great without any issues. When we’re going to Dagit and clicking on the job’s run launcher tab, it’s being converted to YAML in the background (I suppose), and then we get the error I wrote about. U01J51Y6B9D: <@U018K0G2Y85> issue String to int conversion issue when config is loaded into the Dagit Launchpad U018K0G2Y85: Created issue at: https://github.com/dagster-io/dagster/issues/8122


Message from the maintainers:

Do you care about this too? Give it a 👍. We factor engagement into prioritization.

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:6
  • Comments:6 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
alangenfeldcommented, May 31, 2022

related https://github.com/dagster-io/dagster/issues/5962

i believe we need to switch over to just sending the yaml str instead of converting to json

0reactions
gibsondancommented, Jun 28, 2022

Should now be fixed for real with https://github.com/dagster-io/dagster/pull/8621

Read more comments on GitHub >

github_iconTop Results From Across the Web

1.1.7 (core) / 0.17.7 (libraries) - Dagster Docs
Fixed an issue where Dagster failed to load a dagster.yaml file that ... To enable these log views in dagit, navigate to the...
Read more >
Knime - String to Number - YouTube
In this video we will convert a string type column to a number type column in the Knime Analytics Platform. In the video...
Read more >
How can I convert a string to either int or float with priority on int?
I had to make an automatic config file parser and I preferred to make numbers int if possible and float if not. The...
Read more >
Conversion Functions | Alteryx Help
Use a conversion function to convert numbers to strings or strings to numbers. Conversion functions can be used with String and Number data ......
Read more >
Schema changes from double to integer all the time.
For the time being, I've converted the field to string and concatenated required number of values (omitting .0 ) in the python recipe...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found