Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Please tell me how to run it with parameters.

See original GitHub issue

In order to receive a variable and run the notebook, I need to run the paper mill by passing it a variable, but there doesn’t seem to be such a setting right now.

Maybe there is another way I’m not aware of?

As far as I know, passing parameters should be like this:

import papermill as pm

   parameters = dict(alpha=0.6, ratio=0.1)

in papermill

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:1
  • Comments:11 (6 by maintainers)

github_iconTop GitHub Comments

nanaonescommented, Jun 3, 2021

Hi @nanaones, could you describe what your deployment environment currently looks like so I can setup a reproduction for the development team here? e.g. how is spark deployed? colocated in the same k8s cluster or remote? configuration in airflow via connections? etc. thanks!

Airflow is above EKS. Jupyter Hub, Livy, YARN, and Spark are installed on EMR. I installed Elyra from JupyterHub for Jupyter lab users. This is the same configuration as the notebook in EMR used by AWS. The kernel images used were created using the following guides from AWS. (However, only sparkmagic is installed in the default Python image, and the kernel is added via jupyter-kernelspec. Send a request to EMR’s LIVY endpoint via Jupyter’s sparkmagic_config.json file in AWS EMR. )

thesuperzappercommented, Feb 14, 2022

I have raised a separate issue about setting dynamic environment variables in Notebook/Script that take their values from the outputs of the upstream tasks.

Read more comments on GitHub >

github_iconTop Results From Across the Web

CS Principles: Functions with Parameters - YouTube
Start learning at Stay in touch with us ! … Show more. Show more. Featured playlist. 34 videos. Computer Science Principles: ...
Read more >
How can I run an application with arguments from Windows ...
Press Win+R , write cmd.exe /k cd desktop , hit enter, write program name and arguments. Create a shortcut or a batch file...
Read more >
Use parameters to ask for input when running a query
Specify parameter data types · With the query open in Design view, on the Design tab, in the Show/Hide group, click Parameters. ·...
Read more >
Passing arguments to "make run" - Stack Overflow
I don't know a way to do what you want exactly, but a workaround might be: run: ./prog ./prog $(ARGS). Then: make ARGS="asdf"...
Read more >
How to Use Parameters in PowerShell Part I - Simple Talk
Recently I had a client ask me to update a script in both ... I will show you how to do it in...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Post

No results found

github_iconTop Related Hashnode Post

No results found