Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Create `cron` utility extension

See original GitHub issue

Migrated from GitLab: https://gitlab.com/meltano/meltano/-/issues/3522

Originally created by @alxthm on 2022-05-24 14:54:47

For simple meltano deployments, it would be great to have a cron-based orchestrator using the meltano schedule configuration, without having to set-up an Airflow instance with a db, users, etc.

The meltano UI already makes it possible to manually run meltano schedules, so this would be a nice complement 😄

Issue Analytics

State:
Created a year ago
Comments:19 (13 by maintainers)

Top GitHub Comments

4reactions

alxthmcommented, Jun 29, 2022

Based on your input, I made a small python script to transform meltano schedules (both job and elt schedule, in json format) into a crontab file: https://gist.github.com/alxthm/b62eceb1e47f0320e5bd82a67f33e042

I am currently using it this way:

meltano schedule list --format=json | python make_crontab.py >crontab.file
crontab crontab.file

It relies on a CRONTAB_MELTANO_EXECUTABLE environment variable to specify the path to meltano (in case it is not in the crontab PATH).

Happy if it can help (and open to feedback if you have any ofc).

1reaction

aaronsteerscommented, Sep 16, 2022

The license for the repository is currently MIT. Is that suitable, or should it be Apache-2.0 instead?

I’ll defer to @aaronsteers for that but fwiw - i think most of the other repo’s are Apache licensed.

@WillDaSilva and @pandemicsyn - Just circling back here to confirm the above. MIT and Apache 2.0 are both okay. Apache 2.0 is indeed preferred.

Top Results From Across the Web

11.6 Configuring the cron Utility

The cron utility runs in the background and constantly checks the /etc/crontab file. The cron utility also checks the /var/cron/tabs directory, in search...

How To Add Jobs To cron Under Linux or UNIX

You need to use the crontab command to edit/create, install, deinstall or list the cron jobs in Vixie Cron. Each user can have...

How to Set Up Cron Jobs in Linux

Learn how to set up and schedule cron jobs to automate repetitive tasks in Linux. Learn the cron job syntax and crond daemon....

Use the Crontab Utility to Schedule Tasks on Oracle Linux

Create or edit your crontab · You can jump to the bottom of the file by pressing 'Shift-g'. · Hit the 'i' key...

Cron Job: A Comprehensive Guide for Beginners 2023

Cron is a utility program that lets users input commands for scheduling tasks repeatedly at a specific time. Tasks scheduled in cron are...