question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[PROPOSAL] Relocate Job Scheduler into core as a native plugin

See original GitHub issue

Based on this discussion, Job Scheduler will be relocated to core as a native plugin.

Draft PR to relocate Job Scheduler to native plugins : https://github.com/opensearch-project/OpenSearch/pull/5453

As this change is currently slated for the 2.5.0 release, work has begun to prepare for and facilitate this relocation. This issue shall be used to track the associated work items and discuss any questions / concerns.

Build and Assemble Workflow Modifications Since Job Scheduler acts as a dependency for other plugins (AD, IM, Reporting), relocating this project within core as a native plugin will necessitate changes to the yml schema of the input manifest used to assemble the full distribution of OpenSearch.

Discussions for the input manifest changes has been started here .

Dependent Plugin Modifications Though moving Job Scheduler to native plugins is not necessarily a breaking change, the path to Job Scheduler snapshots will be affected. Plugins that have Job Scheduler as a dependency will require modifications to their respective build.gradles [1]. These modifications will be handled by the OpenSearch core Extensibility team (will handle the code changes and testing) and we shall tag the respective plugin owners to review our changes. Additionally, we would like some input on the right naming convention for Job Scheduler [2].

  • [1] Job Scheduler artifacts are currently uploaded to and consumed from https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/opensearch-job-scheduler/, upon relocation, these artifacts will now be uploaded to https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/plugin/opensearch-job-scheduler/
  • [2] Dependent plugins reference opensearch-job-scheduler as part of their extendedPlugins within their build.gradle, (here is Anomaly Detection’s reference for example). Upon relocation, in order to maintain native plugin naming conventions, it is our intention to rename this project as job-scheduler, which would require dependent plugins to also modify their extendedPlugins reference. However, if there are any objections to this change, please discuss this below.

Plans to support previous versions of Job Scheduler In order to support security patches to previous versions of Job Scheduler, upon relocation, the original Job Scheduler repository will not be archived.

Issue Analytics

  • State:open
  • Created 10 months ago
  • Comments:14 (12 by maintainers)

github_iconTop GitHub Comments

2reactions
praveensamenenicommented, Dec 1, 2022

LGTM

2reactions
joshpaliscommented, Nov 21, 2022

@prudhvigodithi @nknize @dblock @vibrantvarun @praveensameneni @sean-zheng-amazon @anirudha @bbarani @gaiksaya @peterzhuamazon

For the dependent plugin owners, please let us know if you have any questions / concerns regarding items [1] and [2]. We shall move forward with raising these PRs starting December 5th.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Frequently Asked Questions - Slurm Workload Manager
How can I run a job within an existing job allocation? There is an srun option --jobid that can be used to specify...
Read more >
Native plug-ins - Unity - Manual
Plug-ins allow the code you write in C# to call functions from these libraries. This feature allows Unity to integrate with middleware libraries ......
Read more >
Advanced Scheduling in Kubernetes
There are future plans to offer requiredDuringSchedulingRequiredDuringExecution which will evict pods from nodes as soon as they don't satisfy ...
Read more >
Best Practices for Migrating to a New Job Scheduler
Use the Cutover method. The Cutover method for migrating requires moving workflows one-by-one into the new scheduler. As each workflow is ...
Read more >
Migrate Azure Scheduler jobs to Azure Logic Apps
If your Azure subscription has a paid support plan, you can create a technical support request in the Azure portal. Otherwise, you can...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found