question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Druid Operator is not getting host

See original GitHub issue

Apache Airflow version

Other Airflow 2 version (please specify below)

What happened

We use Airflow 2.3.3. I see that this test is successful, but I take a this error. This is the picture

File "/home/airflow/.local/lib/python3.7/site-packages/requests/sessions.py", line 792, in get_adapter
    raise InvalidSchema(f"No connection adapters were found for {url!r}")
Screen Shot 2022-10-12 at 15 34 40 Screen Shot 2022-10-12 at 15 37 27

I take dag like this Screen Shot 2022-10-13 at 12 36 25 Screen Shot 2022-10-13 at 12 37 15

Also I tried this type but I failed

ingestion_2 = SimpleHttpOperator(
    task_id='test_task',
    method='POST',
    http_conn_id=DRUID_CONN_ID,
    endpoint='/druid/indexer/v1/task',
    data=json.dumps(read_file),
    dag=dag,
    do_xcom_push=True,
    headers={
        'Content-Type': 'application/json'
    },
    response_check=lambda response: response.json()['Status'] == 200)

I get this log

[2022-10-13, 06:16:46 UTC] {http.py:143} ERROR - {"error":"Missing type id when trying to resolve subtype of [simple type, class org.apache.druid.indexing.common.task.Task]: missing type id property 'type'\n at [Source: (org.eclipse.jetty.server.HttpInputOverHTTP); line: 1, column: 1]"}

I don’t know this is bug or issue or networking problem but can we check this?

P.S - We use Airflow on Kubernetes so that we can not debug it.

What you think should happen instead

No response

How to reproduce

No response

Operating System

Kubernetes

Versions of Apache Airflow Providers

No response

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Issue Analytics

  • State:closed
  • Created a year ago
  • Comments:13 (8 by maintainers)

github_iconTop GitHub Comments

1reaction
emincanoguz11commented, Oct 21, 2022

@o-nikolas Hi Nikolas,

If you have a free time please check this PR. Thanks for your support PR Link

1reaction
o-nikolascommented, Oct 16, 2022

Sorry for removed assigment. It my fault. @o-nikolas can you give assignment to me please again

No worries, done 😃

Read more comments on GitHub >

github_iconTop Results From Across the Web

Airflow - Druid Operator is not getting host - Stack Overflow
I can't find the reference, but I recall reading about a potential bug. The workaround was to set the Airflow connection to HTTP...
Read more >
OOMKilled Druid Operator. How to add resource in examples ...
I am deploying Druid-operator on my enterprise Kube. I am getting OOM Killed error: NAME READY STATUS RESTARTS AGE ...
Read more >
Clustered deployment - Apache Druid
A query server, hosting the Druid Broker and Router processes. In production, we recommend deploying multiple Master servers and multiple Query servers in...
Read more >
Running Apache Druid in Kubernetes - Chen Riang's Blog
Before going into detail on provisioning Druid cluster in ... In this example we will be using Druid operator to install the cluster....
Read more >
OperatorHub.io | The registry for Kubernetes Operators
OperatorHub.io is a new home for the Kubernetes community to share Operators. Find an existing Operator or list your own today.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found