question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Persistent error when ingesting json with rest

See original GitHub issue

When I try to ingest a json file with datahub-rest I get the following error:

  File "C:\Python\lib\site-packages\datahub\entrypoints.py", line 74, in ingest
    pipeline.run()
  File "C:\Python\lib\site-packages\datahub\ingestion\run\pipeline.py", line 92, in run
    for record_envelope in extractor.get_records(wu):
  File "C:\Python\lib\site-packages\datahub\ingestion\extractor\mce_extractor.py", line 21, in get_records
    raise AttributeError("every mce must have at least one aspect")
AttributeError: every mce must have at least one aspect

The error is : every mce must have at least one aspect I’m not sure what this is pointing to. I have tried with different simple json files and always had the same result.

To Reproduce Steps to reproduce the behavior:

  1. Prepare the following yml file:
---
source:
  type: "file"
  config:
    filename: "iris.json"

sink:
  type: "datahub-rest"
  config:
    server: 'http://localhost:8080'
  1. The json file can be found here: https://www.kaggle.com/rtatman/iris-dataset-json-version
  2. Run python -m datahub ingest -c file_to_datahub_rest.yml

Desktop:

  • OS: Windows 10
  • acryl-datahub version: 0.1.3

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:11 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
iremicommented, Apr 24, 2021

Sure, I will retry and let you know. The sample data from the quickstart also ingests normally (running ./docker/ingestion/ingestion.sh)

0reactions
iremicommented, May 5, 2021

I understand now. I have some other questions but I’ll open a separate issue. Thank you for your help.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Persistent error when ingesting json with rest #2430 - GitHub
When I try to ingest a json file with datahub-rest I get the following error: File "C:\Python\lib\site-packages\datahub\entrypoints.py", ...
Read more >
HTTP status and error codes for JSON | Cloud Storage
The following document provides reference information about the status codes and error messages that are used in the Cloud Storage JSON API.
Read more >
Got Error Ingest JSON array data into Azure ... - Stack Overflow
I'm trying to ingest the Json array format from US Census API data into Azure either ASA or ADF is fine... Tried using...
Read more >
rest api - How can @HttpPost methods ingest complex JSON ...
So, the solution to this is to preprocess the JSON body before deserializing it to the custom top level class. You should not...
Read more >
Mass Ingestion Files REST API - Informatica Documentation
tasks. When you use. file ingestion. resources, note the following rules: Use JSON format. Use the following base URL: <serverUrl>/mftsaas/api/v1/<API name>.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found