Persistent error when ingesting json with rest
See original GitHub issueWhen I try to ingest a json file with datahub-rest I get the following error:
File "C:\Python\lib\site-packages\datahub\entrypoints.py", line 74, in ingest
pipeline.run()
File "C:\Python\lib\site-packages\datahub\ingestion\run\pipeline.py", line 92, in run
for record_envelope in extractor.get_records(wu):
File "C:\Python\lib\site-packages\datahub\ingestion\extractor\mce_extractor.py", line 21, in get_records
raise AttributeError("every mce must have at least one aspect")
AttributeError: every mce must have at least one aspect
The error is : every mce must have at least one aspect I’m not sure what this is pointing to. I have tried with different simple json files and always had the same result.
To Reproduce Steps to reproduce the behavior:
- Prepare the following yml file:
---
source:
type: "file"
config:
filename: "iris.json"
sink:
type: "datahub-rest"
config:
server: 'http://localhost:8080'
- The json file can be found here: https://www.kaggle.com/rtatman/iris-dataset-json-version
- Run
python -m datahub ingest -c file_to_datahub_rest.yml
Desktop:
- OS: Windows 10
- acryl-datahub version: 0.1.3
Issue Analytics
- State:
- Created 2 years ago
- Comments:11 (5 by maintainers)
Top Results From Across the Web
Persistent error when ingesting json with rest #2430 - GitHub
When I try to ingest a json file with datahub-rest I get the following error: File "C:\Python\lib\site-packages\datahub\entrypoints.py", ...
Read more >HTTP status and error codes for JSON | Cloud Storage
The following document provides reference information about the status codes and error messages that are used in the Cloud Storage JSON API.
Read more >Got Error Ingest JSON array data into Azure ... - Stack Overflow
I'm trying to ingest the Json array format from US Census API data into Azure either ASA or ADF is fine... Tried using...
Read more >rest api - How can @HttpPost methods ingest complex JSON ...
So, the solution to this is to preprocess the JSON body before deserializing it to the custom top level class. You should not...
Read more >Mass Ingestion Files REST API - Informatica Documentation
tasks. When you use. file ingestion. resources, note the following rules: Use JSON format. Use the following base URL: <serverUrl>/mftsaas/api/v1/<API name>.
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Sure, I will retry and let you know. The sample data from the quickstart also ingests normally (running ./docker/ingestion/ingestion.sh)
I understand now. I have some other questions but I’ll open a separate issue. Thank you for your help.