Invalid parquet type: DECIMAL
See original GitHub issueWhen using await parquet.ParquetReader.openFile("so.parquet");
i get the error invalid parquet type: DECIMAL
since it is not included in PARQUET_LOGICAL_TYPES.
It is listed as one of the logical types here: https://github.com/apache/parquet-format/blob/master/LogicalTypes.md
Any chance it will be added soon?
Issue Analytics
- State:
- Created 4 years ago
- Reactions:21
- Comments:7
Top Results From Across the Web
Incorrect decimal data when parquet file is processed with ...
When processing decimal data with ADLS Gen2 connector in Parquet format, the value loaded is incorrect. ... 1) For Solution, enter CR with...
Read more >Issue while reading a parquet file with different data types like ...
one thing I noticed when I ran the same code with pandas dataframe it worked perfectly means the decimal columns are consider as...
Read more >Data type issue for decimal fields in parquet files between ...
I am generating parquet files using Data Flow in ADF. The files have some fields with decimal data types.
Read more >Parquet Decimal Datatype Returning an Error in Impala
We are having an issue reading tables in Impala with datatype Decimal (1,1). The error is: column 'DECIMAL_1_1' has an invalid type length....
Read more >[#IMPALA-7087] Impala is unable to read Parquet decimal ...
ERROR: File '/hdfs/path/000000_0_x_2' column 'alterd_decimal' has an invalid type length. Expecting: 11 len in file: 8 It would be ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
There does seem to be a pull request that would fix this issue here - https://github.com/ZJONSSON/parquetjs/pull/44/files
However, this pull request is in a fork of this package
as am I