Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[SUPPORT] Flink Date type as partition field

See original GitHub issue

flink sql can’t use date as partition field

create TABLE hudi_sink(
    role_id string,
    log_id string,
    origin_json string,
    origin_log string,
    ts timestamp(3),
    ds date
 )PARTITIONED BY (ds)
 with (
   'connector' = 'hudi'
    ...

throw org.apache.hudi.exception.HoodieNotSupportedException: Unexpected type for partition field: java.time.LocalDate

Issue Analytics

State:
Created a year ago
Comments:5 (5 by maintainers)

Top GitHub Comments

1reaction

danny0405commented, Apr 27, 2022

Already created a PR here: https://github.com/apache/hudi/pull/5432

0reactions

YuangZhangcommented, Apr 28, 2022

@YuangZhang could you provide the steps with the environment for reproducing the issue, e.g., which Hudi and Flink versions are used, which file system is used for the target Hudi table, etc.?

hudi version 0.11.0 build from release-0.11.0 flink version 1.13.5 the file system is hdfs

Top Results From Across the Web

FLIP-63: Rework table partition support

date is the reference of DDL defined fields; partition values need to be saved in real data because they support rich partitioning criteria....

System (Built-in) Functions | Apache Flink

Converts date time string string1 with format string2 (by default: 'yyyy-MM-dd HH:mm:ss') under the session time zone (specified by TableConfig) to a timestamp....

FileSystem | Apache Flink

Flink's file system partition support uses the standard hive format. However, it does not require partitions to be pre-registered with a table catalog....

[DISCUSS] Introduce partitioning strategies to Table/SQL ...

So I think it is better to introduce partitioning strategies to Flink, ... Composite Partitioning Tables: CREATE TABLE fs_table ( name STRING, date:...

CREATE Statements | Apache Flink

Flink SQL supports the following CREATE statements for now: CREATE TABLE ... They define the names, the types, and the order of fields...