Avoid creating Configuration copies in Hudi

We observed that creating Configuration copies is consuming a lot of CPU.

We made changes in Presto to use a wrapper instead of creating configuration copies. But we were told that the presto change is breaking Hudi.

So one suggestion is to avoid creating copies in places like this: https://github.com/apache/hudi/blob/master/hudi-common/src/main/java/org/apache/hudi/common/config/SerializableConfiguration.java#L37

we can instead simply do

  public SerializableConfiguration(Configuration configuration) {
    this.configuration = configuration;
  }

The breaking Presto PR: https://github.com/prestodb/presto/pull/18115 https://github.com/prestodb/presto/issues/17736

@pratyakshsharma @7c00 do you think the code suggestion above makes sense ?

[pratyakshsharma]

@codope Let us connect sometime next week to discuss this. This has been pending for some time.

[codope]

Synced up with @pratyakshsharma regarding this issue. First of all, the issue affects hudi tables queries via presto-hive connector. We need to see if we can use the config provided by the engine itself while instantiating the meta client. Created HUDI-4974 to track that issue. For now, we have a mitigation. We will unwrap the wrapper config object and pass that.

Closing the issue as it has been triaged and we have an interim solution.