startOffset not honored by KStream/KTable creation

With auto.offset.reset (globally) set to “latest” and startOffset set to “earliest” for a specific KTable/KSteam:

spring.cloud.stream.kafka.streams.binder.auto.offset.reset: latest

spring.cloud.stream.kafka.streams.bindings.configInput:
  consumer:
    materializedAs: configState
    keySerde: org.apache.kafka.common.serialization.Serdes$StringSerde
    valueSerde: org.apache.kafka.common.serialization.Serdes$StringSerde
    startOffset: earliest

when the table/stream is created, only the global setting (“latest”) seems to take effect. i.e. The very first time this application comes up, only the latest offsets are processed.

I was able to confirm that extendedConsumerProperties is correctly populated with startOffset=“earliest” here. However, it does not seem to be propagated down to the table/stream creation.

If I change this to include a Consumed object with a hard-coded “earliest”
 then the KTable does behave as expected and consume from the earliest offset on the first start of the application.

        private <K,V> KTable<K,V> materializedAs(StreamsBuilder streamsBuilder, String destination, String storeName, Serde<K> k, Serde<V> v) {
                return streamsBuilder.table(bindingServiceProperties.getBindingDestination(destination),
                                Consumed.with(k, v).withOffsetResetPolicy(Topology.AutoOffsetReset.EARLIEST),
                                Materialized.<K, V, KeyValueStore<Bytes, byte[]>>as(storeName)
                                                .withKeySerde(k)
                                                .withValueSerde(v));
        }

Is this expected?

Thanks, Alex

[amleung21]

@sobychacko And yes, we wanted to set the global setting to latest for one topic (our “data” topic) and have another topic (our “configuration” topic) be overridden to earliest.

[amleung21]

@sobychacko My mistake, that was a typo. spring.cloud.stream.kafka.streams.binder.configuration.auto.offset.reset was indeed used for the global setting.