question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Stream-GlobalTable left join not working as expected

See original GitHub issue

Description

Performing a Stream-GlobalTable left join does not pickup matching keys. Right side values (from table) are always empty/null. The same logic implemented in Java with Streams API works correctly and picks up the matching keys correctly.

How to reproduce

Topic 1 : JoinSample-1 Messages --> Key:Value 100:tableValue-1 200:tableValue-2 300:tableValue-3

Topic 2 : JoinSample-2 Messages --> Key:Value 100:streamValue-4 300:streamValue-3 50:streamValue-8 500:streamValue-2 600:streamValue-1 700:streamValue-5 800:streamValue-6 900:streamValue-7

EXPECTED JoinedEvent Messages --> Key:Value 100:streamValue-4joinedWithtableValue-1 300:streamValue-3joinedWithtableValue-3 50:streamValue-8joinedWith 500:streamValue-2joinedWith 600:streamValue-1joinedWith 700:streamValue-5joinedWith 800:streamValue-6joinedWith 900:streamValue-7joinedWith

ACTUAL JoinedEvent Messages (fails to pickup values for Key 100 and 300 from Table topic) --> Key:Value 100:streamValue-4joinedWith 300:streamValue-3joinedWith 50:streamValue-8joinedWith 500:streamValue-2joinedWith 600:streamValue-1joinedWith 700:streamValue-5joinedWith 800:streamValue-6joinedWith 900:streamValue-7joinedWith

Checklist

Please provide the following information:

  • A complete (i.e. we can run it), minimal program demonstrating the problem. No need to supply a project file. - code attached
  • A code snippet with your topology builder (ex: builder.Stream<string, string>(“topic”).to(“an-another-topic”)😉 - see attached code
  • Streamiz.Kafka.Net nuget version. - 1.3.0
  • Apache Kafka version. - 6.0.1-ce Confluent Server
  • Client configuration. -->
 var config = new StreamConfig<StringSerDes, StringSerDes>
            {
                ApplicationId = $"test-kstreams-{Guid.NewGuid()}",
                BootstrapServers = "localhost:29092",
                AutoOffsetReset = AutoOffsetReset.Earliest
            };
  • Operating system. - linux
  • Provide logs (with in debug mode (log4net and StreamConfig.Debug) as necessary in configuration). - attached file
  • Critical issue - NA Program.txt logs.txt .

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:1
  • Comments:7 (4 by maintainers)

github_iconTop GitHub Comments

2reactions
mayur-raocommented, Aug 4, 2022

Wonderful. I tested and looks like it is working as expected. Thanks for the quick fix.

2reactions
mayur-raocommented, Aug 2, 2022

Hi @LGouellec ,

Yes, I can confirm that both topics have messages before I run the streams app. Also I made sure that the timestamps for the topic I want to use as table (JoinSample-1 above) are before the topic I want to use as stream (JoinSample-2).

Read more comments on GitHub >

github_iconTop Results From Across the Web

MySQL: LEFT JOIN not working as expected
The WHERE date(attIn) like '2016-07-02%' is converting the LEFT join to an INNER join. The condition should be moved to the ON clause....
Read more >
Left Join not working as expected
You have three problems that are "undoing" the left outer join . The inner join condition will fail when sal.STY_QUAL is NULL ....
Read more >
OUTER Right Join not working as expected
OUTER Right Join not working as expected. Hi,. I have a data source that is built off of 3 tables, as shown in...
Read more >
Sql server left join strange behaviour
A left join effectively first does what an inner join would (find all the matching rows) and then adds to the result all...
Read more >
Left outer join not working as expected
Hi All,. I have below three tables with the values .The below mentioned outer join query not working and its behave like inner...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found