join/merge problems

I’m trying to merge 2 kdf that actually are subsets of the same kdf. The main kdf contains all the log events of the all transport_order_number : E.g.,: transport_order_number== 696530708053

kdf=ks.DataFrame({'transport_order_number': {11059585: ('696530708053'),  36538499: '696530708053',  41914814: '696530708053',  58878846: '696530708053',  83502171: '696530708053',  87335732: '696530708053',  89651819: '696530708053'},
 'event_description': {11059585: 'PIEZA EN RUTA AL DESTINATARIO',  36538499: 'TRANSFERENCIA RUTA (OTBCS)',  41914814: 'RECEPCION TRANS. PIEZA',  58878846: 'RETIRO DESDE PDT',  83502171: 'RECEPCION TRANS. CONT.',  87335732: 'RECEPCIONADA',  89651819: 'PIEZA ENTREGADA A DESTINATARIO'},
 'event_date': {11059585: ('2020-12-15 09:05:12.743000'),  36538499: ('2020-12-15 06:42:22.477000'),  41914814: ('2020-12-15 06:42:34.083000'),  58878846: ('2020-12-14 13:41:00'),  83502171: ('2020-12-15 06:42:00'),  87335732: ('2020-12-14 14:41:00'),
  89651819: ('2020-12-15 12:53:00')}})

so I made two subset using ks.loc[] to get just the ‘RECEPCIONADA’ AND 'RETIRO DESDE PDT ’ events with:

recepcion=kdf.loc[kdf['event_description']=='RECEPCIONADA']

retiro=kdf.loc[kdf['event_description']=='RETIRO DESDE PDT']

Then when I try to marge this 2 subset (recepcion & retiro) using ‘how=outer’ I got only NaN values …

ks.merge(fecha_recepcion, fecha_retiro, on='transport_order_number', how='outer', suffixes=('_recepcion','_retiro'))

Using Pandas I got the expected results

Pandas DF:

pd.merge(kdf1, kdf2, on='transport_order_number', how='outer')

[ueshin]

@FJLD The fix has been merged. It will be available in the next release. Thanks again for the report!

[ueshin]

Ah, I see what you mean! Yeah, that’s right, it’s weird… Let us investigate it. Thanks for the report!