Date formatting issue in WHERE clause

Noticed that date transformation/formatting fails in WHERE clause though it works fine when used in SELECT. My dataset timestamp is of the following format: 2020-10-01T14:00:00.000Z.

The following works:

SELECT
  dateTimeConvert("timestamp", '1:HOURS:SIMPLE_DATE_FORMAT:yyyy-MM-dd''T''HH:mm:ss.SSS''Z''', '1:HOURS:SIMPLE_DATE_FORMAT:yyyy-MM-dd', '1:HOURS')
FROM myTable

But same expression fails if moved to WHERE:

SELECT
  * 
FROM myTable
WHERE
  dateTimeConvert("timestamp", '1:HOURS:SIMPLE_DATE_FORMAT:yyyy-MM-dd''T''HH:mm:ss.SSS''Z''', '1:HOURS:SIMPLE_DATE_FORMAT:yyyy-MM-dd', '1:HOURS') = '2020-10-01'

This is likely related with handling single quotes in SIMPLE_DATE_FORMAT:yyyy-MM-dd''T''HH:mm:ss.SSS''Z''

[Jackie-Jiang]

Find the issue and here is the fix: https://github.com/apache/incubator-pinot/pull/6416

[xiangfu0]

hmm, I’ve seen this issue on another table with the datetime field event_time as well.