Support a more fine-grained datediff function in Impala (once it exists)
See original GitHub issueImpala does not yet support a proper date difference (e.g. milliseconds between or nanoseconds between). While nanoseconds-between can yield int64 overflows on historical dates (pandas supports a little under 500 years range due to using nanosecond resolution), this is still decently useful.
Note that Impala’s datediff
function is the only real “timedelta” function, but it only computes days between, which isn’t that useful in general.
Issue Analytics
- State:
- Created 8 years ago
- Comments:6 (4 by maintainers)
Top Results From Across the Web
Impala Date and Time Functions
Impala supports the following date and time functions: ADD_MONTHS; ADDDATE; CURRENT_DATE; CURRENT_TIMESTAMP; DATE_ADD; DATE_PART; DATE_SUB; DATE_TRUNC; DATEDIFF ...
Read more >Impala Date and Time Functions | 6.3.x
Impala supports the following data and time functions: ADD_MONTHS · ADDDATE · CURRENT_TIMESTAMP · DATE_ADD · DATE_PART · DATE_SUB · DATE_TRUNC · DATEDIFF...
Read more >Difference in days between two dates in Impala
I am trying to find a date difference In Impala. ... I know that there is no datediff function on Impala and I've...
Read more >Apache Impala (incubating) Guide
Because the statestore's purpose is to help when things go wrong, it is not critical to the normal operation of an Impala cluster....
Read more >Cloudera Impala | PDF | Trademark | License
Because the statestore's purpose is to help when things go wrong, it is not critical to the normal operation of an Impala cluster....
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
I would test against a current install of impala. Best to verify what the current behavior is.
A less precise version should be possible by casting both timestamps to int64 and then compute the difference. This will return a delta in seconds if memory serves.
This is still in units of days as of 2021: https://impala.apache.org/docs/build/html/topics/impala_datetime_functions.html#datetime_functions__datediff