timedelta64[D] is always coerced to timedelta64[ns]

Hi guys, the following snippets show the issue…

xarray.DataArray([1,2,3,4]).astype('timedelta64[D]')

#output is
"""
<xarray.DataArray (dim_0: 4)>
array([ 86400000000000, 172800000000000, 259200000000000, 345600000000000], dtype='timedelta64[ns]')
Coordinates:
  * dim_0    (dim_0) int64 0 1 2 3
"""

Compare this with Pandas:

pandas.Series([1,2,3,4]).astype('timedelta64[D]')

#output is
"""
0   1 days
1   2 days
2   3 days
3   4 days
dtype: timedelta64[D]
"""

This behvaiour becomes more problematic when trying to convert from timedelta[ns] to e.g. days as ints:

xarray.DataArray(pandas.Series([1,2,3,4]).astype('timedelta64[D]')).astype(int)

#output is
"""
<xarray.DataArray (dim_0: 4)>
array([ 86400000000000, 172800000000000, 259200000000000, 345600000000000])
Coordinates:
  * dim_0    (dim_0) int64 0 1 2 3
"""

Again contrast that with pandas:

pandas.Series([1,2,3,4]).astype('timedelta64[D]').astype(int)

#output is 
"""
0    1
1    2
2    3
3    4
dtype: int64
"""

Other variations of timedelta e.g. timedelta64[s], timedelta64[W] etc suffer from the same problem.

Thanks

[hottwaj]

The pandas docs do seem to say that conversion to timedelta64[D] (or other frequencies) is possible - see: http://pandas.pydata.org/pandas-docs/stable/timedeltas.html#frequency-conversion

Also here’s a more realistic example of why this is problematic for me - I have a sequence of dates and I want to calculate the difference between them in days: possible in pandas, but not possible in xarray without first reverting to pandas/numpy types

dates = pandas.Series([datetime.date(2016, 01, 10), datetime.date(2016, 01, 20), datetime.date(2016, 01, 25)]).astype('datetime64[ns]')

dates.diff().astype('timedelta64[D]').astype(float)
#returns 
#0     NaN
#1    10.0
#2     5.0
#dtype: float6

xarray.DataArray(dates).diff(dim = 'dim_0').astype('timedelta64[D]').astype(float)
#returns
#<xarray.DataArray (dim_0: 2)>
#array([  8.64000000e+14,   4.32000000e+14])
#Coordinates:
#  * dim_0    (dim_0) int64 1 2

Again the xarray result is in ns rather than days.

Thanks

[shoyer]

df_trans['DELTA'].dt.days should work, in both pandas in xarray.