Failing to parse timestamp values without milliseconds

There is a bug in the parsing of timestamp values without milliseconds while using select

E.g. the value [2016-02-03T08:16:26.389] is successfully parsed, but the next value [2016-02-03T08:19] fails:

Failed with exception java.io.IOException:org.elasticsearch.hadoop.rest.EsHadoopParsingException: Cannot parse value [2016-02-03T08:19] for field [receivedTimestamp]

The error is consistent across different timestamp fields.

Using elasticsearch-hadoop-hive-2.2.0.jar

[bitsondatadev]

For a more concrete example.

#assuming you have a string field called customer and a date field called createdAt in elasticsearch

hive> DROP TABLE IF EXISTS my_table;

hive> CREATE EXTERNAL TABLE my_table (id string, customer string, createdat string)
STORED BY 'org.elasticsearch.hadoop.hive.EsStorageHandler'
TBLPROPERTIES (
    'es.resource' = 'my_table_es_index',
    'es.nodes' = 'es_url:9200',
    'es.read.metadata' = 'true',
    'es.mapping.names' = 'id:_metadata._id,customer:customer,createdat:createdAt',
    'es.mapping.date.rich' = 'false'
);

#print date as string
hive> select id, createdat, customer from my_table limit 10;

#convert the string described above to long (this type of logic can better reside inside a UDF)
hive> select id, unix_timestamp(createdat, "yyyy-MM-dd'T'HH:mm"), customer from my_table limit 10;

[wangxuegang1214]

‘es.mapping.date.rich’=‘false’