Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Support timestamp and date feature types

See original GitHub issue

add a date type
detect dates, ie allenai/c4 -> timestamp , curiosity_dialogs

Issue Analytics

State:
Created 2 years ago
Comments:9 (1 by maintainers)

Top GitHub Comments

1reaction

mariosaskocommented, Jan 5, 2022

As of recently, datasets supports the PyArrow Timestamp type (yields datetime.datetime objects in Python), so I plan to update the existing datasets with the new type. I’ll let you know once it’s done.

0reactions

severocommented, Sep 20, 2022

Currently, we miss the following list of dtype when _type == Value:

time32[(s|ms)]
time64[(us|ns)]
date32
date64
duration[(s|ms|us|ns)]
decimal128(precision, scale)
decimal256(precision, scale)
binary
large_binary
large_string

See https://github.com/huggingface/datasets-server/blob/main/services/worker/tests/test_features.py

Top Results From Across the Web

Date & Time Data Types

This topic describes the data types supported in Snowflake for managing dates, times, and timestamps (combined date + time). It also describes the...

11.2.2 The DATE, DATETIME, and TIMESTAMP Types

The DATE , DATETIME , and TIMESTAMP types are related. This section describes their characteristics, how they are similar, and how they differ....

Date, time, and timestamp data types - Db2

A timestamp is a seven-part value representing a date and time by year, month, day, hour, minute, second, and microsecond, in the range...

Timestamps, Time Zones, Time Ranges, and Date Formats

We support several options for timestamps, time zones, time ranges, and dates. When collecting log data, the timestamp attached to messages is vital,...

Date and time data types (DATE, TIME, and TIMESTAMP)

Use datetime data types to specify data of date and time at a time zone, DATE for a specific date, TIME for time...