Academic Search results truncated?

I’m noticing that I can only get a months worth of results back from the /2/tweets/search/all endpoint. But I can get more as long as I use --end-time.

For example searching for from:barackobama yields tweets back to 2021-03-17 and then twarc stops:

twarc2 search from:barackobama --archive --flatten | jq .created_at
...
"2021-03-19T17:01:07.000Z"
"2021-03-18T13:00:08.000Z"
"2021-03-17T14:23:01.000Z"
"2021-03-17T14:23:01.000Z"
"2021-03-17T14:23:01.000Z"

But if I ask for more tweets I can get another month:

twarc2 search from:barackobama --archive --end-time 2021-03-17 --flatten | jq .created_at
...
"2021-02-19T21:04:07.000Z"
"2021-02-18T22:53:52.000Z"
"2021-02-18T19:02:40.000Z"
"2021-02-17T21:15:27.000Z"
"2021-02-15T21:13:15.000Z"

I would expect both commands to keep retrieving tweets back to barackobama’s first tweets? I don’t know if this is a problem in twarc or this is some kind of limitation of the API. Any insights would be welcome.

[edsu]

Yes, I think it’s a legit worry. But depending on your query you could max it out searching a month window too. I guess I was hoping people would get in the habit of using --limit to control how much data they get at once?

[edsu]

I learned over in the forum post that it is documented that the the start_time has this default:

https://developer.twitter.com/en/docs/twitter-api/tweets/search/api-reference/get-tweets-search-all

Unless there are objections I’m going to update twarc to default start_time to Twitter Epoch Time time (2006-03-21 00:00:00) to avoid confusion from users.