Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Point Radius search verification

See original GitHub issue

Hello all, I am trying to scrape tweets from London.

I make the following query:

twarc2 search --archive --limit 100 --start-time "2019-01-04" --end-time "2019-01-06" "(vegan OR vegetarian OR plant-based) point_radius:[-0.127758 51.507351 5mi]" 100VeganLondonJan2019.jsonl

Is there a way I can verify these results? When I look at the users author.location I would say about 20% seem to at least be self-defined as London or at least the UK.

The few with geolocation vary across the UK and US.

Issue Analytics

State:
Created 2 years ago
Comments:9 (4 by maintainers)

Top GitHub Comments

1reaction

SamHamescommented, Oct 19, 2021

What Igor said - I just ran your original query and got the results I think you were expecting in your question, so I’m going to close this ticket here.

If you’re using twarc-csv, note you will probably also want the --no-inline-referenced-tweets option set, otherwise you’ll get quoted/referenced tweets in the CSV that don’t match your search criteria.

1reaction

SamHamescommented, Oct 19, 2021

Can you try again with the query in your original question with the brackets?

The data you shared was collected with a different query - the brackets are critical as without them you end up with a query that implicitly is like “a OR b OR (c and d)”. The Twitter API applies the implicit AND first.

On Tue, 19 Oct 2021, 22:43 Joseph Allen, @.***> wrote:

Apologies I didn’t answer the question, what can I do to confirm that those tweets are actually from near London, since most of them contain no geo data, and only some of them even self-report a location near London in their author.location

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/DocNow/twarc/issues/557#issuecomment-946682941, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACADAUJRUQ5P73UCQOOALEDUHVRVJANCNFSM5GIRGWTA . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.