Prepare data for network analysis: Is it possible to use network.py with twarc2 downloaded tweets?
See original GitHub issueI’ve downloaded with twarc2 a set of tweets in .jsonl
and I am now trying to create .gexf
or other network usable files (list of nodes and edges being able to select which relationship to use).
While running utils/network.py
it throws some errors, as the names of the variables (that’s my guess) are not the same with the API 2 (id
instead of id_str
, author
instead of user
…) and the script is unable to process them.
Which way do you recommend to transform the data into files usable for data analysis? Thanks!
Issue Analytics
- State:
- Created 2 years ago
- Reactions:1
- Comments:9 (5 by maintainers)
Top Results From Across the Web
DocNow/twarc-network - GitHub
Generate network visualizations from Twitter data. ... quote, retweet and mention network from a file of tweets that you've collected using twarc.
Read more >Twitter Data Collection Using Twarc - UNLV Libraries
With Twitter data you can create a network analysis, which can help increase understanding of how movements form and organize online.
Read more >Twitter Data Collection & Analysis - GitHub Pages
In this lesson, we're going to learn how to analyze and explore Twitter data with the Python/command line tool twarc. We're specifically going...
Read more >twarc-network - PyPI
Generate network visualizations for Twitter data. ... quote, retweet and mention network from a file of tweets that you've collected using twarc.
Read more >How to download and visualize your Twitter network
Using social network analysis, the Twitter API, Python, and Gephi to ... when downloading data from Twitter — you can only make a...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
I just added the minor changes of name variable and parsing noted above. See the current script: https://gist.github.com/numeroteca/aa040b0488c914d1e4a37e40117ef062
Ok I’ve released a port of the old network.py script as a twarc2 plugin. You should be able to install it with:
and then run it to generate a network as HTML D3:
More details about the various format options are available at https://github.com/docnow/twarc-network
Please ask questions about the plugin over in that issue tracker if you don’t mind too much!