Hydrator closes suddenly with no errors
See original GitHub issueI am Hydrating GeoCoV19
dataset which corresponds to May the 1st. Hydrator was working fine till it stopped hydrating and suddenly closed with no error messages.
Reopening the program and clicking Start
would trigger the same behaviour: it simply shuts down with no explanations.
I checked the ids around where it stopped and they are legit, without any overflow. I restarted the machine as well to no avail. The jsonl
file as of now is ~21GB in size.
Total Tweet Ids:
7,298,409
Tweet Ids Read:
4,485,700
Tweets Hydrated:
3,760,528
Percent Deleted:
16%
Any ideas on what I can do?
Issue Analytics
- State:
- Created 3 years ago
- Comments:21 (9 by maintainers)
Top Results From Across the Web
Unrecoverable errors. - QuickBooks - Intuit
Go to the File menu, then select Close Company/Logoff. ... Suddenly no more Blue screen of death. ... Close QuickBooks.
Read more >Programs randomly freeze-crashing with no errors in Windows ...
For a 3 second period the program will freeze or stop responding and then suddenly disappear (close). No error messages to dig through....
Read more >react-hydration-error - Next.js
The first render is called Hydration which is a feature of React. This can cause the React tree to be out of sync...
Read more >How to Upgrade to React 18
ReactDOM.render is no longer supported in React 18. ... Stricter hydration errors: Hydration mismatches due to missing or extra text content ...
Read more >Node.js server crashing without error message - Stack Overflow
In addition to logging uncaught exceptions to find the cause of the crash, you may check to see if the process is running...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Many thanks for debugging this @Tipphead!I will leave this open until i figure out the serialization issue
Update: Windows host, Windows VMs, and Ubuntu VMs are all running fine. The /Twitter/to/trump path was the issue. There must have been a point where either Twitter was being escaped by being the //shared folder or by me not realizing the shared folder did not begin with a T.
I just want to point out that when Hydrator runs on Linux, it will actually catch the issue and notify you where Windows will just shut down. Also, on Linux hydrator automatically converts to .jsonl where Windows goes to .txt. That’s fine as I prefer working with .txt. Another bug I’ve found is that on Linux, Hydrator has no icon in the task bar (not big deal just letting you know). Again, thanks for the program!