question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Hydrator closes suddenly with no errors

See original GitHub issue

I am Hydrating GeoCoV19 dataset which corresponds to May the 1st. Hydrator was working fine till it stopped hydrating and suddenly closed with no error messages.

Reopening the program and clicking Start would trigger the same behaviour: it simply shuts down with no explanations.

I checked the ids around where it stopped and they are legit, without any overflow. I restarted the machine as well to no avail. The jsonl file as of now is ~21GB in size.

Total Tweet Ids:
7,298,409

Tweet Ids Read:
4,485,700

Tweets Hydrated:
3,760,528

Percent Deleted:
16%

Any ideas on what I can do?

Issue Analytics

  • State:open
  • Created 3 years ago
  • Comments:21 (9 by maintainers)

github_iconTop GitHub Comments

2reactions
edsucommented, Feb 27, 2021

Many thanks for debugging this @Tipphead!I will leave this open until i figure out the serialization issue

1reaction
shullawcommented, Feb 27, 2021

Update: Windows host, Windows VMs, and Ubuntu VMs are all running fine. The /Twitter/to/trump path was the issue. There must have been a point where either Twitter was being escaped by being the //shared folder or by me not realizing the shared folder did not begin with a T.

I just want to point out that when Hydrator runs on Linux, it will actually catch the issue and notify you where Windows will just shut down. Also, on Linux hydrator automatically converts to .jsonl where Windows goes to .txt. That’s fine as I prefer working with .txt. Another bug I’ve found is that on Linux, Hydrator has no icon in the task bar (not big deal just letting you know). Again, thanks for the program!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Unrecoverable errors. - QuickBooks - Intuit
Go to the File menu, then select Close Company/Logoff. ... Suddenly no more Blue screen of death. ... Close QuickBooks.
Read more >
Programs randomly freeze-crashing with no errors in Windows ...
For a 3 second period the program will freeze or stop responding and then suddenly disappear (close). No error messages to dig through....
Read more >
react-hydration-error - Next.js
The first render is called Hydration which is a feature of React. This can cause the React tree to be out of sync...
Read more >
How to Upgrade to React 18
ReactDOM.render is no longer supported in React 18. ... Stricter hydration errors: Hydration mismatches due to missing or extra text content ...
Read more >
Node.js server crashing without error message - Stack Overflow
In addition to logging uncaught exceptions to find the cause of the crash, you may check to see if the process is running...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found