Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Lightweight python commit reader
See original GitHub issueWe are developing a simple client library in python to identify what files to read within hoodie datasets. We have two main use-cases at this point:
- Determine the latest version for every dataset file, in order to read a complete dataset as it exists at a given timestamp.
- Determine the latest version for only files that have changed since a given timestamp, in order to read changes incrementally.
At the moment, this library only reads completed commits, since it’s for a project that consumes data downstream. Another important distinction is that it does not read the files (i.e. generate a DataFrame), but instead produces a list of files for the client to use and (presumably) read in their own way. We are open to further development and suggestions.
Is this something you would be interested in including in the project? And if so, do you have any requirements or suggestions before we make a PR?
Issue Analytics
- State:
- Created 7 years ago
- Comments:6 (3 by maintainers)
Top Results From Across the Web
Top Related Medium Post
Top Related StackOverflow Question
Troubleshoot Live Code
Top Related Reddit Thread
Top Related Hackernoon Post
Top Related Tweet
Top Related Dev.to Post
Top Related Hashnode Post
Closing since we are not pursuing this anymore
did u solve @DSouzaM ?