Generated files for same chunk differ in binary
See original GitHub issueAfter running the testdata profile twice, I noticed that the same file for the same chunk differs on byte level, although the file size is identical. This should not happen, as it will cause problems on CDN.
For the index file, it looks like missing sorting is causing the problem, one example:
[23,18,21,22,19,20]
Issue Analytics
- State:
- Created 3 years ago
- Comments:7 (7 by maintainers)
Top Results From Across the Web
Read binary file chunk by chunk in C - Stack Overflow
How can I read file in chunks and overwrite its data? In the first place, if you want to both read and write...
Read more >How do I compare binary files in Linux? - diff - Super User
I wrote a simple script to diff a binary file. It will print the first different chunk (40 bytes) ...
Read more >Reading A Binary File By Chunks - Charlotte-NGS
In an earlier posts I showed some functions to work with symmetric matrices that are read from binary files using R's readBin() function....
Read more >What is a binary file and how does it work? - TechTarget
Electronic files are typically categorized as either binary files or text files. It could be argued that text files are also a type...
Read more >File Chunk Store #556 - zarr-developers/zarr-python - GitHub
The file chunk store translates array chunk keys into file seek and read operations and therefore only provides read access to the chunk...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Managed to convince the ZIP Library to create byte-identical archives. The payload signing creates different bytes for the same chunk each time though. Having the signing algorithm create the same bytes for the same chunk would be a security risk, so we can’t create byte-identical archives for the same chunk.
Since the generation code has changed a lot & Timon and me are working on https://github.com/corona-warn-app/cwa-server/issues/203, we will have an eye on this as well. I will reopen this, in case https://github.com/corona-warn-app/cwa-server/issues/203 will not fix it.