question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Generated files for same chunk differ in binary

See original GitHub issue

After running the testdata profile twice, I noticed that the same file for the same chunk differs on byte level, although the file size is identical. This should not happen, as it will cause problems on CDN.

For the index file, it looks like missing sorting is causing the problem, one example:

[23,18,21,22,19,20]

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
UnchartedBullcommented, May 30, 2020

Managed to convince the ZIP Library to create byte-identical archives. The payload signing creates different bytes for the same chunk each time though. Having the signing algorithm create the same bytes for the same chunk would be a security risk, so we can’t create byte-identical archives for the same chunk.

1reaction
christian-kirschnickcommented, May 22, 2020

Since the generation code has changed a lot & Timon and me are working on https://github.com/corona-warn-app/cwa-server/issues/203, we will have an eye on this as well. I will reopen this, in case https://github.com/corona-warn-app/cwa-server/issues/203 will not fix it.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Read binary file chunk by chunk in C - Stack Overflow
How can I read file in chunks and overwrite its data? In the first place, if you want to both read and write...
Read more >
How do I compare binary files in Linux? - diff - Super User
I wrote a simple script to diff a binary file. It will print the first different chunk (40 bytes) ...
Read more >
Reading A Binary File By Chunks - Charlotte-NGS
In an earlier posts I showed some functions to work with symmetric matrices that are read from binary files using R's readBin() function....
Read more >
What is a binary file and how does it work? - TechTarget
Electronic files are typically categorized as either binary files or text files. It could be argued that text files are also a type...
Read more >
File Chunk Store #556 - zarr-developers/zarr-python - GitHub
The file chunk store translates array chunk keys into file seek and read operations and therefore only provides read access to the chunk...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found