question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Storage Initializer Azure Fileshare download tgz RuntimeError ContentType check

See original GitHub issue

/kind bug

What steps did you take and what happened: Downloading a model from Azure Fileshare URI with a SAS results in RuntimeError due to a mismatch in ContentType. On previous versions this would succeed as there were no ContentType checks.

  • URI example: https://<STORAGE_ACCOUNT>.file.core.windows.net/path/to/file.tgz?<SAS_TOKEN>
  • Detected mimetype: 'application/x-tar'
  • Detected encoding: 'gzip'
  • Response ContentType: 'application/octet-stream'

This is a clear violation of the checks that were added. I wonder if it’s better to add an exception when the URI contains file.core.windows.net or if there is another solution. For me to deploy I could try to just skip the checks and build a new image but it isn’t ideal.

What did you expect to happen: Expected the model to be downloaded and extracted from the archive.

Environment: Tested the download locally on master branch.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:5 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
laozccommented, Jan 10, 2022

I believe there are a few endpoints for Azure storage accounts in different Azure clouds which we might need to add those as well. I can work on this.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Storage Initializer Azure Fileshare download tgz RuntimeError ...
What steps did you take and what happened: Downloading a model from Azure Fileshare URI with a SAS results in RuntimeError due to...
Read more >
Archived (.tgz) files aren't downloading properly from blob #4558
Description I archived my data (.tgz) on server-1, and uploaded to the container as blob. $ az storage blob upload -f file_name.tgz -c ......
Read more >
Troubleshoot Azure Files problems in Linux (SMB)
Solution for cause 2. Browse to the storage account where the Azure file share is located, click Access control (IAM) and verify your...
Read more >
Use the Azure Storage Emulator for development and testing ...
The Microsoft Azure Storage Emulator is a tool that emulates the Azure Blob, Queue, and Table services for local development purposes.
Read more >
Troubleshoot Azure Files problems in Windows (SMB)
Connect from a virtual machine (VM) in the same datacenter as the Azure storage account that is used for the Azure file share....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found