Copying between storage accounts within same instance fails

Which service (blob, file, queue, table) does this issue concern?

Blob

Which version of the Azurite was used?

3.20.1

Where do you get Azurite? (npm, DockerHub, NuGet, Visual Studio Code Extension)

DockerHub

What’s the Node.js version?

N/A

What problem was encountered?

When copying files between storage accounts within the same Azurite instance, I get an error that:

The specified blob does not exist.
RequestId:9078173b-3037-4c64-b03f-a499c852c918
Time:2022-10-26T13:59:49.995Z
Status: 404 (The specified blob does not exist.)
ErrorCode: BlobNotFound

Content:
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<Error>
  <Code>BlobNotFound</Code>
  <Message>The specified blob does not exist.
RequestId:9078173b-3037-4c64-b03f-a499c852c918
Time:2022-10-26T13:59:49.995Z</Message>
</Error>

Headers:
Server: Azurite-Blob/3.20.1
x-ms-error-code: BlobNotFound
x-ms-request-id: 9078173b-3037-4c64-b03f-a499c852c918
Date: Wed, 26 Oct 2022 13:59:49 GMT
Connection: keep-alive
Keep-Alive: REDACTED
Transfer-Encoding: chunked
Content-Type: application/xml

I expect this to work, since the support matrix specifies that Copy Blob From URL works within the same Azurite instance.

Steps to reproduce the issue?

First, start Azurite with multiple storage accounts, like:

docker run -p 10000:10000 -v c:/azurite:/workspace -e "AZURITE_ACCOUNTS=devstoreaccount1:Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;devstoreaccount2:Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==" mcr.microsoft.com/azure-storage/azurite azurite-blob -d /workspace/debug.log --blobHost 0.0.0.0

Then, create a container in each storage account, upload a non-empty file to one of them, then start a copy to the other one:

var sourceBlobServiceClient = new BlobServiceClient("DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://127.0.0.1:10000/devstoreaccount1;");
var sourceContainer = sourceBlobServiceClient.GetBlobContainerClient("test");
await sourceContainer.CreateAsync();
var sourceBlob = sourceContainer.GetBlobClient("test.txt");
await sourceBlob.UploadAsync(BinaryData.FromString("Lorem ipsum dolor sit amet..."));

var sourceBlobSasUri = sourceBlob.GenerateSasUri(BlobSasPermissions.All, DateTimeOffset.UtcNow.AddDays(1));

var destinationBlobServiceClient = new BlobServiceClient("DefaultEndpointsProtocol=http;AccountName=devstoreaccount2;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://127.0.0.1:10000/devstoreaccount2;");
var destinationContainer = destinationBlobServiceClient.GetBlobContainerClient("test");
await destinationContainer.CreateAsync();
var destinationBlob = destinationContainer.GetBlobClient("test.txt");
await destinationBlob.SyncCopyFromUriAsync(sourceBlobSasUri);

See debug.log.

Have you found a mitigation/solution?

No, other than avoiding the use of the copy function and instead downloading an uploading files.

[blueww]

@kimsey0

We already have other issues to track Put Blob From Uri like https://github.com/Azure/Azurite/issues/852 So we can close this issue when the PR #1742 is merged. And use other issue to track Put Blob from Uri.

[blueww]

@kimsey0

Look at the first log file, and I believe https://github.com/Azure/Azurite/pull/1742 can fix the 404 error of “Operation=Blob_CopyFromURL” in this log.

For “Put Blob From URL”, we currently is working on other high priority features, will consider it in the future.