Using CopyToAsync when copying stream from GetObjectAsync

Hello.

I want to follow best practices and use async when copying from the Stream to MemoryStream in the below code block, but the following will occasionally hard crash my application with the following error:

Unhandled Exception: System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request. ---> System.Net.Sockets.SocketException: The I/O operation has been aborted because of either a thread exit or an application request
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.FillAsync()
   at System.Net.Http.HttpConnection.CopyToExactLengthAsync(Stream destination, UInt64 length, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnection.ContentLengthReadStream.CompleteCopyToAsync(Task copyTask, CancellationToken cancellationToken)
   at Hyperview.Manager.AssetUtils.FileStorage.MinioService.<>c__DisplayClass3_0.<<GetImageByteArrayAsync>b__0>d.MoveNext() in C:\Projects\manager\src\AssetUtils\FileStorage\MinioService.cs:line 26
--- End of stack trace from previous location where exception was thrown ---
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
--- End of stack trace from previous location where exception was thrown ---
   at System.Threading.ThreadPoolWorkQueue.Dispatch()

Unhandled Exception: System.IO.IOException: Unable to read data from the transport connection: The I/O operation has been aborted because of either a thread exit or an application request. ---> System.Net.Sockets.SocketException: The I/O operation has been aborted because of either a thread exit or an application request
   --- End of inner exception stack trace ---
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.ThrowException(SocketError error)
   at System.Net.Sockets.Socket.AwaitableSocketAsyncEventArgs.GetResult(Int16 token)
   at System.Net.Http.HttpConnection.FillAsync()
   at System.Net.Http.HttpConnection.CopyToExactLengthAsync(Stream destination, UInt64 length, CancellationToken cancellationToken)
   at System.Net.Http.HttpConnection.ContentLengthReadStream.CompleteCopyToAsync(Task copyTask, CancellationToken cancellationToken)
   at Hyperview.Manager.AssetUtils.FileStorage.MinioService.<>c__DisplayClass3_0.<<GetImageByteArrayAsync>b__0>d.MoveNext() in C:\Projects\manager\src\AssetUtils\FileStorage\MinioService.cs:line 26
--- End of stack trace from previous location where exception was thrown ---
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
--- End of stack trace from previous location where exception was thrown ---
   at System.Threading.ThreadPoolWorkQueue.Dispatch()

My ideal solution.

try {
	await minioObjectOperationsClient.GetObjectAsync(bucketName, imageId.ToString(), async (stream) => {
			using (var responseStream = new MemoryStream()) {
				await stream.CopyToAsync(responseStream).ConfigureAwait(false);
				image = responseStream.ToArray();
			}
		}).ConfigureAwait(false);

		return image;
	} catch (Exception exception) {
		throw new Exception($"GetImageByteArrayAsync OnError. ObjectId: {imageId}, Bucket: {bucketName}", exception);
	}

What I’m doing right now.

try {
	await minioObjectOperationsClient.GetObjectAsync(bucketName, imageId.ToString(), (stream) => {
		using (var responseStream = new MemoryStream()) {
			stream.CopyTo(responseStream);
			image = responseStream.ToArray();
		}
	}).ConfigureAwait(false);

	return image;
} catch (Exception exception) {
	throw new Exception($"GetImageByteArrayAsync OnError. ObjectId: {imageId}, Bucket: {bucketName}", exception);
}

I noticed also that none of the example code used CopyToAsync and that perhaps this is required.

Please let me know how best to proceed.

Thank you.

[damikun]

Hi im geting now this error any way how to deal wit it ?

This is my API for small files works ok for bigger i get exeption with non-negative blablabla…

Its working only if i set options.AllowSynchronousIO = true; and change code from copyAsyncto to CopyTo…

[kannappanr]

@cklogs Closing this issue based on the above comment. Please feel free to reach out to us if you have further questions. You can also reach out to us at https://slack.min.io.