Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
MinIO Java SDK is much slower compared to both `mc` and AWS S3 Java SDK
See original GitHub issueI am using Java 8 and trying to upload a 1 Gb file on a local MinIO server. Here is the amount of time it took for each of the following methods:
MinIO Java SDK: 17s
AWS Java SDK: 11s
AWS Java SDK(with Transfer Manager): 7s
mc client: 3.5s
I wonder what makes MinIO SDK slower and how can I improve the speed.
Issue Analytics
- State:
- Created a year ago
- Comments:8 (5 by maintainers)
Top Results From Across the Web
Write Performance between 'MinIO Client SDK' and 'mc' #816
I don't think native code compiled with Go is faster (or slower) than Java and I presume MC is using Minio Go Client,...
Read more >ClickHouse Object Storage Performance: MinIO vs. AWS S3
Conclusion. In conclusion, MinIO is significantly faster than AWS S3 when used to store ClickHouse table data. Using the OnTime dataset, the ...
Read more >S3 uploads from Java SDK much slower than AWS CLI
Uploading a relatively small file (15 MB) is much slower when uploading with Java SDK when compared with AWS CLI, holding everything constant: ......
Read more >Accessing MinIO with the AWS S3 SDK [GCast 97] - YouTube
The AWS S3 SDK for Java allows you to read from and write to MinIO. ... migrate an application from using S3 to...
Read more >What's different between the AWS SDK for Java 1.x and 2.x
This section describes the main changes to be aware of when converting an application from using the version 1.x to version 2.x.
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
As expected, SHA256 and MD5 checksum calculation are slow. Probably I will move away from Java built-in SHA256/MD5 hasher.
For 1GiB file upload, I see HTTP request/response takes 5 seconds and file read takes another 5 seconds.