Support large file uploads to IPFS
See original GitHub issueOutline
Currently attempting to upload a large file to IPFS through EmbarkJS api (see uploading file in documentation) will get the browser stuck. The goal of this task is to fix the code so it can support large file uploads to decentralized systems, namely IPFS.
Acceptance Criteria
- Uploading a file larger than 1GB using
EmbarkJS.Storage.uploadFile
as specified in the documentation should not get the browser stuck and the file should be able to be downloaded afterwards.
Issue Analytics
- State:
- Created 5 years ago
- Comments:22 (2 by maintainers)
Top Results From Across the Web
Upload larger files on IPFS - YouTube
In this video, I will show you a different process to upload larger or more files on IPFS and then pin it with...
Read more >Can I upload gigantic files to IPFS? - Reddit
I think more generally, large file sharing via IPFS is very compelling (eg. leak archives, historical archives, Linux distros.).
Read more >Complete Guide on How to Upload Files to IPFS in 3 Easy Steps
Thanks to Moralis' Web3 APIs, it is possible to upload files to IPFS seamlessly. This guide demonstrates the process in three simple steps!...
Read more >How to upload a large folder by running a local IPFS node
Click on the "Files" tab in IPFS Desktop. From here you will see any files you have pinned through IPFS Desktop. To upload...
Read more >Uploading an Image to IPFS - Medium
We will use FileReader to access file data, create a browser supported buffer array, and then finally upload the image to IPFS using...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Thank you for bringing this to my attention! The example was really old, I created PR to update it: https://github.com/ipfs/js-ipfs-api/pull/884
In short, when working with bigger files you don’t want to create a Buffer from file contents (like here), instead you create a stream and pass it to ipfs-api (see example from my PR).
Hey @kziemianek you may want to try ipfs-api v25.0.0, it shipped with a fix (https://github.com/ipfs/js-ipfs-api/pull/868) that should make 1GB+ uploads possible.