Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
-
@netikras What do you mean? I don't need dropbox anymore. I piled files in it and now it's became sluggish. What is your potential solution? Another cloud?
-
@zemaitis You're complaining about slow performance because there are many files. So why not reduce amount of files to sync?
Make containers, like truecrypt filesystems, and store everything in them. You will have less files to sync.
Amount of data per-file (and per-change) will be larger, but if you can sync on-demand it does not really matter.
This will work perfectly if you are using cloud storage as an archive or a way to transfer data between devices, as access to files is no longer flexible. THAT is why asked you what's your use case.
Did that with a part of my dropbox storage.
I found the rig of the year.
When people find out the hard truth
I am Computer Science Student
Yesterday I asked question to my classmates, what is Linux,
here's some(non-fo...
Need an advice on syncing large amounts of small files. For starters I have 2 million of ~20-25kb sized files in dropbox. Syncing it with my local machine is a pain in the ass (API limits syncing to 4-5 files per second, so I will need at least 96 hours just to take out everything from dropbox).
Recently I started looking into self hosted cloud solutions. I fiddled around with nextcloud but it's client limits syncing to 5-6 files per second as well. Accessing nextcloud via webdav from a rclone client I was able to up the syncing speed to 15-25 files per second but that's all.
Any solutions where I should host 2mil of files and would be able to sync them fast to my own machine with some cloud client when I need it to?
question
sync
cloud