How to Increase Upload Speed
For backup duties, the data transmission speed is a key performance indicator. CloudBerry Backup provides users with efficient data transmission tools but in some cases backup processes can be slowed down. This article guides you through backup speed slowdown issues and the measures that help to avoid them.
Anti-virus Software and Firewall
Most Windows users (less relevant for macOS users) use firewall and anti-virus software. In some cases, firewalls and anti-virus applications can cause data transmission slowdown by limiting bandwidth and preventing long-time data transfers. At first step, check if Cloudberry Backup is whitelisted in your firewall and anti-virus software:
Backup Settings Fine-Tuning
CloudBerry Backup splits files into 10 MB chunks by default to upload it to storage. The chunk size is adjustable. The overall backup performance can be improved by adjusting chunk size with an approach as it is equal to the file size, as it is shown in the diagram below.
In fact, this is a heuristic value as chunk size (or N x chunk) must fit approximately 70% of files. Thus, in backup there will not be many chunks of small sizes, i.e. 21.5 MB cannot be split efficiently to 7 MB chunks.
For example, if the median size of a single file of your backup plan is 17 MB, you should adjust chunk size to 18 MB to optimize the process. However, consider recommendations of point 2.
For backup plans that contain files of smaller sizes, small chunks are recommended; for greater files big chunks. are recommended, respectively.
Mind that the RAM consumption may grow significantly in accordance with the formula below: RAM consumed = 2 x thread count x chunk size
The principles of network connection are also a thing to consider.
For a Gigabit connection, 10 MB chunk size could be too small (provided it is not set because the files are very small), so it is recommended to set it 120 MB or alike.
If you are using a modem connection (satellite or cellular), then the minimum chunk size of 5 MB is recommended.
Note that your host connection bandwidth is likely to be used by multiple processes on multiple machines. So, instead of theoretically possible bandwidth, it is reasonable to use the expected available bandwidth for upload speed estimation.
CloudBerry Backup uploads data to the cloud storage in multiple parallel upload threads (in case if a storage supports multiple thread uploading)
It is important to adjust thread number to use network bandwidth and CPU in a most effective way: too many threads may create a significant load for both network and CPU and decrease overall performance. Too few threads will reduce the uploading speed respectively.
If a network connection is not stable, smaller chunks and smaller thread count work better. For small files backups, bigger thread number and smaller chunks will be more efficient. For big files and middle-sized files, it is recommended to use the default number of threads (6 in Backup for Windows, 5 in Backup for Linux and Mac) and chunk size adjusted as described in the paragraph above.
Mind Your Backup Contents
For improving overall performance it is reasonable to exclude files of smaller importance from your backup plan (or include important files only). Use backup filters to manage your backup content.
On different OS it may differ, but not significantly. See the example of using file filters for macOS GUI on the figure below.
One more option is splitting the whole dataset to several backup plans.
For example, images and videos do not change frequently, so they can be backed up on a monthly basis.
On the contrary, MS Office documents may change several times a day, so they can be scheduled for a daily backup plan [ *doc; *docx ] files.
In addition, you might never want to backup any temporary files. Thus, exclude (or don't include) all [ *tmp; *temp; ~*; *.bak ] files from all plans.