multithreaded parallel rsync

find -type d | xargs -I '{}' -P 10 -n1 rsync -a --no-r remote:path/'{}'/ '{}'/

rsync args:
--no-r No recursive

xargs args:
-P 10 Run up to 10 processes at a time.
-n 1 Use 1 argument per command line.

User tags

soa firefox idmapd ddos AMD HDFS security erase tftp rkhunter in-addr.arpa rpm source taskset freedos SpamAssassin regex quagga backup HTTPS language bonding Salt sysctl.conf perlbrew RT pvmove chromium xhost ubuntu fio PXE .htaccess exim4 routing virtualbox raid SSD arch top 3Ware mkfs docker-compose youtube nvidia pacemaker dhcp ardour performance lstat dpkg gtk ansible vrrp newgrp arp iSCSI xen route wordpress nginx opcontrol docker glusterfs vrrpd ip Adaptec java OpenSSL bscan wget leap second graylog2 chroot bash profiling cpu usage kernel ha shorewall lts netfilter opreport groups conntrack proxy ssh gpg perl MODx mount cluster tiger arping tun cgroups nfs4 tzdata initrd lenny debootstrap fail2ban shellshock cpanm tin munin flash ps cpu search sg hdparm corosync deb mariadb virsh tool scsi iowait ulimit alsa dhclient oprofile asoundrc qcow2 xfs debian dstat CPAN MegaRAID storage numa raid5 iptables lxc LSI X forwarding Areca build Swift puppet usb LVM tar squeeze backtrace radeon PTR ipmi pulseaudio iostat keyboard sysctl centos 7 slab alien OpenStack sublime sysfs rtl8723be grub bind zRam sysresccd dns NFS git exim equalizer sftp limit_conn boot su iops hotplug encrypt rsync elliptics pam sysrq apache KVM etch fido7 gdb drupal gre vim vtysh SYN SuperMicro mysql php cache lubuntu replication find bridge glxinfo bug noop dovecot rtsp StorMan openvpn ipmitool APU qemu video apt htop cfq DRBD swap CentOS parallel vlan mdadm core dump jackd virt-install xargs /etc/network/interfaces bacula