multithreaded parallel rsync

find -type d | xargs -I '{}' -P 10 -n1 rsync -a --no-r remote:path/'{}'/ '{}'/

rsync args:
--no-r No recursive

xargs args:
-P 10 Run up to 10 processes at a time.
-n 1 Use 1 argument per command line.

User tags

apt bridge fail2ban Areca elliptics nfs4 bug git CPAN mount fido7 backup newgrp cpu usage bash usb StorMan zRam vrrp sublime NFS deb netfilter qcow2 ansible storage docker-compose gdb cpu munin hotplug openvpn puppet ubuntu pacemaker xen iSCSI parallel cluster ssh tun vlan ardour jackd arping mkfs equalizer slab bonding alien tool grub ps Salt SYN HTTPS iops swap iowait LVM asoundrc cgroups route wget arch routing SpamAssassin debootstrap dovecot cpanm CentOS flash gtk perlbrew security erase pam opreport gre initrd backtrace encrypt scsi ddos Adaptec iostat quagga raid5 noop ip groups vim virsh in-addr.arpa bacula idmapd mariadb .htaccess PXE dstat dhcp soa lenny sftp APU tar build glxinfo xhost php leap second shellshock pvmove shorewall qemu source conntrack ipmi firefox proxy mysql OpenSSL SSD rpm KVM sysfs OpenStack ha nginx language java lubuntu virtualbox chroot regex freedos kernel /etc/network/interfaces youtube xargs tin video alsa oprofile apache virt-install performance exim RT exim4 tftp drupal search rsync core dump dhclient rtsp sg nvidia etch 3Ware docker htop fio lxc cfq opcontrol DRBD hdparm pulseaudio SuperMicro cache LSI numa tiger vtysh Swift sysctl.conf taskset squeeze glusterfs AMD radeon top xfs sysctl MegaRAID corosync dns iptables wordpress bind keyboard X forwarding rkhunter rtl8723be sysrq boot bscan vrrpd centos 7 ipmitool perl su profiling tzdata MODx find HDFS graylog2 lts chromium limit_conn mdadm sysresccd ulimit lstat PTR gpg replication raid debian arp dpkg