Exclude a set of file types when running rsync

file-transferrsync

I'm running the following rsync command

rsync --times -v --recursive --compress --exclude "*.svn" --rsh=/usr/bin/ssh source/folder/ user@ip:httpdocs/

which excludes *.svn files when running. My question is how do I pass it a list of file types to exclude. There are a lot of non-essential hidden files in our development copy (IDE project files and osx specific files)

I need to pass in a list of 5 or 6 file extensions for rsync to ignore.

thanks

Best Answer

Use the --exclude-from option, and specify a text file with all the patterns you want to avoid in it, like:

rsync --times -v --recursive --compress --exclude-from /tmp/filelist.txt --rsh=/usr/bin/ssh source/folder/ user@ip:httpdocs/

Related Solutions

Windows – Ignore windows hidden files when copying with rsync

To get the DOS attributes into Linux you will need to edit your smb.conf file.

There are two different ways to import Windows attributes.

The first option is to set map hidden = yes which will mean that hidden files on Windows will have the world execute bit set on Linux. For this to work you must also have at least 001 in your create mask.

The other option is to set store dos attributes = yes which will mean that the Windows attributes will be stored in an extended attribute in the Linux file system called user.DOSATTRIB.

rsync doesn't have the ability to filter files based on either normal or extended attributes but it can exclude a list of files that you have prepared in some other way. You can use the find command to create this list based on Unix attributes. The version of find I have doesn't seem to support extended attributes but it might still be possible to use the -exec option in find to get extended attributes of all your files and filter on them.

Since find can filter on normal Unix permissions, if you chose the world execute bit option then find . -perm -001 will find all of the hidden files in your mounted Windows filesystem. You can put this list in a file and then use rsync --exclude-from=FILE to exclude those files from your rsync.

Linux – rsync – Exclude files that are over a certain size

There is a max-size option:

--max-size=SIZE         don't transfer any file larger than SIZE

So:

# rsync -rv --max-size=1.5m root@tss01:/tmp/dm

Will send only files less than 1.5m.

Regarding sizes from man: The suffixes are as follows: "K" (or "KiB") is a kibibyte (1024), "M" (or "MiB") is a mebibyte (1024*1024), and "G" (or "GiB") is a gibibyte (1024*1024*1024). If you want the multiplier to be 1000 instead of 1024, use "KB", "MB", or "GB". (Note: lower-case is also accepted for all values.) Finally, if the suffix ends in either "+1" or "-1", the value will be offset by one byte in the indicated direction*

Best Answer

Related Solutions

Windows – Ignore windows hidden files when copying with rsync

Linux – rsync – Exclude files that are over a certain size

Related Topic