Writing to an s3 mounted directory

That's why you have a production and a staging environment. The staging environment is supposed to be "Free for all" and then your production environment is for when your code is all nice and dandy.

If you want to allow more granularity you should consider source code control for your SaltStack code/yaml. (git, mercurial, etc) Every user could have his/her own branch and then when push comes to shove, you have to merge everything into a 'staging' branch and then eventually deploy to 'production'

The behavior that you are seeing with S3 is the default behavior for "eventual consistency" Basically, you will get the copy of the last updated files and won't get anything new until the 'other user' has finally pushed his/her change.

This is what the docs say on the AWS site about S3 data consistency:

Q: What data consistency model does Amazon S3 employ? Amazon S3 buckets in the US West (Oregon), US West (Northern California), EU (Ireland), Asia Pacific (Singapore), Asia Pacific (Tokyo), Asia Pacific (Sydney) and South America (Sao Paulo) Regions provide read-after-write consistency for PUTS of new objects and eventual consistency for overwrite PUTS and DELETES. Amazon S3 buckets in the US Standard Region provide eventual consistency.

And you can read about 'eventual consistency' here:

http://en.wikipedia.org/wiki/Eventual_consistency

(Improving the solution of Shishir)

• Save the following script in a file (I named the file s3Copy.sh)

path=$1 # the path of the directory where the files and directories that need to be copied are located
s3Dir=$2 # the s3 bucket path

for entry in "$path"/*; do
    name=`echo $entry | sed 's/.*\///'`  # getting the name of the file or directory
    if [[ -d  $entry ]]; then  # if it is a directory
        aws s3 cp  --recursive "$name" "$s3Dir/$name/"
    else  # if it is a file
        aws s3 cp "$name" "$s3Dir/"
    fi
done

• Run it as follows:
  /PATH/TO/s3Copy.sh /PATH/TO/ROOT/DIR/OF/SOURCE/FILESandDIRS PATH/OF/S3/BUCKET
  For example if s3Copy.sh is stored in the home directory and I want to copy all the files and directories located in the current directory, then I run this:
  ~/s3Copy.sh . s3://XXX/myBucket

You can easily modify the script to allow for other arguments of s3 cp such as --include, --exclude, ...