How to ideally store images on Amazon S3

amazon s3compressiongzipimages

I want to store a huge number of images on Amazon S3 (served via Cloudfront). Currently the way I am doing is simply dumping the images and having basic HTTP Cache headers set to a month so that users can have fast browsing experience. But I still want more fast experience.

Is there anyway I can compress my images (like gzip for text) and users can access that image resource on their browsers.

Best Answer

JPEGs are already inherently a compressed format, so further compression isn't really something that'll give you any significant benefit. You could reencode them with a lower quality setting but that'll compromise their appearance significantly.

Related Solutions

Gzip to bmp images on the fly

If possible, use PNG as image format. It's the defacto standard for lossless image compression and will probably surpass the compression level achieved by merely gziping bitmaps.

If you need to use BMP because of dependencies from legacy systems, you can try using the output compression methods available in your webserver, e.g. see mod_deflate for Apache. Wireshark can be especially helpful in testing/debugging such setups.

Amazon S3 – How to Get the Size of an Amazon S3 Bucket

The AWS CLI now supports the --query parameter which takes a JMESPath expressions.

This means you can sum the size values given by list-objects using sum(Contents[].Size) and count like length(Contents[]).

This can be be run using the official AWS CLI as below and was introduced in Feb 2014

 aws s3api list-objects --bucket BUCKETNAME --output json --query "[sum(Contents[].Size), length(Contents[])]"

Best Answer

Related Solutions

Gzip to bmp images on the fly

Amazon S3 – How to Get the Size of an Amazon S3 Bucket

Related Topic