What caching strategies can I implement between the web load balancer and the web farm

cacheload balancingPROXY

I've got a web farm of IIS7 machines. works great. We're about to release an API to the wild. It's pretty simple but we know it's going to get hit pretty hard from day one (we have at least one signed up client).

So we're considering adding a caching layer BETWEEN our web servers and the interwebs. Firstly, I have no idea if this is a good solution, so I'm open to ideas. Secondly, what do we put in front of the farm? A dedicated Windows or Linux box? Our web load balancer is an F5 BIG IP.

I'm open to suggestions 🙂

Any ideas, folks?

Best Answer

I'm not sure I understand the question. Reverse proxy caching is a common practice, and there are lots of tools for doing it. Varnish and Squid are popular in the open source world for doing this. Typically you'd put a couple of RPC boxes behind your load balancer, and then either go directly from the RPC boxes to your web servers or go back through the load balancer to the web servers.

That said, if you're talking about an API, typically most of the content you'd be serving would by dynamic, making the caching mostly useless.