What does maximum-connections, CPU autoscaling, money and distributed systems have in common? Find out.

What does maximum-connections, CPU autoscaling, money and distributed systems have in common? Find out.
How do you know the right maxThreads (Tomcat/Java) or maxConnections (IIS/.NET) for your application? What is it? Why do I need to set that?
Bob is a very successful guy. He is auto scaling his service by automatically adding hosts when the CPU increases, and he is removing them when CPU goes down. Dear Bob, there is a trap waiting for you around the corner.