Cloud Foundry Day North America 2025

Welcome to the Cloud Foundry API pizza shop, where requests come in - some are processed immediately, while others become jobs for the baking department (cc-workers) to handle. But not all orders are the same - some are simple Margheritas, while others are complex deep - dish specials that take much longer. If the baking department isn’t managed properly, simple orders get stuck, ovens sit idle, and customers get frustrated.

To improve efficiency, we’ve made key upgrades:

• Multi-Threaded Workers: Ovens now handle multiple pizzas at once, increasing throughput without extra hardware.
• Dynamic Job Priorities: A kitchen manager ensures no single customer floods the system, allowing fair scheduling.
• Better Draining: Ovens now complete all pizzas before shutting down, preventing waste and delays.
• Preventing Database Bottlenecks: When the order system is overloaded, ovens struggle to receive new orders - fixes have improved this, but further work remains.

This talk will show how these improvements make cc-workers more efficient, scalable, and reliable, reducing costs and optimizing performance - without remodeling the entire pizza shop.