Scale and performance is every engineer’s problem. Scale is not same as performance though related.
- Performance – Task runs on a thread and assigned to a CPU core. How fast it run depends on the clock speed and the code. Performance is what can be seen when there is no load.
- Scale – Scale is all about load. Load impacts the performance as there is a limit on the number of requests that can be processed and hence a queue involved. CPU context switches to deal with multiple threads.
Top factors in achieving scale and performance
- Design for scale out.
- Caching – Almost at every layer.
- Optimized code.