Your cache hit rate is 99%. Users are STILL seeing 2s latency. What are you checking next? No new components. Think bottleneck. #SystemDesign #BackendEngineering #Scalability t.co/Is1mHJEPeK
- 2 réponses
- 2 partages
- 4 j'aime
- 101 vues
Your cache hit rate is 99%. Users are STILL seeing 2s latency. What are you checking next? No new components. Think bottleneck. #SystemDesign #BackendEngineering #Scalability t.co/Is1mHJEPeK
@team_scaledojo I'd check p95/p99 instead of average latency. A 99% cache hit rate could hide a smaller percentage of very slow requests that are disproportionately affecting user experience.
@SanhitaDawn Exactly. Averages can hide the pain. I'd want p50, p95 and p99 broken down by endpoint and request type.