Numbers To Know medium
Roughly how much slower is a Main Memory (RAM) reference compared to an L1 Cache reference?
- A approximately 100x to 200x slower
- B approximately 10x to 20x slower
- C The speeds are conceptually identical in modern processors.
- D approximately 1,000x to 5,000x slower
Answer: A. approximately 100x to 200x slower
L1 cache is integrated directly into the CPU core and is incredibly fast, typically with a latency of around 0.5 nanoseconds. In contrast, Main Memory (RAM) sits much further away across the memory bus, with latencies closer to 100 nanoseconds. This ~200x speed difference is the reason why 'cache locality' is so critical in high-performance software; every 'cache miss' that forces the CPU to wait for RAM effectively wastes hundreds of processing cycles. Modern system design relies on this hierarchy (L1 vs L2 vs L3 vs RAM) to balance the high cost of fast cache memory with the large capacity of slower RAM.
One system design question a day, with spaced repetition so the ones you miss come back.
Get the appRelated questions
- What is the maximum allowed downtime per year for a system targeting '99.9%' (Three Nines) availability?
- What is the typical size of a standard ASCII character (e.g., 'A')?
- What is the typical Round Trip Time (RTT) for a single network packet traveling between New York and London (Transatlantic)?
- Network bandwidth is usually denoted in **bits** per second (Gbps), while storage is in **Bytes** (GB). What is the conversion ratio?
- Storing a password using a secure algorithm like bcrypt (cost 10) or Argon2 typically consumes how much storage per user?
- How much power does a typical fully-loaded rack-mount server consume?