Hard Design: Rate Limiter
How would you design a rate limiter that limits by cost rather than by count (e.g., expensive ML inference costs 10 units, simple lookup costs 1)?
— Tests your understanding of this concept.
Want to see the correct answer?
Get the answer with a detailed explanation, plus practice 22+ more Design: Rate Limiter questions with adaptive quizzes and timed interviews.
See the Answer on Guru Sishya →This question is from the Design: Rate Limiter topic (System Design Cases).
More Design: Rate Limiter Questions
Which HTTP status code indicates a rate limit has been exceeded?
HardWhat is the main disadvantage of a fixed window counter rate limiter?
HardWhy must the sliding window check-and-increment be done atomically in Redis?
HardYour rate limiter Redis cluster goes down during peak traffic. What should happen?
HardWhich algorithm allows bursting up to bucket capacity while maintaining an average rate?
Hard