1. Queueing Theory I

2. Summary Little’s Law Queueing System Notation Stationary Analysis of Elementary Queueing Systems  M/M/1  M/M/m  M/M/1/K  …

3. Little’s Law a(t): the process that counts the number of arrivals up to t. d(t): the process that counts the number of departures up to t. N(t)= a(t)- d(t) N(t)N(t) a(t)a(t) Time t Area γ(t) Average arrival rate (up to t ) λ t = a(t)/t Average time each customer spends in the system T t = γ(t)/a(t) Average number in the system N t = γ(t)/t d(t)d(t)

4. Little’s Law Taking the limit as t goes to infinity Expected number of customers in the system Expected time in the system Arrival rate IN the system N(t)N(t) a(t)a(t) Time t Area γ(t) d(t)d(t)

5. Generality of Little’s Law Little’s Law is a pretty general result It does not depend on the arrival process distribution It does not depend on the service process distribution It does not depend on the number of servers and buffers in the system. Queueing Network Queueing Network λ Aggregate Arrival rate

6. Specification of Queueing Systems Customer arrival and service stochastic models Structural Parameters  Number of servers  Storage capacity Operating policies  Customer class differentiation (are all customers treated the same or do some have priority over others?)  Scheduling/Queueing policies (which customer is served next)  Admission policies (which/when customers are admitted)

7. Queueing System Notation A/B/m/K/N Arrival Process M: Markovian D: Deterministic Er: Erlang G: General Service Process M: Markovian D: Deterministic Er: Erlang G: General Number of servers m=1,2,… Storage Capacity K= 1,2,… (if ∞ then it is omitted) Number of customers N= 1,2,… (for closed networks otherwise it is omitted)

8. Performance Measures of Interest We are interested in steady state behavior  Even though it is possible to pursue transient results, it is a significantly more difficult task. E[S] average system time (average time spent in the system) E[W] average waiting time (average time spent waiting in queue(s)) E[X] average queue length E[U] average utilization (fraction of time that the resources are being used) E[R] average throughput (rate that customers leave the system) E[L] average customer loss (rate that customers are lost or probability that a customer is lost)

9. Recall the Birth-Death Chain Example At steady state, we obtain λ0λ0 01 μ1μ1 λ1λ1 2 μ2μ2 λ j-2 j-1 μ j-1 λ j-1 j μjμj μ3μ3 λ2λ2 λjλj μ j+1 In general Making the sum equal to 1 Solution exists if

10. M/M/1 Example Meaning: Poisson Arrivals, exponentially distributed service times, one server and infinite capacity buffer. λ 01 μ λ 2 μ λ j-1 μ λ j μ μ λ λ μ Using the birth-death result λ j =λ and μ j =μ, we obtain Therefore for λ/μ = ρ <1

11. M/M/1 Performance Metrics Server Utilization Throughput Expected Queue Length

12. M/M/1 Performance Metrics Average System Time Average waiting time in queue

13. M/M/1 Performance Metrics Examples μ=0.5 Ε[Χ]Ε[Χ] Ε[W]Ε[W] Ε[S]Ε[S]

14. PASTA Property PASTA: Poisson Arrivals See Time Averages Let π j (t)= Pr{ System state X(t)= j } Let a j (t)= Pr{ Arriving customer at t finds X(t)= j } In general π j (t) ≠ a j (t) !  Suppose a D/D/1 system with interarrival times equal to 1 and service times equal to 0.5 00.51.01.52.02.53.0 aaaa Thus π 0 (t)= 0.5 and π 1 (t)= 0.5 while a 0 (t)= 1 and a 1 (t)= 0!

15. Theorem For a queueing system, when the arrival process is Poisson and independent of the service process then, the probability that an arriving customer finds j customers in the system is equal to the probability that the system is at state j. In other words, Proof: Arrival occurs in interval (t,Δt)

16. M/M/m Queueing System Meaning: Poisson Arrivals, exponentially distributed service times, m identical servers and infinite capacity buffer. λ 01 μ λ 2 2μ2μ λ m mμmμ λ m+1 mμmμ 3μ3μ λ λ mμmμ 1 m …

17. M/M/m Queueing System Using the general birth-death result Letting ρ=λ/(mμ) we get To find π 0

18. M/M/m Performance Metrics Server Utilization

19. M/M/m Performance Metrics Throughput Expected Queue Length Using Little’s Law Average Waiting time in queue

20. M/M/m Performance Metrics Queueing Probability Erlang C Formula

21. Example Suppose that customers arrive according to a Poisson process with rate λ=1. You are given the following two options,  Install a single server with processing capacity μ 1 = 1.5  Install two identical servers with processing capacity μ 2 = 0.75 and μ 3 = 0.75  Split the incoming traffic to two queues each with probability 0.5 and have μ 2 = 0.75 and μ 3 = 0.75 serve each queue. μ1μ1 λ Α μ2μ2 μ3μ3 λ Β μ2μ2 μ3μ3 λ C

22. Example Throughput It is easy to see that all three systems have the same throughput E[R A ]= E[R B ]= E[R C ]=λ Server Utilization Therefore, each server is 2/3 utilized Therefore, all servers are similarly loaded.

23. Example Probability of being idle For each server

24. Example Queue length and delay For each queue!

25. M/M/ ∞ Queueing System Special case of the M/M/m system with m going to ∞ λλ λ λ 01 μ 2 2μ2μ λ m mμmμ m+1 (m+1)μ 3μ3μ λ Let ρ=λ/μ then, the state probabilities are given by System Utilization and Throughput

26. M/M/ ∞ Performance Metrics Expected Number in the System Using Little’s Law No queueing! Number of busy servers

27. M/M/1/K – Finite Buffer Capacity Meaning: Poisson Arrivals, exponentially distributed service times, one server and finite capacity buffer K. Using the birth-death result λ j =λ and μ j =μ, we obtain Therefore for λ/μ = ρ λ 01 μ λ 2 μ λ K-1 μ λ K μ μ λ

28. M/M/1/K Performance Metrics Server Utilization Throughput Blocking Probability Probability that an arriving customer finds the queue full (at state K )

29. M/M/1/K Performance Metrics Expected Queue Length System time Net arrival rate (no losses)

30. M/M/m/m – Queueing System Meaning: Poisson Arrivals, exponentially distributed service times, m servers and no storage capacity. Using the birth-death result λ j =λ and μ j =μ, we obtain Therefore for λ/μ = ρ λ 01 μ λ 2 2μ2μ λ m-1 (m-1)μ λ m mμmμ 3μ3μ λ

31. M/M/m/m Performance Metrics Throughput Blocking Probability Probability that an arriving customer finds all servers busy (at state m ) Erlang B Formula

32. M/M/1//N – Closed Queueing System Meaning: Poisson Arrivals, exponentially distributed service times, one server and the number of customers are fixed to N. NλNλ 01 μ (N-1)λ 2 μ 2λ2λ N-1 μ λ N μ μ (N-2)λ λ μ 1 N … Using the birth-death result, we obtain

33. M/M/1//N – Closed Queueing System Response Time  Time from the moment the customer entered the queue until it received service. NλNλ 01 μ (N-1)λ 2 μ 2λ2λ N-1 μ λ N μ μ (N-2)λ For the queue, using Little’s law we get, In the “thinking” part, Therefore