WPI

Impact of Acknowledgements on Application

Performance in 4G LTE Networks

Master’s Thesis Presentation

Brett Levasseur
Advisors
Mark Claypool, Robert Kinicki
Reader
Emanuel Agu

5/5/2014 1
 Network Growth WPI

• Worldwide Mobile networks in 2013

– ½ billion mobile devices added
– 77% of this growth from smartphones
– Mobile data traffic grew 81%
– Mobile video traffic 51% of all mobile data
• 4G in 2013
– 2.9% of all connections
– Account for 30% of all mobile traffic
– Predicted to be ½ of all connections in 2018
[Cisco 13]
5/5/2014 2
 4G Long Term Evolution (LTE) WPI

• Long Term Evolution (LTE) – Standard created

by the 3rd Generation Partnership Project
– Deployed globally
– All packet switched network
– High throughput and QoS considerations
– Provides wireless retransmissions of lost data

5/5/2014 3
 Wireless Loss and LTE WPI

• LTE responds to poor signal quality by decreasing

throughput
– Retransmissions
• LTE has multiple configuration parameters for
wireless retransmissions
– E.g. 1 or 2 layers of retransmissions
• Network providers may not choose optimum settings
• Application developers have no knowledge on LTE
retransmissions

5/5/2014 4
 General Problem Statement WPI

• How do LTE retransmissions impact

application performance?
• What LTE retransmissions settings impact
application performance?
• Which LTE retransmission policies are
preferred in different wireless loss conditions?

5/5/2014 5
 Outline WPI

• Introduction
• Background
– LTE
– ns-3
• Related Work
• Approach
• Results
• Conclusion
5/5/2014 6
 LTE Network WPI

• Packet Delivery Network Gateway (PGW)

– Connects LTE network to IP networks
• Serving Gateway (SGW)
– Route packets to and from wireless access points
• Enhanced Node B (eNodeB)
– Wireless access point
• User Equipment (UE)
– End user devices
5/5/2014 7
 LTE Network Layers WPI
Application
• LTE wireless network
has 6 layers (not all
TCP UDP
shown)
• PHY – RLC layers carry IP
user and network
control data RLC
• LTE transmits
collections of Physical MAC
Resource Blocks (PRB)s
in transport blocks PHY

5/5/2014 8
 Channel Quality Indictor (CQI) WPI

• UEs send CQI to notify received signal quality

– Maps to modulation and encoding schemes (MCS)
– MCS and PRBs determine transport block size

5/5/2014 9
 LTE Retransmissions: MAC WPI

1ms TTI [Dahlman 11]

• Hybrid Automatic Request Reply (HARQ)

• Data sent at time n, arrives at time n
• 3ms taken to check if data arrived with errors
• n+4 ACK/NACK sent back
• n+8 if NACK, data can be retransmitted
– Up to 3 retransmissions for downlink traffic
5/5/2014 10
 LTE Retransmissions: RLC WPI

• Unacknowledged Mode (UM) receive window

– VR(UR) – Lower bound
– VR(UH) – Highest received SN + 1
– VR(UX) – Reordering SN
• Acknowledged Mode (AM) receive window
– VR(R) – Lower bound
– VR(H) – Highest received SN + 1
– VR(X) – Reordering SN
– VR(MS) – Highest SN to ACK
– VR(MR) – Upper bound
5/5/2014 11
 RLC UM WPI

0 1 2 3 4 5 6

VR(UR),VR(UH)

• Receiving window used for reordering PDUs

• Out of order PDU trigger timer t-Reordering

0 1 2 3 4 5 6

VR(UR) VR(UX),VR(UH)
5/5/2014 12
 Timer t-Reordering UM WPI

• Timer runs when PDUs 0 1 2 3 4 5 6

arrive out of order
• Gives MAC layer chance to VR(UR) VR(UX),VR(UH)
recover lost data
• Expiration moves VR(UR) up
to first SN >= VR(UX) that is 0 1 2 3 4 5 6

not received
• Tradeoffs Recovered
VR(UR),VR(UH)

– Small timer, MAC

retransmissions lost
0 1 2 3 4 5 6
– Large timer, keeps lower
bound of window stalled
VR(UR),VR(UH)
5/5/2014 LOST 13
 RLC AM WPI

0 1 2 3 4 5 6

VR(R),VR(H),VR(MS)

• Receiving window used for reordering and

ACK/NACK messaging

0 1 2 3 4 5 6

VR(R),VR(MS) VR(X),VR(H)
5/5/2014 14
 Timer t-Reordering AM WPI
• Gives MAC layer time before 0 1 2 3 4 5 6
NACKing
• t-Reordering starts when SN 5
arrives VR(R),VR(MS) VR(X),VR(H)
– ACK = 3
• While running SN 4 arrives
– ACK = 3 0 1 2 3 4 5 6
• When timer expires VR(MS) is
updated VR(R),VR(MS) VR(X),VR(H)
– ACK = 6, NACK = 3
• Tradeoffs
– Small timer, NACK data that MAC can 0 1 2 3 4 5 6
recover
– Large timer, stalls NACKs
VR(R) VR(H),VR(MS)
5/5/2014 15
 RLC AM STATUS WPI

• Control message for sending ACKs/NACKs

between UEs and eNodeBs
• Sender polls for STATUS messages
D/C CPT ACK_SN Oct 1
ACK_SN E1 Oct 2
NACK_SN Oct 3
E1 E2 NACK_SN Oct 4
NACK_SN E1 E2 Oct 5
SOstart Oct 6
SOstart SOend Oct 7
SOend Oct 8
SOend NACK_SN Oct 9
...
[LTE RLC]
5/5/2014 16
 Timer t-StatusProhibit WPI

• Receiver side timer

– Stops receiver from sending STATUS messages
– Timer started when STATUS message sent
– All poll requests collapsed to one STATUS sent
when timer expires
• Trade off
– Small timer could send many STATUS messages
– Large timer delays sending ACKs and NACKs

5/5/2014 17
 Outline WPI

• Introduction
• Background
– LTE
– ns-3
• Related Work
• Approach
• Results
• Conclusion
5/5/2014 18
 ns-3 WPI

• Open source packet level network simulator [ns-3]

• Successor to ns-2
• Funded by National Science Foundation and
the Planete group at INRIA Sophia Antipolis
• 2009 - 2012 ns-3 downloaded 50,792 times
• As of version 3.16 there were 113 listed
authors and 25 maintainers [ns-3 stats]

5/5/2014 19
 LTE-EPC Network Simulator Module WPI

• LTE/EPC Network Simulator (LENA) [Baldo 11]

• Developed Centre Tecnologic de
Telecomunicacions de Catalunya
• Allows simulations with LTE networks in ns-3
– Part of the main ns-3 branch
• Still under active development

5/5/2014 20
 Outline WPI

• Introduction
• Background
– LTE
– ns-3
• Related Work
• Approach
• Results
• Conclusion
5/5/2014 21
 Related Work WPI

• Applications Used
– Böhmer et al. – Mobile apps mostly used for
communication [Böhmer 11]
– Huang et al. – Majority of data over LTE uses TCP
[Huang 13]
• HARQ
– Kawser et al. – Limit MAC retransmissions to 3 or
[Kawser 12]
less
• RLC AM
[Makidis 07]
– Makidis – Examined TCP with RLC AM
5/5/2014 22
 Outline WPI

• Introduction
• Background
– LTE
– ns-3
• Related Work
• Approach
• Results
• Conclusion
5/5/2014 23
 Specific Problem Statement WPI

• How do MAC and RLC layer retransmission

impact VoIP, FTP, Video
– Delay/Loss/Throughput sensitive
• How does adjusting RLC timer settings impact
retransmissions and application performance
• When is it better to use RLC AM or UM with
varying loss rates at physical layer

5/5/2014 24
 ns-3 LTE Modifications WPI

• LTE module for ns-3 did not support NACKs in

AM STATUS message
• Joined discussion forum to implement NACKs
– Worked with LTE module developers and others
– Provided code for (de-)serializing NACKs to
developers
– Discussed specifics of AM receive window for
NACKs with developers
– Helped LTE model developers test changes
[ns-3 Forum]

5/5/2014 25
 Simulator Additions WPI

• Confirmed NACK
read/write works
• Modified how NACKs
are selected
– Found and corrected
errors on when AM
window variables were
updated
– Tests show AM recovers
all lost PDUs

5/5/2014 26
 Simulating VoIP WPI

• ns-3 example code for application that sends data at a

specified rate
• Use G.711 encoding format to define size of packets
[ITU G.711]
and sending rate
– 160 bytes data, 12 bytes RTP header, 8 bytes UDP header, 20
bytes IP header
– Sending rate 64Kbps or about 1 packet every 20ms
• Mean Opinion Score (MOS) used as performance metric
– 1 – 5 point scale, 1 worst, 5 best
– Calculated from delay and loss using E-Model [E-Model]

5/5/2014 27
 Simulating FTP WPI

• ns-3 bulk send application

– Transmits as much data as possible over TCP
– Default ns-3 congestion control algorithm is
NewReno
• Throughput used as performance metric

5/5/2014 28
 Simulating MPEG WPI

• ns-3 MPEG trace file application

– Reads a file of MPEG frame sizes and times to
transmit
– Sends frames in UDP packets
• Compatible video trace files from the
Telecommunication Network Group at
Technische Universität Berlin [MPEG Trace]
• Selected video of soccer match
• Frame rate used as performance metric
5/5/2014 29
 Simulation Network WPI

• Server sends data to UE

• Wireless link bottleneck
• UE stationary
• No obstructions or noise sources
• UE positioned so it would request CQI 8
5/5/2014 30
 CQI Choice WPI

• Wrote Android application to log requested CQI

value on LTE networks
• Collected data over 1 week from Feb – March 2014
• Average CQI requested was 8
5/5/2014 31
 Wireless Loss WPI

• LTE simulator allows fading trace files to

impose SINR
– File is a matrix of TTI, PRB number and SINR
• If fading trace SINR is too high any data in that
PRB sent in that TTI is lost
• Gilbert-Elliot model used to set which TTIs
have loss
– Bursty Loss

5/5/2014 32
 Wireless Loss Cont WPI

• Creating fading loss file

– Run previous equations for state transitions
– Run Gilbert model

5/5/2014 33
 RLC Settings WPI

• Test adjusting t-
0 ms, 5, 10, 15, 20, 25, 30, 35,
Reordering and t- 40, 45, 50, 55, 60, 65, 70, 75,
t-Reordering 80, 85, 90, 95, 100, 110, 120,
StatusProhibit timers 130, 140, 150, 160, 170, 180,
190, 200
• Settings suggested in 0 ms, 5, 10, 15, 20, 25, 30, 35,
LTE specification [LTE RRC] 40, 45, 50, 55, 60, 65, 70, 75,
80, 85, 90, 95 100, 105, 110,
• Subset of these 115, 120, 125, 130, 135, 140,
t-StatusProhibit 145, 150, 155, 160, 165, 170,
suggested values are 175, 180, 185, 190, 195, 200,
205, 210, 215, 220, 225, 230,
used for testing 235, 240, 245, 250, 300, 350,
400, 450, 500

5/5/2014 34
 Outline WPI

• Introduction
• Background
– LTE
– ns-3
• Related Work
• Approach
• Results
• Conclusion
5/5/2014 35
 VoIP t-Reordering WPI
AM UM

• Adjusting t-Reordering has little impact on delay

– AM experiences more delay but not by much

5/5/2014 36
 VoIP t-Reordering WPI
AM UM

• Adjusting t-Reordering has little impact on MOS

– Worst MOS is still good across all settings
• Fix t-Reordering = 30ms

5/5/2014 37
 VoIP t-StatusProhibit WPI

• Adjusting t-StatusProhibit has greater impact

• Lower values for timer better than higher in general
• Fix t-StatusProhibit = 50ms

5/5/2014 38
 VoIP AM vs UM WPI

• Adjusted loss percent

• VoIP over AM outperforms VoIP over UM until 20% loss
– Same for both Atlantic and Pacific test

5/5/2014 39
 FTP t-Reordering WPI
AM UM

• AM outperforms UM across t-Reordering

• Large error ranges due to TCP RTO
• Fix t-Reordering = 50ms

5/5/2014 40
 FTP t-StatusProhibit WPI

• Lower values for t-StatusProhibit are better

• Large error ranges from TCP RTOs
• Fix t-StatusProhibit = 75ms

5/5/2014 41
 FTP AM vs UM WPI

• FTP over AM has higher average throughput than FTP over UM

• UM briefly better at 10% loss but has higher error range
– Input gap lengths up to 30 for 5 – 25% and up to 100 for 30 – 50%

5/5/2014 42
 MPEG t-Reordering WPI
AM UM

• Adjusting t-Reordering has little impact on frame rate

– Exception is additional frames recovered in UM
• Fix t-Reordering = 30ms

5/5/2014 43
 MPEG t-StatusProhibit WPI

• Lower values for t-StatusProhibit produce less variation

– Large error ranges from RLC retransmissions
• Fix t-StatusProhibit = 75ms

5/5/2014 44
 MPEG AM vs UM WPI

• AM – Higher average frame rate

• UM – Lower average frame rate

5/5/2014 45
 MPEG AM vs UM WPI

• AM – Out of order frames delayed by retransmissions

• UM – Lower average delay but more frames lost

5/5/2014 46
 Conclusion WPI

• Added RLC AM NACKs to ns-3 LTE simulator

• VoIP over AM has higher MOS until 20% loss
– 5 – 20% loss rate AM avg 4.26, UM avg 4.15
– 25 – 35% loss rate AM avg 1.82, UM avg 3.7
• FTP over AM has higher average throughput
– AM average throughput 1.21Mb/s, UM 0.83 Mb/s
• Video over AM has higher delay, UM lower average
frame rate
– AM avg 25 frames per sec, UM avg 21
– UM frame delay avg 29 ms, AM avg 95 ms

5/5/2014 47
 Future Work WPI

• Video simulations with TCP

• Test with other RLC layer settings
– t-PollRetransmit timer
– PollPDU and pollByte
• Add support for RLC AM maximum
retransmission radio link layer failure

5/5/2014 48
 Questions WPI

Impact of Acknowledgements on
Application Performance in 4G LTE
Networks
Master’s Thesis Presentation
Brett Levasseur
Advisors
Mark Claypool, Robert Kinicki
Reader
Emanuel Agu

5/5/2014 49
 References WPI
[LTE RLC] 3GPP. 3rd Generation Partnership Project; Technical Specification Group Radio Access Network; Evolved Universal
Terrestrial Radio Access (E-UTRA); Radio Link Control (RLC) protocol specification (Release 8). Technical Specification 36.322v8.0.0,
3GPP, December 2007. http://www.3gpp.org/ftp/Specs/html-info/36322.htm.
[LTE RRC] 3GPP. 3rd Generation Partnership Project; Technical Specification Group Radio Access Network; Evolved Universal
Terrestrial Radio Access (E-UTRA); Radio Resource Control (RRC) Protocol specication (Release 8). Technical Specication
36.331v8.10.0, 3GPP, march 2008. http://www.3gpp.org/ftp/Specs/html-info/36331.htm.
[Cisco 13] Cisco. Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2013-2018. Technical report,
Cisco, 2014. http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white paper c11-520862.pdf
[Dahlman 11] Erik Dahlman, Stefan Parkvall, and Johan Sk old. 4G LTE/LTE-Advanced for Mobile Broadband. Academic Press,
Oxford, 2011.
[Zyren 07] Jim Zyren. Overveiw of the 3GPP Long Term Evolution Physical Layer. Technical report, Freescale Semiconductor, 07
2007.
[ns-3] https://www.nsnam.org/
[ns-3 stats] https://www.nsnam.org/overview/statistics/
[Baldo 11] Nicola Baldo, Marco Miozzo, Manuel Requena-Esteso, and Jaume Nin-Guerrero. An open source product-oriented
lte network simulator based on ns-3. In Proceedings of the 14th ACM International Conference on Modeling, Analysis and
Simulation of Wireless and Mobile Systems, MSWiM '11, pages 293{298, New York, NY, USA, 2011. ACM.
[ITU G.711] International Telecommunication Union. Pulse Code Movulation (PCM) of Vlice Frequencies. Technical Specification
G.711, ITU-T, November 1988. https://www.itu.int/rec/dologin pub.asp?lang=e&id=T-REC-G.711-198811-I!!PDFE& type=items.
[MPEG Trace] http://www-tkn.ee.tu-berlin.de/research/trace/trace.html
[Gordo 10] N Gordo and A Daniel. Evaluating video quality degradation from data packet losses in an lte environment, 2010.
[Verizon] Verizon. IP Lagency Sstatistics, April 2014. http://www.verizonenterprise.com/about/network/latency/.

5/5/2014 50
 References Cont WPI
[ns-3 Forum] https://groups.google.com/forum/#!topic/ns-3-users/CEfmMX3IRBw
[E-Model] Leandro Carvalho, Edjair Mota, Regeane Aguiar, Ana F Lima, Jose Neuman de Souza, and Anderson Barreto. An E-
model implementation for speech quality evaluation in VoIP systems. In Proceedings of the 10th IEEE Symposium on Computers
and Communications, volume 154. IEEE Computer Society, 2005.
[Böhmer 11] Matthias Böhmer, Brent Hecht, Johannes Sch oning, Antonio Kr uger, and Gernot Bauer. Falling asleep with angry
birds, facebook and kindle: a large scale study on mobile application usage. In Proceedings of the 13th International Conference
on Human Computer Interaction with Mobile Devices and Services, pages 47{56. ACM, 2011.
[Huang 13] Junxian Huang, Feng Qian, Yihua Guo, Yuanyuan Zhou, Qiang Xu, Z. Morley Mao, Subhabrata Sen, and Oliver
Spatscheck. An In-depth Study of LTE: Eect of Network Protocol and Application Behavior on Performance. In Proceedings of the
ACM SIG-COMM 2013 Conference on SIGCOMM, SIGCOMM '13, pages 363{374, New York, NY, USA, 2013. ACM.
[Makidis 07] Michael Makidis. Implementing and evaluating the RLC/AM protocol of the 3GPP specification. Master's thesis,
Athens University of Economics and Business, 2007.
[Kawser 12] T. Mohammad Kawser, Nax Imtiaz Bin Hamid, Nayeemul Hasan, M. Shah Alam, and M. Musqur Rahman. Limiting
HARQ Retransmissions in Downlink for Poor Radio Link in LTE. International Journal of Information and Electronics Engineering,
2012.

5/5/2014 51
 Backup Slides WPI

5/5/2014 52
 MPEG t-Reordering WPI
AM UM

• Video over UM outperforms video over AM across t-Reordering

• Fix t-Reordering = 30ms

5/5/2014 53
 MPEG t-StatusProhibit WPI

• Lower values for t-StatusProhibit are better

• Large error ranges from RLC retransmissions
• Fix t-StatusProhibit = 75ms

5/5/2014 54
 Loss Shape WPI

• 30% loss performs better for AM than 25%

5/5/2014 55
 Gilbert-Elliot Model WPI

• Two state machine for loss

– X = 0 no loss
– X = 1 loss
• Transition probabilities define when to change
states
5/5/2014 56
 Transitions WPI

• Gordo et al. shows how

to take input of loss
gaps and determine
state transitions [Gordo 10]
– Ok – # of burst losses of
length k
– a - # of TTIs
– d - # of lost TTIs

5/5/2014 57
 HARQ WPI

• MAC layer fixes blocks with known errors

05/06/2021 58
 RLC UM WPI

• Maintains transmission
& reception buffers
• Segmentation &
concatenation of RLC
SDUs
• Reorder of PDUs
• Retransmissions still
occur in MAC layer

05/06/2021 59
 RLC AM WPI

• Maintains transmission, AM-SAP

retransmission &
reception buffers Transmission
RLC control SDU reassembly
buffer

• Segmentation &
concatenation of RLC SDUs Remove RLC header
Segmentation & Retransmission

• Reorder of PDUs Concatenation buffer

• Sliding window for PDUs

Reception
buffer & HARQ
reordering

sent/received
Add RLC header

• Max retransmission Routing

threshold DCCH/DTCH DCCH/DTCH

05/06/2021 60
 Simulation Settings WPI

• Physical
– Tx Power
– Noise
– Mobility
• RLC
– AM
– UM
• Applications
– Protocols
– App types

05/06/2021 61
 Traffic Separation & Frame Structure WPI

• Time Division Duplexing (TDD)

• Frequency Division Duplexing (FDD)

Generic Frame Structure for FDD

05/06/2021 62
 Downlink Multiplexing WPI
• Orthogonal Frequency Division Multiple
Access (OFDMA)
– User allocated Physical Resource Blocks (PRBs) or
subcarriers for predetermined time
– Total subcarriers depends on bandwidth
Bandwidth
1.4 3.0 5.0 10.0 15.0 20.0
(MHz)
Subcarrier
bandwidth (kHz) 15
PRB bandwidth
180
(kHz)
# of available
PRBs 6 15 25 50 75 100

05/06/2021 63
 Downlink Resource Grid WPI

PRB X PRB X
Frequency

PRB 1 PRB 1

12 sub PRB 0 PRB 0

carriers
Slot 1 0.5 ms Slot 2 1 ms

Time

05/06/2021 64
 Transport Block Size WPI
1 Frame (10 msec)

TB TB TB TB TB TB TB TB TB TB

1 Transport Block (1 msec)

PRB PRB 1 – 100

possible PRBs
Depending on modulation and number of PRBs
…

per slot
depending on the total size of 1 Transport Block can be from:
PRB PRB available 16 – 75,376 bits
frequencies

Slot (0.5msec)

05/06/2021 65
 SDUs & PDUs WPI

05/06/2021 66
 LTE WPI

• Long Term Evolution – Standard of wireless

communication of high-speed data for mobile
equipment
• ITU lowered original 4G criteria for LTE and
WIMAX
Standard Organization 3GPP
Uplink Speed (theoretical) 50 Mbit/s
Downlink Speed (theoretical) 100 Mbit/s
Bandwidth Range 1.4 MHz – 20 MHz
Based On GSM/EDGE and UMTS/HSPA

05/06/2021 67
 Multipath Handling WPI
• Orthogonal Frequency Division Multiplexing
(OFDM)
– Transmits data in parallel streams
– Symbol preceded by cyclic prefix (CP)
– Overlap of multiple paths occur in the CP

05/06/2021 68