Nokia Dynamic Experience Management Application Note en
Nokia Dynamic Experience Management Application Note en
Management
User plane access network congestion detection and policy control
Application note
Abstract
The traffic load generated by users of wireless networks continues to grow to unprecedented levels,
with highly variable loads across the network and over time. Internet of Things and machine-type
communications (IoT/MTC) will further increase data demand and diversify consumption behaviors, with
traffic management and quality of experience requirements that are different from consumer applications.
These trends place enormous demands of traffic growth on access networks for any access technology
that uses wireless licensed or unlicensed spectrum, or for fixed networks where resource sharing and
overbooking will likely remain a common practice. When network congestion occurs, users are impacted
in a variety of ways that can disrupt the user experience of the applications they use, with no fairness
between users on the shared congested resource.
To address these problems, Nokia Dynamic Experience Management (DEM) is a systemic approach that
automatically detects congestion in the user plane and allows it to be mitigated immediately without
management or control plane intervention. This document provides an overview of DEM, its potential
applications and capabilities.
2 Application note
Dynamic Experience Management
Contents
Abstract 2
The need for automated access network congestion control 4
Intelligent congestion control 5
Experience management benefits 6
DEM support in Nokia products 7
DEM: a use case of Application Assurance 7
DEM integrated in PGW/GGSN/UPF 8
DEM for access network types 9
Fixed wireless access networks 9
NLB-DEM for mobile networks 10
Wireless LAN access networks 10
DEM configuration 11
DEM congestion detection 11
DEM traffic control 12
DEM performance impact 13
Use cases and policy examples 14
Mobile RAN congestion control 14
Location-based congestion control 16
Net neutrality and congestion control 18
Conclusion 19
Abbreviations 19
3 Application note
Dynamic Experience Management
The need for automated access network congestion control
Video and multimedia continue to dominate growth in broadband traffic, with augmented reality (AR) and
virtual reality (VR) experiences on the horizon. The traffic load generated by users of wireless networks
continues to grow to unprecedented levels, with highly variable loads across the network and over time.
Internet of Things and machine-type communications (IoT/MTC) are set to further increase data demand
in the future. These trends place enormous demands of traffic growth on access networks for any access
technology that uses wireless licensed or unlicensed spectrum, or for fixed networks where resource
sharing and overbooking remain common practices.
Due to these circumstances, combined with dynamic and highly variable user behavior, it is a regular
occurrence for access networks to congest, meaning more traffic needs to be delivered through the
network than can be supported. In the absence of dynamic congestion control solutions, traffic is
queued and eventually discarded with no awareness of the value of the traffic, which subscribers on that
network are being impacted, or if the resulting use of resources is fair between subscribers. For instance,
subscribers with traffic that existed before the congestion event could get much better performance than
new users trying to connect over the congested network.
To address these problems, a systemic approach that automatically and simply detects congestion in the
user plane and allows it to be managed immediately without management or control plane intervention
is essential. The parameters for how to treat subscribers, services and traffic in a manner based on
application awareness and quality of experience (QoE) should be proactively defined as a matter of
network policy, such that when congestion occurs, it can be managed immediately, avoiding any delays
caused by external systems’ involvement in real-time policy decisions.
The Nokia solution to this problem is called Dynamic Experience Management (DEM). This is an optional
capability available in network functions based on the Nokia Service Router Operating System (SR OS) used
for fixed and mobile subscriber management and policy enforcement across a range of wired and wireless
access network technologies. It is Dynamic in that is responds automatically in real time to access network
congestion events; Experience Management means that the traffic mitigation polices invoked are based on
monitoring the QoE being achieved by the actual user traffic on the network, rather than by synthetic OAM
traffic parameters or the measured network performance by the operations support system (OSS). The
traffic mitigation policies implemented may be service aware, application aware and subscriber aware,
with any combination and weight of these as desired.
1b. Understand congestion per subscriber per congestion point per application
or by or access location (e.g. radio) 20–30% virtual
Any access
Content
capacity gain
Real-time QoE measurement for customer experence insight
servers
Subscriber fairness
Wi-Fi RNC MME
BTS
4 Application note
Dynamic Experience Management
With DEM, network congestion events become an opportunity to manage and improve the end user’s
satisfaction with the network services, rather than have them be subjected to network overload events
with unintended, sub-optimal consequences. In doing so, it also maximizes the value of the access network
during times of congestion, which may not be preventable, but which certainly can be controlled by policy.
Mobile
Shared
Unlicensed
Fixed
5 Application note
Dynamic Experience Management
In the WLAN-GW, DEM models the congestion points as access network locations (ANLs), which it learns
from the WLAN-GW subscriber attributes, and manages them accordingly to achieve the configured QoE/
quality of service (QoS) target on a per-ANL basis. The access location managed for Wi-Fi networks is the
Wi-Fi access point (AP).
The DEM-GW achieves congestion control by:
• Running DPI to classify flows (including encrypted traffic) into applications
• For location-based DEM, dynamically learning access network congestion points and estimating their
maximum capacity:
− Through real-time detection, sniffing, measurements and profiling
− Continuous monitoring of user equipment locations and associating them to the right AP radio
congestion points
• For NLB-DEM, dynamically learning per-subscriber congestion state through real-time detection,
sniffing, measurements and profiling
• QoE enforcement using flexible Application QoS Policy (AQP) rules:
− Efficient AP radio congestion detection, localization and management provided via configurable
“adaptive policers”
− Per-subscriber policy control using congestion-override policers that rate limit subscriber bandwidth
during different stages of congestion: mild and severe congestion.
- Congestion policy control rules that can factor in application, application group, day and time of day,
as well as service tier(s) or APNs
6 Application note
Dynamic Experience Management
Figure 3. 3G Mobile RAN congestion
Main network bottlenecks
Radio
access Mobile
Mobile backhaul packet
core
Node B
RNC SGSN GGSN
For 3G, the use of high-capacity 3G/LTE smartphones and USB dongles in many cases leads to frequent
user plane congestion in the access networks, which in turn causes:
• Service degradation for mobile subscribers attached to congested cell sites
• Challenges in implementing fair usage policies to manage network congestion in the core network
and in the RAN
• Increased OPEX due to packet loss and retransmission.
Managing RAN access congestion points at the mobile core to provide QoS guarantees to different
applications can be challenging as the cells are loaded differently at any point in time, both in quantity
(bandwidth) and application type (video, web, mail, and so on).
7 Application note
Dynamic Experience Management
AA supports all applications and traffic types:
• Web, video, audio, voice, social networking, file transfer, software updates, mail, gaming, etc.
• Encrypted traffic support: HTTPs, HTTP2C, SPDY and QUIC
• IPv4, IPv6 and dual-stack.
Dynamic application policy control is the ability to dynamically apply prescribed actions to different
subscriber traffic flows. The per-subscriber application control via the Diameter or Radius policy
interface gives the service provider the freedom to use the different AA actions dynamically on
a specific subscriber application.
AA subscriber control enables many other PCEF use cases that can be deployed at the same time in
addition to DEM, including:
• Per-subscriber, per-application HTTP redirect
• Per-subscriber, per-application header enrichment
• Per-subscriber tethering detection and control
• Per-subscriber web filtering/parental control
• Per-subscriber, per application or application group throttle and control
• Network-based URL and domain blacklisting
• In-browser notification
• Layer 7 stateful firewall
• TCP optimization.
8 Application note
Dynamic Experience Management
Figure 4. SSG use for enhanced services on the SGi-LAN interface
Operator
cloud
MME/
SGSN
4G/LTE RAN
EPC
SGW/PGW/ CMG
Trusted/untrusted Wi-Fi network GGSN (SSG)
IP/optical
network
ePDG/TWAG
Fixed network
9 Application note
Dynamic Experience Management
Figure 5. FWA-DEM architecture
Gx/Sd
ULI and specific per-sub,
per-app control via ASO override
Detailed
reporting
GGSN/PGW/
SSG/BNG (w/AA)
eNodeB SWG
For FWA on a 3GPP access network, the User Location Information (ULI) provided by the Policy and
Charging Rules Function (PCRF) at bearer setup time does not change while the bearer is active. For
FWA-DEM, the 3G, 4G or 5G cell is modeled as the congestion point.
Fixed residential networks may also be used for FWA on non-3GPP access networks. In these cases, the
FWA service may not even propagate ULI to the IP edge network termination point, which is typically a BNG.
In these cases the BNG should use NLB-DEM to manage congestion.
10 Application note
Dynamic Experience Management
Figure 6. Wi-Fi network congestion at the AP
Wi-Fi
access GRE/IPsec backhaul Core
Wi-Fi AP
radio WLAN-GW
with AA DEM
Increased penetration of Wi-Fi-enabled devices (for example, mobile handsets, tablets, laptops, and TVs)
and widespread use of streaming video result in frequent data plane congestion events in Wi-Fi networks.
This congestion results in service degradation for Wi-Fi subscribers attached to congested APs and creates
challenges in implementing fair usage policies to manage network congestion in the access network.
DEM provides the capability of managing Wi-Fi access congestion points at the WLAN-GW to provide some
level of QoS guarantees to different applications, which otherwise poses challenges as the loading of the
different APs at any point in time is different, both in quantity (bandwidth) and application types
(for example, video, web or mail).
WLAN-GW DEM relies on location information relayed by subscriber management attributes for the Access
Point MAC and VLAN. DEM uses the user location information to apply traffic management at specific
impacted access sites, while not restricting users during times of non-congestion. This ensures different
applications within an AP radio get their fair share of available resources, and controlling low-value traffic
during times of congestion.
DEM configuration
DEM congestion detection
For each subscriber or ANL in a DEM-GW deployment, the system detects the subscriber’s real-time
congestion level toward the access network. The system continuously measures RTT between the DEM-GW
and the subscriber’s device. DEM only measures subscriber side delay; servers exhibiting long response
delays or reached over very long WAN distances with high transmission delay will not trigger congestion
detection. Congestion detection is debounced for many seconds to avoid triggering on spurious events.
The algorithm includes hysteresis between the threshold for declaring congestion and the subsequent
level of measured RTT performance needed to clear the congestion state.
There are two configurable aspects to the DEM congestion detection algorithm:
threshold — This parameter is used by the DEM-GW algorithm to determine ANL congestion or subscriber
congestion in the case of NLB-DEM. It specifies the maximum acceptable RTT for connections under no
congestion. Any measured RTT above the threshold is considered an indication of possible congestion.
The DEM-GW auto-learns the normal RTT across the access to the network and uses it to derive the
congestion’s threshold. Alternatively, the operator can configure a static congestion threshold:
Values: integer 0 --500 ms – default 173 ms
If auto-threshold is enabled, the operator can configure a tolerance delay. The tolerance delay is added
to the auto-learned RTT to derive a value for the congestion RTT threshold.
When auto-congestion threshold is selected, the DEM-GW continuously makes adjustments to the RTT
norm threshold to ensure that it reflects changing environments.
11 Application note
Dynamic Experience Management
tolerance — This parameter is used by the DEM-GW algorithm to determine ANL level or subscriber level
congestion. It represents the ratio of RTTs above the configured threshold (rtt-threshold) over the total
RTT measurements.
i.e. rtt-threshold-tolerance = #(RTTs > rtt-threshold)/(Total #RTTs)
If the rtt-threshold-tolerance ratio is exceeded, then all ANL subscribers (or just one subscriber in the case
of NLB-DEM) are declared congested.
Values: integer 0 --100 % – default: 50%
12 Application note
Dynamic Experience Management
Similar to Time-of-Day (ToD) policers, per-subscriber congestion policers can be applied to all the traffic of a
subscriber or to some specific applications or application groups as configured in the matching section of AQPs.
The DEM congestion state can, if configured, trigger a policing override to the per-subscriber’s bandwidth
policers. When a subscriber is declared to be in a congestion state, the per-subscriber congestion policer
rates are triggered. This overrides any pre-existing per-subscriber policer rates, including ToD policer rates.
These per-subscriber congestion policer rates are applied for the duration of time that the subscriber is
in a congestion state. DEM allows the operator to optionally configure two sets of congestion policers to
be applied under two congestion conditions: mild congestion and/or severe congestion conditions. When
a congestion state transitions from “no congestion” to “congestion”, the “mild” congestion policers are
invoked, if configured. If the congestion state becomes severe, the second stage (severe) congestion
policers are invoked, if configured, overriding any prior policers.
If stage 2 congestion policers are not configured, the “mild” congestion policers are applied under all
congestion levels/states until the congestion is cleared. Under mild congestion state, the stage 2 policers
are only applied if there are configured “mild” congestion policers. Once the subscriber’s state is changed to
uncongested, the per-subscriber congestion policer rates are no longer applied to the subscriber’s traffic. The
adjusted policing limits are applied immediately to any pre-existing or new flows of the subscriber.
The per-subscriber congestion override policers are only applicable to bandwidth policers, both single
and dual leaky buckets. They are not applicable to per-subscriber flow count or flow rate policers.
To configure the per-subscriber bandwidth policer override rates, use the following commands:
• config>app-assure>group>policer>congestion-override
• config>app-assure>group>policer>congestion-override>cbs
• config>app-assure>group>policer>congestion-override>mbs
• config>app-assure>group>policer>congestion-override>pir
• config>app-assure>group>policer>congestion-override>cib
13 Application note
Dynamic Experience Management
Use cases and policy examples
Nokia DEM provides a flexible dynamic traffic management solution that is fully configurable by the
network operator to implement any desired policy. Some examples are shown in this section for illustration
purposes, but ultimately the network operator will define their own policies as suitable for their needs. The
policy control is implemented using operator-configured rules in the AA AQP, defined as part of AA using
match conditions and action rules. The AQP match conditions that are typically used for DEM policy include:
• app-group {eq | neq} <application-group-name>
• application {eq | neq} <application-name>
• characteristic <characteristic-name> eq <value-name>
• charging-group {eq | neq} <charging-group-name>
• traffic-direction {subscriber-to-network | network-to-subscriber | both}.
Note that most rules should include “app-groups” or “charging-group” instead of “application” match
condition, since this allows the same treatment for similar sets of applications, without targeting policy
to specific apps that change over time within an app-group, and without invoking treatment to specific
application content providers (e.g., manage streaming video, rather than YouTube in particular).
AQP action control mechanisms typically include: bandwidth-policer <policer-name> (other options are
possible for exception cases)
Once the AA DEM congestion detection algorithm determines congestion state, this instantly enables
any configured AA-sub congestion policer or ANL policer that is referenced in the AQP rule actions.
These policers can be used in AQP actions to implement application-aware control of the traffic including
UDP/QUIC (i.e., policer values can differ based on AG/App/CG).
For more information on configuring AA AQPs, see the Multi-Service Integrated Services Adapter user guide.
14 Application note
Dynamic Experience Management
An example for an AQP policy rule to block this traffic would be:
> entry # > match app-group eq “software update” action bandwidth-policer sub-rate-zero
Where that policer name is defined as a single-bucket subscriber policer with congestion-override
PIR= 0 kb/s (effectively blocking traffic)
2. AQP rules to limit per-subscriber streaming video to a specific per-subscriber rate such as 500
Mb/s, which will result in average bit rate (ABR) video downshifting to stream at approximately 480p
resolution. This rule is vital to enforce per-subscriber fairness for video rates within a congested
network, since existing connections already streaming at 4k or 1080p may continue to send at those
rates even while the network cannot accept any new sessions.
• AQP > entry # > match app-group eq “Multimedia Streaming” action bandwidth-policer sub-500
Where that policer name is defined as a single-bucket subscriber policer with congestion-override
PIR= 500 kb/s
2.1 Option: If congestion persists and becomes severe, policy can be configured to block all video
streaming traffic. This ensures that network resources are still available for mission-critical applications,
such as email, maps and browsing.
To achieve this, the “sub-500” bandwidth policer is configured with a stage 2 congestion-override
policer that has a PIR=0 kb/s (effectively blocking OTT video traffic).
3. AQP rules to limit per-subscriber total traffic (all apps including video) to a specific per-subscriber
rate such as 700 Mb/s. This rule is vital to enforce per-subscriber overall fairness within a congested
network independent of what application is being used.
• AQP > entry # > match any action bandwidth-policer sub-aggregate-700
Where that policer name is defined as a dual-bucket subscriber policer with congestion-override
PIR= 1000 kb/s and CIR = 700 kb/s (or whatever values are desired…)
4. Option: Specific applications requiring preferential QoE treatment from the remaining best effort traffic
could be separated out from the subscriber aggregate policer as illustrated in this example. Let’s say a
service provider has decided that an application (or a set of applications defined in custom App-Group
or Charging Group “Premium”) shall be exempt from DEM congestion rate limiting rules. This can be
implemented by mapping all other remaining applications into one app or charging group, with the
subscriber aggregate rate policer defined in the previous step conditioned to exclude this app-group.
• AQP > entry # > match app-group neq “Premium” action bandwidth-policer sub-aggregate-700
An example of an application or set of applications that could benefit a service provider by being
exempt from congestion management are applications that measure network performance.
5. Option: Specific subscribers requiring preferential QoE treatment could be separated out and excluded
from any policers as illustrated in this example. Let’s say a service provider has decided to offer a
“Priority” service. Those subscribers who opt in to this package shall be exempt from DEM congestion
rate limiting rules. This can be implemented by using application service option (ASO) characteristics
match conditions against an ASO policy attribute assigned to these subscribers, such as Characteristic
“Service” value “Priority”; then the policy rules:
• AQP > entry # > match characteristic neq “Priority” action bandwidth-policer sub-aggregate-700
(everyone without the Priority characteristic is policed)
15 Application note
Dynamic Experience Management
Location-based congestion control
For fixed wireless or WLAN-GW networks, DEM can track all the ANLs that subscribers are using and build a
real-time view of the maximum network capacity that is supported at each access location (independent of
vendor, technology, etc.). As shown in Figure 7 in the stacked chart on the left, when there is no congestion
there will typically be no network policy invoked, and DEM runs in the background, tracking network
capacity and per-user real-time user plane traffic performance.
When congestion events occur, congestion management policy prevents congestive throughput collapse
(caused by packet drops, TCP retransmissions, increased RAN latency, etc.). Congestion collapse of goodput
is shown in the center case.
100%
Retransmissions
80%
(variable by cell)
40%
0%
0% blocked non real-time apps:
• SW updates (device O/S, apps)
• P2P downloads
Multimedia streaming Peer-to-peer Instant messaging • FTP...
Web Email Social networking
OTT voice
With DEM control enabled, DEM control policy can be enforced at the total aggregate cell level as expressed
in terms of the percent of available bandwidth at the time of congestion, in addition to policy on a per-
subscriber basis. For example, the DEM policy may include:
1. AQP rules to block or significantly rate limit all non-real-time applications, since these generally do
not affect the user experience if they are delayed, and thus can wait until the network congestion is
alleviated. This would include
• “Software Update” App Group, key to managing large-scale congestion events triggered or
aggravated by IOS and Android device updates, or antivirus security updates
16 Application note
Dynamic Experience Management
• “Peer to Peer” App Group, since point-to-point apps are background scavenger apps that should
use excess bandwidth, not priority bandwidth under congestion
• “File transfer” App Group, such as FTP bulk data file transfers.
To achieve this, an example of AQP policy would be:
> entry # > match app-group eq “software update” action bandwidth-policer ANL-rate-5
Where that policer name is defined as granularity access-network-location with rate = 5%
2. AQP rules to limit streaming video application to 50% of the total bandwidth of each ANL (e.g., cell).
This limits the total amount of video across all subscribers to not exceed 50% of network capacity.
• AQP > entry # > match app-group eq “Multimedia Streaming” action bandwidth-policer anl-video-
congestion-50
Where that policer name is defined as granularity access-network-location with rate = 50%
3. AQP rules to limit per-subscriber streaming video to a specific per-subscriber rate such as 500 Mb/s,
which will result in ABR video downshifting to stream at approximately 480p resolution. This rule is
vital to enforce per-subscriber fairness within a congested network, since existing connections already
streaming at 4k or 1080p may continue to send at those rates even while the network cannot accept
any new sessions.
• AQP > entry # > match app-group eq “Multimedia Streaming” action bandwidth-policer sub-500
Where that policer name is defined as a single-bucket subscriber policer with congestion-override
PIR= 500 kb/s
3.1 Option: If congestion persists and becomes severe, policy can be configured to block all video
streaming traffic. This ensures that network resources are still available for mission-critical applications,
such as email, maps and browsing.
To achieve this, the “sub-500” bandwidth policer is configured with a stage 2 congestion-override
policer that has a PIR=0 kb/s (effectively blocking OTT video traffic).
4. Optional: rate limit consumer traffic vs higher priority emergency service or premium access point
name (APN) traffic.
To do this, define AQP rules to limit the total amount of consumer APN traffic for all remaining traffic
(app groups) to 30% of the available ANL capacity. APN traffic is not directly an AQP match criteria; this
would be implemented using an Application Service Option (ASO) characteristic name such as “APN”
with a value such as “Consumer”, and configuring PCC PRB policy statically or dynamically to assign
this ASO characteristic to any subscriber in the consumer APNs.
• AQP > entry # > match characteristic “APN” eq “Consumer” action bandwidth-policer anl-
congestion-30
Where that policer name is defined as granularity access-network-location with rate = 30%
In doing this, the remaining 20% of network capacity is reserved for other APNs that would include
emergency services or other premium APNs.
5. As with the video streaming case, for per-subscriber fairness within this traffic segment, the traffic within
the APN 30% ANL rate limit control should also be complemented by a per-subscriber AQP rate limit.
17 Application note
Dynamic Experience Management
DEM location-based analytics
Location-based analytics provides the operator with an accurate view of the subscriber’s location (ANL)
and application usage for a specified location in Wi-Fi networks for the purpose of data mining.
Capacity
80%
40%
20%
60% 0%
Capacity
40%
100%
80%
Capacity
60%
20%
40%
20%
0% 0%
To provide an accurate reporting of the subscriber location via analytics tools such as the Network Services
Platform, AA exports location information and congestion status in both volume and comprehensive
cflowd reports. The off-line cflowd collector then allows per ANL (Access Point and AP radio) per application
or application group statistics.
18 Application note
Dynamic Experience Management
Conclusion
The Nokia DEM solution is a tool enabling network operators to easily and effectively implement intelligent
access network congestion detection and control from within the IP networking user plane.
DEM active intelligent congestion control can be provided as:
• Location-based: cell site or AP-specific
– Only apply traffic management at the impacted sites
– Don’t restrict users during times of non-congestion
• Non-location-based
– When integrated with AA enforcement specific applications can be targeted for control based on
entitlements
– Provide notification to subscriber regarding service adjustment and network conditions (also input
into data offload decisions)
Using these capabilities, providers can flexibly mitigate network congestion:
• In real time without overbuilding the network
• Control/restrict relevant traffic by application during times of congestion
• Enforce subscriber fairness for access bandwidth use during congestion
• With location awareness, manage how different applications within a cell receive a fair share of available
resources.
Abbreviations
3GPP 3rd Generation Partnership Project
AA Application Assurance
ABR available bit rate
ANL access network location
AP access point
AQP Application QoS Policy
AR augmented reality
ASO application service option
BNG Broadband Network Gateway
CMG Cloud Mobile Gateway
CPC Cloud Packet Core
DEM Dynamic Experience Management
DEM-GW DEM Gateway
DPI deep packet inspection
GGSN Gateway GPRS Support Node
19 Application note
Dynamic Experience Management
IoT Internet of Things
LB-DEM location-based DEM
MTC machine-type communications
NLB-DEM non-location-based DEM
OTT over the top
PCC policy charging and control
PGW Packet Data Network Gateway
QoE quality of experience
QoS quality of service
RAN radio access network
RAT radio access technology
RNC radio network controller
SGSN Service GPRS Support Node
SR OS Service Router Operating System
SSG Subscriber Services Gateway
TDF Traffic Detection Function
ULI User Location Information
UPF User Plane Function
VR virtual reality
WLAN-GW Wireless LAN Gateway
About Nokia
We create the technology to connect the world. Powered by the research and innovation of Nokia Bell Labs, we serve communications service providers, governments, large
enterprises and consumers, with the industry’s most complete, end-to-end portfolio of products, services and licensing.
From the enabling infrastructure for 5G and the Internet of Things, to emerging applications in digital health, we are shaping the future of technology to transform the
human experience. networks.nokia.com
Nokia operates a policy of ongoing development and has made all reasonable efforts to ensure that the content of this document is adequate and free of material errors
and omissions. Nokia assumes no responsibility for any inaccuracies in this document and reserves the right to change, modify, transfer, or otherwise revise this publication
without notice.
Nokia is a registered trademark of Nokia Corporation. Other product and company names mentioned herein may be trademarks or trade names of their respective owners.
© 2019 Nokia
Nokia Oyj
Karaportti 3
FI-02610 Espoo, Finland
Tel. +358 (0) 10 44 88 000