Enterprise SONiC Distribution

by Dell Technologies
Technical Overview
 Course objectives

This course has been designed to help you:

• Describe the key features of Enterprise SONiC Distribution by
Dell Technologies
• Describe the advantages of our commercial distribution
• Recognize how to position Enterprise SONiC Distribution by
Dell Technologies and SmartFabric OS10
• Qualify opportunities for cloud and large enterprise

Internal Use - Confidential of231 © Copyright 2020 Dell Inc.

 Driving evolution in Open Networking
Traditional Open Open Source
Networking Networking Networking
Containerized apps

Networking Networking
OS OS Enterprise SONiC
Distribution by
Dell Technologies

Hardware Hardware Hardware

platforms platforms platforms

Aggregated hardware Disaggregated Disaggregated hardware and

and network hardware and network NOS + further disaggregation
operating system operating system of NOS and containers

Last several decades Since 2014 2020 onward

The first to offer this model Offering a commercial open source model

Internal Use - Confidential of331 © Copyright 2020 Dell Inc.

 Why do we need an Open Source NOS?
Openness to fuel innovation

Freedom and choice

Flexibility
Data center
Customization Compute
Modularity
Linux
Move fast
Data center
Growth Networking
Evolve Stifled growth
Innovate Closed NOS due to lack of
openness
Independence and control
No more proprietary solutions
Scalable
Cost effective

Internal Use - Confidential of431 © Copyright 2020 Dell Inc.

 Software for Open Networking in the Cloud

Control Extensibility Agility Collaboration

• SONiC is an open source software project under OCP.

Currently SONiC is running on
• SONiC is a network operating system with the seed code provided 40,000+ Azure switches.
by Microsoft.
• Current production deployments include Microsoft, hyper scalers
and SaaS.
• SONiC allows the operator to control the complexity of the data
center fabric by moving toward an automated, intent-based, API-
centric, and purpose-built containerized network.
Internal Use - Confidential of531 © Copyright 2020 Dell Inc.
 SONiC – network switch operations and management

Open and extensible Developer ready through Created for cloud Silicon vendors drive
Debian Linux-based and containerization, operations at scale. innovation exposed
standards-based protocols automation, API-centric. Real-world tested. Tens of through extensible SAI
and northbound interfaces Containers provide thousands of VMs scale. layer. Advanced telemetry
with OpenConfig, sandboxing, security, Hardened for multi- and deep analytics visible
REST/JSON and gRPC. portability, ease of tenancy. to applications.
Access to Linux tools and troubleshooting and Feature velocity no longer
third-party applications granular resource blocked by incumbent
management for network operating system
applications constraints

Internal Use - Confidential of631 © Copyright 2020 Dell Inc.

 Dell Technologies committed to the Community
By the numbers
 Dell Technologies + Broadcom largest team since inception
 Dell: 26 registered contributors; Broadcom, 32

 Dell Technologies contributed with 360+ pull requests

 PowerSwitch platforms: Z9100, Z9264, Z9332, S5232,

S5248, S5296. Planning to add a dozen more throughout Broadcom
2020

 Dell Technologies participates in several workgroups:

 Test Automation Framework, Dynamic Port Breakout,
SAI, Management Framework, SAI-5G, SAI-security, Dell
SAI-ECMP

 Contributions include:
 sFlow, Management VRF, ZTP, Platform API, Telemetry,
Management Framework
Developers 2016-2020
 Currently planning with the community projects to
undertake for the SONiC.202006 release

Internal Use - Confidential of731 © Copyright 2020 Dell Inc.

 Better together – Dell Technologies + SONiC

Innovative open source Market leader in

NOS for the cloud Open Networking

Container-based Proven and trusted leader

Incorporates a modular/micro services Leading-edge technology with thousands of
containerized architecture satisfied customers

Highly scalable History of innovation

Proven track record of simplifying the
Being used in hyper-scale networking by
installation, deployment and management
Microsoft, LinkedIn and Alibaba
of complex technology

Open and extensible Global support

Based on open source Debian Linux 24/7 fast response time in 165 countries
distribution with 60,000+ professionals

Internal Use - Confidential of831 © Copyright 2020 Dell Inc.

 Enterprise SONiC Distribution by Dell Technologies
Open source innovation
Enterprise and Network With a focused roadmap of networking
cloud datacenter management integrations across the protocol stack and
features building a ecosystem with partners like
Ansible, Augtera Networks, and Apstra

Enterprise
SONiC Enterprise and cloud datacenter ready
Partner Tested & With extensive testing, validation and
Distribution management options including hardware and
ecosystem validated
by Dell software and in hyper-scale environments
Technologies

Runs on Dell EMC PowerSwitch

Across a broad portfolio of 1GbE to 400GbE
Global Dell EMC platforms with market leading global support
HW/SW PowerSwitch and services
support HW

Internal Use - Confidential of931 © Copyright 2020 Dell Inc.

 Hardware and software support model
Proven and trusted leader SONiC for Enterprises
#1 in Open Networking for the last 5 years and moving to Open Source Networking Extensive testing and validation,
enterprise hardened NOS brings Cloud
network operating system to
Configuration and Containerized Open source enterprises
management tools applications applications
Dell Technologies ProSupport
• Global coverage
Software license • Mission critical and all the
Cloud version Enterprise version
and support supported SKUs for hardware
Enterprise SONiC Distribution • Dell EMC qualified optics
by Dell Technologies • POS – the hardware and SONiC
Global Support & support are tied for the same term
Services
Hardware 1 year
ProSupport 3 year Global support
5 year 24/7 fast response time in 165
PowerSwitch countries with 60,000+ professionals

Training resources
Merchant silicon • Comprehensive documentation
• Virtual lab
• Reference architectures and
white papers

Internal Use - Confidential of

1031 © Copyright 2020 Dell Inc.
 SONiC solutions for enterprise networks
Supported on Dell EMC PowerSwitch portfolio

Open Source components

Test and management
features:
• Platform onboarding
• Management infrastructure
(gNMI) PowerSwitch
• Build infrastructure

Partners and co-developers

Proprietary components

Standard NOS features:

• L2, L3, VxLAN
• Port channels, VLT Validated for enterprise network
• QoS, ACL, forwarding Packages deployments; supported by Dell EMC
services
• Other essential “NOS
features”

Internal Use - Confidential of

1131 © Copyright 2020 Dell Inc.
 Lifecycle management solution overview – CY2020
Q1 Q2 Q3 Q4

Design Fabric Design

Center

Deploy
*
SmartFabric
Director SmartFabric
Configure Director

* *
Operate OpenManage
Enterprise

Diagnose
*
*Best effort
Internal Use - Confidential of
1231 © Copyright 2020 Dell Inc.
 Enterprise SONiC Distribution at a glance
SmartFabric
Director
Ecosystem OpenManage Fabric Design
Enterprise Center
 Two licensed bundles Cloud Enterprise
 Cloud

Premium

Premium
 PTP  PTP
 Enterprise  Advanced Analytics  Advanced Analytics
IFA,
IFA, MoD
MoD IFA,
IFA, MoD
MoD
 Standard editions

Dell EMC Support

 Open-source
 Dell-specific services  Dell SupportAssist *  Dell SupportAssist *
 Management Plane  Management Plane
 Premium editions TACACS, RADIUS, ZTP, gNMI, REST, Same as Cloud
Standard

Standard
OpenConfig, CLI, Telemetry, RSPAN,
 Closed-source sFlow
 Control Plane
Same as Cloud plus:
 Proprietary services  Control Plane  VxLAN, EVPN, MLAG, RPVST+, IGMP
BGP, OSPF, ECMP, WRED, COPP, BFD,  * Multicast, RSTP, STP, MSTP, ECN,
VRF, LAG, LLDP, ACL, VRRP, PBR, UFD, ROCEv2
 Tiers of SKUs NAT

 Standard - Premium
 Port speed: 1G - 10G –
25/100G – 400G
 Subscription term: 1 – 3
Enterprise SONiC Distribution by Dell Technologies
– 5 years
Dell EMC PowerSwitch platforms
Internal Use - Confidential of
1331 © Copyright 2020 Dell Inc. *Roadmap post 3.0
 Current management models for Community SONiC

1 2 3 4
Config_db.json Minigraph.xml Python-based FRRouting (FRR)
• /etc/sonic • Legacy SONiC CLI • Layer 3
• Startup method • CLICK CLI protocols
• Loaded from a • Python click • Open source
configuration
server library • Protocols such
• Modify and • Currently • Configuration as BGP, OSPF
load deprecated and verification etc.

Disparate methods

NOT CENTRALIZED LEARNING CURVE MISCONFIGURATION CONFIG BACKUP

Internal Use - Confidential of

1431 © Copyright 2020 Dell Inc.
 Management Framework CLI for Enterprise SONiC

Centralized management

Intuitive CLI

Monitoring alerts gNMI

Misconfiguration prevention
CLI

Internal Use - Confidential of

1531 © Copyright 2020 Dell Inc.
 Important Enterprise SONiC Distribution features
sFlow Ansible
• Standards-based sampling technology • Network automation
• Monitor network traffic
• Consists of sFlow agent embedded in the
device and sFlow collector Zero-Touch Provisioning (ZTP)
• Switch firmware
EverFlow
• Configuration files
• Network telemetry system • Enable/disable of service
• “Match and mirror” functionality
• Use of ACL Security
Telemetry • RBAC
• Streaming telemetry using gNMI • TACACS+
• Enterprise SONiC supports only Dial-in mode • RADIUS
• Advanced telemetry such as Inband Flow Analysis,
Mirror on Drop and Congestion monitoring

Internal Use - Confidential of

1631 © Copyright 2020 Dell Inc.
 Customer use cases

Internal Use - Confidential of

1731 © Copyright 2020 Dell Inc.
 Server attach methods

Docker
containers
use case

Internal Use - Confidential of

1831 © Copyright 2020 Dell Inc.
 Multi-chassis LAG (MCLAG)
L2/L3
Peer-link
Advantages
• Active-active uplinks
• Redundant paths
• LACP MCLAG
SONiC SONiC
• Prevents wiring errors
• Resource utilization VRRP VRRP
• Single VTEP for leaf pair

Disadvantages
• Network complexity
• Higher costs
• Proprietary protocol
• Dedicated ICL interfaces

Servers
L2 Fabric with multi-chassis
link aggregation group

Internal Use - Confidential of

1931 © Copyright 2020 Dell Inc.
 Scale-out Layer 3 data center fabric (L3 underlay)
SONiC SONiC

VRF VRF

BGP

SONiC SONiC

MLAG MLAG
NIC NIC VRRP NIC NIC
teaming teaming teaming teaming

Internal Use - Confidential of

2031 © Copyright 2020 Dell Inc.
 Scale-out L2/L3 fabric (VxLAN + EVPN overlay)
SONiC SONiC

VRF VRF

BGP EVPN
VxLAN

el BGP
u nn EV
T ECMP PN
PN SONiC SONiC Tu
EV EVPN Tunnel EVPN Tunnel nn
el
Anycast GW Anycast GW
VTEP-1 VTEP-1 VTEP-2 VTEP-3 VTEP-4 VTEP-5 MLAG VTEP-5
MLAG
VRRP VRRP

Scale-out, data center architecture with L3 underlay and VxLAN overlay

Internal Use - Confidential of

2131 © Copyright 2020 Dell Inc.
 SaaS infrastructure
Mission-critical application infrastructure

Background and context

 Looking for an opportunity to move to an infrastructure that has a Internet
basic and simple underlay and build a smart overlay over it
 Seeking opportunities to reduce their growing Capex, OpEx and
add innovation
Fabric details
 eBGP fabric with AS path ignore and ECMP, with LLDP network
discovery
 100G spine with 100G leafs which have breakout capabilities SPINE SPINE SPINE SPINE
 gNMI interface for monitoring
 QoS with WRR scheduling on all switches
 Use of JSON for ZTP
 SONiC to SONiC image upgrade between peer switches
 All L3 interfaces should support jumbo frames, MTU 9000
 Warm reboot
 Critical Resource Monitoring(CRM) with gNMI

SONiC solution and benefits

 SONiC running on Open Network platform brings homogeneity
with respect to management and control plane, and hardware
independence.
 Benefits include fast turnaround time for fixes, and ability to use
open source contributions to address network issues.

Internal Use - Confidential of

2231 © Copyright 2020 Dell Inc.
 Layer 2 VxLAN
Underlay network Overlay networks
ASN 65000

Spine1 Spine2

VNI 510

VNI 500 VNI 520

ASN 65001 ASN 65003 VTEP

ASN 65031
VTEP VTEP

Leaf1 MCLAG Leaf2 Leaf3 MCLAG Leaf4 Leaf31 MCLAG Leaf32

Vtep1 10.10.10.1
VNI 500 GW Vtep3 10.10.10.3
VNI 500 GW Vtep31 10.10.10.31 Border Leafs
Vlan50 VNI 500 VNI 510 GW Vlan50 VNI 500 VNI 510 GW Vlan50 VNI 500
Vlan51 VNI 510 Vlan51 VNI 510 Vlan51 VNI 510
Vlan52 VNI 520 Portchannel1 Vlan52 VNI 520 Vlan52 VNI 520

VNI 520 GW
Server Server
Gateway/
Firewall
Server Server
VNI 500 GW VNI 500 Anycast gateway 192.168.50.254/24

VNI 510 GW VNI 510 Anycast gateway 192.168.51.254/24

VNI 520 GW VNI 520 Indirect gateway 192.168.52.254/24

Internal Use - Confidential of

2331 © Copyright 2020 Dell Inc.
 Layer 3 VxLAN – Multi-tenancy
Underlay network Overlay networks
ASN 65000

Spine1 Spine2
Vrf1 Vlan 61 VNI 610

Vrf2 Vlan62 VNI 620

ASN 65001 ASN 65003 VTEP

ASN 65031
VTEP VTEP

Leaf1 MCLAG Leaf2 Leaf3 MCLAG Leaf4 Leaf31 MCLAG Leaf32

Vtep1 10.10.10.1 VIP 192.168.81.254 Vtep3 10.10.10.3 VIP 192.168.31.254 Vtep31 10.10.10.31 Border Leafs
Vlan81 Vrf1 VIP 192.168.82.254 Vlan31 Vrf1 VIP 192.168.32.254 Vlan41 Vrf1
VIP 192.168.41.254 Vrf1
Vlan82 Vrf2 Vlan32 Vrf2 Vlan42 Vrf2
VIP 192.168.42.254 Vrf2
Portchannel1

Server Server
Gateway/
Server Server Firewall

VM Tenant Vrf1 VM Tenant Vrf1 VM Tenant Vrf1

VM Tenant Vrf2 VM Tenant Vrf2 VM Tenant Vrf2

Internal Use - Confidential of

2431 © Copyright 2020 Dell Inc.
 CI/HCI + Enterprise SONiC Distribution + NSX

• NOS – SONiC (Spine), OS10EE(Leaf)

• VMware Cloud Foundation (VCF) over Dell EMC Hyper Converged Infrastructure (VxRail) ESG – Edge Services Gateway
• VCF includes:
o SDDC Manager
o vSphere and the ESXi hypervisor for compute and memory virtualization
o vRealize Suite
o VSAN for storage virtualization on the hyperconverged hardware platform
o NSX for network virtualization

Internal Use - Confidential of

2531 © Copyright 2020 Dell Inc.
 Private cloud by xSP
For Service Provider: IaaS, PaaS
 Traditional storage and networking infrastructure
 Opportunities to reduce their growing CapEx, OpEx and add innovation

Fabric Details
 Complete Isolation of Availability zones for power and cooling isolation
 Overlay using VMWare NSX-T
 BGP underlay with IPv6, ECMP and routing to host
 1:1 Design – No Oversubscription
 Network Operating System: Enterprise SONiC Distribution by Dell Technologies
 Underlay: Repeated Localized Use of Addresses of v4
 NIC Teaming – No MC-LAG

Monitoring
 NTP (Stratum 2/3), AAA, TACACS+, SYSLOG, SNMP, SSH External
Network
 ERSPAN (EVERFLOW) to vRealize Suite
 Provide Topology Information, Traffic Visibility, Buffer Statistics, Correlation &
Anomaly Trending

Automation
 Localized Code Repository, CI Tool, Configuration Management, Runner,
and etc. for independent bring up per AZ. Playbooks, Jinja 2 Templates, Inventory
Generation Provided

SONiC Solution and Benefits

 SONiC running on Open Network platform brings homogeneity with respect to
management and control plane, and hardware independence.
 Benefits include fast turnaround time for fixes, and ability to use opensource
contributions to address network issues.
Internal Use - Confidential of
2631 © Copyright 2020 Dell Inc.
 OSS/Higher

Bare metal automation API

Layers

Cloud Manager
 SP Edge
Multi-site
 Greenfield data centers

MPLS/SD-WAN Network
Site 1
Dell switch Third-party
Dell switch Third-party SONiC SONiC SONiC
container container SONiC SONiC SONiC
Compute Compute Compute
Enterprise SONiC Enterprise SONiC Compute Compute Compute
Compute Compute Compute

Site 2 Site 3 Site n

• Third-party container used on SONiC for Edge automation

• Third-party container can bootstrap the Compute in the rack
• Multiple containers can be deployed with SONiC as per
Compute Compute requirement
• Deployed container can act as DHCP server and can host
SDN SDN configuration and small images
• HA configuration
Virtual infrastructure BMC Virtual infrastructure BMC
• Centralized controller can be used for wider management
SDS SDS and automation

Internal Use - Confidential of

2731 © Copyright 2020 Dell Inc.
 Dell Technologies Open Networking framework recap
Open Networking spectrum
More converged More disaggregated

1. Dell EMC networking stack: 2. Open Networking stack: 3. Disaggregated open

Full Dell EMC service and Dell EMC service and source stack: Dell EMC
support for hardware and support with warm hand- service and support for
software over to software partner hardware and software

SmartFabric
OS10 Enterprise SONiC
Distribution by
Dell Technologies

switching platforms

Maximizing customer choice, flexibility, and innovation at any scale

Internal Use - Confidential of

2831 © Copyright 2020 Dell Inc.
 When to recommend OS10 vs. Enterprise SONiC
Enterprise SONiC Distribution
  SmartFabric OS10
by Dell Technologies

Linux-based, multi-purpose OS Highly scalable and flexible open source-

featuring an industry-hardened based OS featuring a scalable and
networking stack with standard L2 flexible architecture based on containers
Description and L3 protocols over a standard and including L2 and L3 protocol support
CLI interface with an enterprise-class centralized
management infrastructure

- SMB and Commercial - Large enterprise, cloud-level

- 10s of nodes in fabric hyper-scale environments
Targeted
- Server attachment - 100s of nodes in fabric
use cases
- Integrated solutions - DevOps mentality
- Traditional SNMP monitoring - Advanced telemetry and analytics

Internal Use - Confidential of

2931 © Copyright 2020 Dell Inc.
 Resource links
Dell Technologies resources
• Enterprise SONiC Distribution by Dell Technologies Sales Portal
DellEMC.com/resources/en
-us/auth/products/networking/core-software-and-operating-systems/
enterprisesonic.htm

• Reach out to the team for questions: [email protected]

• Reach the team for engagements during controlled introduction

(until FY21Q3): [email protected]
Hands-on resources
SONiC Community resources
SONiC lab on DemoCenter.dell.com
• Community SONiC portal: Azure.github.io/SONiC
• Introduction to SONiC OS
• Community SONiC wiki: Github.com/Azure/SONiC/wiki • FRRouting with SONiC
• Community binaries – find the platform and appropriate binary: • BGP Communities
Github.com/Azure/SONiC/wiki/Supported-Devices-and-Platforms

Internal Use - Confidential of

3031 © Copyright 2020 Dell Inc.
 CALL TO ACTION

1 2 3
Start qualifying Position Highlight the
your cloud and SmartFabric advantages of
enterprise OS10 and Dell
customers SONiC Technologies +
appropriately SONiC
Internal Use - Confidential of
3131 © Copyright 2020 Dell Inc.