Network Function Virtualization (NFV) using IOS-XR
1Rpdssl
1Rpdssl
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Network</strong> <strong>Function</strong> <strong>Virtualization</strong><br />
(<strong>NFV</strong>) <strong>using</strong> <strong>IOS</strong>-<strong>XR</strong><br />
Rajendra Chayapathi & Syed Hassan<br />
BRKSPG-2724
Agenda<br />
• Role of <strong>NFV</strong> in EPN<br />
• <strong>NFV</strong> <strong>using</strong> <strong>IOS</strong>-<strong>XR</strong>:<br />
• <strong>IOS</strong> <strong>XR</strong>v<br />
• <strong>IOS</strong> <strong>XR</strong>v 9000 Router<br />
• Use case<br />
• Virtual Route Reflector & Virtual Provider Edge<br />
• Deployment & Troubleshooting<br />
• Summary
decouples<br />
network functions<br />
from proprietary hardware<br />
virtualization<br />
http://www.sdncentral.com/whats-network-functions-virtualization-nfv/
Customer Demand is Changing<br />
Rapid Deployment of New<br />
Business Applications<br />
On-Demand<br />
Bandwidth & Capacity<br />
Big Data & Analytics<br />
Anywhere/Anytime<br />
Secure Accessibility<br />
User Experience,<br />
Delivered<br />
Multi-Vendor Offerings;<br />
No Lock-In<br />
The New Customer Requirements<br />
PAYG Models<br />
On-Demand<br />
Solutions<br />
Multi-Platform<br />
Security &<br />
Compliance<br />
Seamless<br />
Connectivity
Entering a New Era in the SP <strong>Network</strong> Evolution<br />
Discontinuity #1:<br />
TDM limits new services,<br />
forces architectural shift<br />
Discontinuity #2:<br />
Commoditization of IP<br />
services plus high traffic<br />
growth limits profitability,<br />
forces architectural shift<br />
IP NGN Era<br />
Evolved Programmable<br />
<strong>Network</strong> (EPN) Era<br />
Open<br />
APIs<br />
Open<br />
APIs<br />
Services<br />
Applications and Services<br />
Resources<br />
Evolved Services Platform<br />
SDN Control<br />
TDM Era<br />
Evolved Programmable <strong>Network</strong> Infrastructure<br />
<strong>Network</strong> <strong>Function</strong><br />
<strong>Virtualization</strong><br />
IP unleashes new wave of<br />
innovation and service<br />
revenues<br />
Software Defined <strong>Network</strong>ing<br />
Service Orchestration
<strong>NFV</strong> in Evolved Programmable <strong>Network</strong> (EPN) Era<br />
<strong>Network</strong> <strong>Function</strong> <strong>Virtualization</strong><br />
Software Defined <strong>Network</strong>ing<br />
Service Orchestration<br />
Open and Dynamic<br />
Optimal resource utilization<br />
Accelerated innovation<br />
New services & revenues<br />
Reduced costs<br />
Reduced complexity<br />
Open<br />
APIs<br />
Open<br />
APIs<br />
Applications and Services<br />
Services Resources SDN Control<br />
Evolved Services Platform<br />
Evolved Programmable <strong>Network</strong> Infrastructure
<strong>NFV</strong> across Cisco portfolio<br />
Virtualized <strong>Network</strong> Operating Systems<br />
<strong>IOS</strong>-<strong>XR</strong> NX-OS <strong>IOS</strong>-XE<br />
ASA<br />
Virtualized in<br />
<strong>IOS</strong> <strong>XR</strong>v ,<br />
<strong>IOS</strong> <strong>XR</strong>v 9000<br />
Virtualized in<br />
Nexus 1000v<br />
Virtualized in<br />
CSR1000v<br />
Virtualized in<br />
ASAv
Cisco VNF Sample List …<br />
Available<br />
Available<br />
Announced<br />
Available<br />
Available<br />
Available<br />
Available<br />
Available<br />
CSR1Kv<br />
<strong>IOS</strong>-<strong>XR</strong>v<br />
<strong>IOS</strong>-<strong>XR</strong>v 9000<br />
Nexus1000v<br />
VTF (vPE-F)<br />
vWAAS<br />
vWLC<br />
vNAM<br />
<strong>Network</strong><br />
Infrastructure,<br />
Gateways,<br />
Applications<br />
Available<br />
ASAv<br />
Available<br />
QvPC-SI<br />
(vEPC)<br />
Available<br />
vSourceFire<br />
Available<br />
QvPC-DI<br />
(vEPC)<br />
Available<br />
vESA<br />
Available<br />
VDS-IS<br />
Available<br />
vWSA<br />
Available<br />
Cloud DVR<br />
Available<br />
vSCE<br />
Available<br />
Unified Comms<br />
Manager<br />
Available<br />
vNX-OS<br />
Available<br />
Unified Contact<br />
Centre / CC Exp.<br />
Radar<br />
X-Star<br />
(vBNG Control Plane /<br />
NG <strong>XR</strong> Control Plane)<br />
Available<br />
DDoS Radware<br />
Def. Pro / Arbor<br />
Radar<br />
vMX<br />
(Meraki)<br />
Available<br />
MCE8K<br />
(Video Conferencing)<br />
Available<br />
Available<br />
Available<br />
Available<br />
Available<br />
Available<br />
Available<br />
Available<br />
DC Controller<br />
(XNC)<br />
APIC-EM<br />
ODL/CDL<br />
WAE<br />
NCS/NSO<br />
ESC<br />
APIC<br />
Prime Service<br />
Catalog<br />
Management and<br />
Orchestration<br />
Available<br />
Available<br />
VTC CSM Prime <strong>Network</strong><br />
Available<br />
Intelligent<br />
Automation for<br />
Cloud<br />
Available<br />
Available<br />
Prime Central<br />
Available<br />
Prime <strong>Network</strong><br />
Service Controller<br />
Available<br />
Prime Performance<br />
Manager<br />
Available<br />
Prime Fulfillment<br />
Available<br />
Prime <strong>Network</strong><br />
Registrar<br />
Available<br />
Cisco Configuration<br />
Engine<br />
Available<br />
Prime Optical<br />
Available<br />
Prime Analytics<br />
Available<br />
Prime Provisioning<br />
Available<br />
CML (VIRL)<br />
Available<br />
Prime<br />
Infrastructure<br />
Available<br />
UCS Director<br />
Available<br />
Prime Access<br />
Registrar<br />
Available<br />
Prime IP Express,<br />
Prime Home<br />
Available<br />
Cisco Multicast<br />
Manager<br />
Available<br />
CTCM<br />
(Stratos/Diadem)<br />
Available<br />
Cisco Process<br />
Orchestrator<br />
Available<br />
QvBN<br />
Available<br />
Quantum Policy<br />
(BroadHop)<br />
Available<br />
Tidal Enterprise<br />
Scheduler
<strong>Network</strong> <strong>Function</strong>s <strong>Virtualization</strong><br />
<strong>Network</strong> infrastructure/Service <strong>Function</strong>s run on<br />
Virtualized x86 compute platforms<br />
• Key Enabler: Cloud technology<br />
• Hypervisor & x86 compute hardware<br />
• <strong>Network</strong> Programmability APIs<br />
• <strong>Network</strong> Automation / Orchestration<br />
Apps &<br />
Open<br />
Innovation<br />
SDN<br />
<strong>NFV</strong>
<strong>Network</strong> <strong>Function</strong>s <strong>Virtualization</strong><br />
Where is SDN?<br />
• SDN complementary, but not mandatory<br />
• <strong>NFV</strong> is not SDN, though they have commonalities<br />
• Complementary / Orthogonal concepts<br />
Apps &<br />
Open<br />
Innovation<br />
<strong>NFV</strong><br />
SDN<br />
Programmability<br />
Split Architecture<br />
Abstraction<br />
CP: Central Processing<br />
DP: Distributed Processing<br />
SDN<br />
SDN Software (CP)<br />
Virtual <strong>Network</strong>s (DP)<br />
Physical <strong>Network</strong><br />
<strong>NFV</strong><br />
VNF Software (CP)<br />
Virtual Hardware (DP)<br />
Physical IT Hardware
SDN & <strong>NFV</strong><br />
Comparison<br />
SDN<br />
SDN Controller :<br />
Open Daylight, Open SDN Controller(OSC) etc.<br />
OpenFlow, NETCONF/Yang , Path computation<br />
element protocol (PCEP)<br />
Involves end to end networking<br />
New network architecture<br />
<strong>NFV</strong><br />
Virtual network functions :<br />
vFW, vRR, vCPE , vPE etc.<br />
VM to Host (socket, Taps etc.)<br />
Involves single network entity<br />
<strong>Virtualization</strong> of existing architecture
Virtualizing <strong>Network</strong> <strong>Function</strong>s<br />
X86 versus Custom <strong>Network</strong> Processing Unit (NPU)<br />
<strong>Network</strong> Forwarding (L0-3)<br />
Mostly predictable traffic<br />
Stateless functions<br />
High throughput / BW<br />
IPv6/v4, MPLS, VPNs, Optical<br />
<strong>Network</strong> Services (L4+)<br />
Unpredictable traffic<br />
Stateful functions<br />
Low to Med Throughput<br />
BGP Route reflector, Firewall,<br />
DPI<br />
Better fit for NPU<br />
Compute<br />
Bandwidth<br />
Better fit for x86<br />
Compute<br />
Bandwidth
<strong>NFV</strong> Use-Cases<br />
Use-Cases<br />
Description<br />
1 Virtual Route Reflector Virtualized BGP RR delivered on demand<br />
2 Virtual PE Router Fully virtualized PE router delivered as an on demand cloud service<br />
3 Virtual Private Cloud<br />
Single-tier, 2-tier, 3-tier applications with optional <strong>NFV</strong> service chaining attached<br />
to customer L3 VPN<br />
4 Virtualized Mobility Service vEPC, GiLAN delivered as cloud based service<br />
5 Hosted Collaboration Service<br />
Integrating HCS provisioning with VPN configuration for single click customer<br />
deployment<br />
6 Virtualized Video Headend Cloud DVR, CDN/streaming as a service<br />
7 Routing-as-a-service Using CSR to deliver routing/BNG as a cloud service<br />
8 Virtual BNG in the cloud High-scale (multi-million subscribers) BNG control plane in the cloud<br />
9 Virtual Managed Services<br />
10 vWLC, vWAAS, vNAM, vSCE .. .. ..<br />
Using CSR, ASAv to deliver managed services to enterprise customers<br />
(attached to customer L3VPN)
<strong>IOS</strong> <strong>XR</strong>v
<strong>Network</strong> <strong>Virtualization</strong><br />
• Applications and running<br />
<strong>using</strong> virtualized Hardware<br />
end CPUs<br />
• Guest O/S running<br />
independently in each VM<br />
Virtual Machines<br />
Guest O/S<br />
• HyperVisor - isolated<br />
application providing VMs on<br />
the Host<br />
/<br />
QEMU<br />
HyperVisor<br />
• Basic host operating system<br />
Host O/S<br />
• <strong>Virtualization</strong> capable CPUs<br />
Physical Host
<strong>IOS</strong> <strong>XR</strong><br />
• Time tested for years<br />
• CRS-1, CRS-3, CRS-X, ASR 9000<br />
• High-scale control plane<br />
• MicroKernel-based<br />
• Modular Software<br />
• Process Restartability<br />
• PIE and SMU activation without reloading the VM<br />
<strong>IOS</strong> <strong>XR</strong><br />
QNX Kernel<br />
Physical Hardware:<br />
CPU, ASICs, NIC,<br />
Consoles, Memory, HDD
<strong>IOS</strong> <strong>XR</strong>v<br />
• <strong>IOS</strong> <strong>XR</strong> on x86 Virtualized environment<br />
• Full Platform Independent <strong>IOS</strong> <strong>XR</strong><br />
• Same <strong>IOS</strong> <strong>XR</strong> software feature set<br />
• Manageability<br />
• Control Plane<br />
• Routing<br />
Host OS<br />
Physical Hardware:<br />
CPU, ASICs, NIC, Consoles, Memory, HDD<br />
<strong>IOS</strong> <strong>XR</strong>v<br />
Guest OS (32bit Linux)<br />
HyperVisor
<strong>IOS</strong> <strong>XR</strong>v<br />
Other Guest OS<br />
HyperVisor<br />
<strong>IOS</strong> <strong>XR</strong>v #2<br />
Guest OS (32bit Linux)<br />
HyperVisor<br />
Host OS<br />
Physical Hardware:<br />
CPU, ASICs, NIC, Consoles, Memory, HDD<br />
<strong>IOS</strong> <strong>XR</strong>v #1<br />
Guest OS (32bit Linux)<br />
HyperVisor
<strong>IOS</strong> <strong>XR</strong>v 9000
<strong>IOS</strong> <strong>XR</strong>v 9000<br />
• Virtualized <strong>IOS</strong> <strong>XR</strong> with Control and Data plane Separation<br />
• Linux Containers for Admin, Control and Data Planes<br />
• Scalability through Flexible resource Allocation<br />
• Data plane scalability.<br />
• Control Plane scalability<br />
Host OS<br />
Physical Hardware:<br />
CPU, ASICs, NIC, Consoles, Memory, HDD<br />
<strong>IOS</strong> <strong>XR</strong>v<br />
Guest OS (64bit Linux)<br />
HyperVisor
Cisco <strong>IOS</strong> <strong>XR</strong>v 9000<br />
Right sizing Scale and Throughput through Control and Data Planes<br />
Present Mode of Operation<br />
Routers + LCs<br />
<strong>IOS</strong> <strong>XR</strong><br />
Future Mode of Operation<br />
Virtual Routers<br />
Routers/Compute <strong>IOS</strong> <strong>XR</strong>v 9000<br />
Compute<br />
RP(Control Plane)<br />
LC (Data Plane)<br />
1xCPU : NxLCs<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
MxCPU : N x NPU<br />
Compute Server<br />
(Control Plane)<br />
Compute Server<br />
(Control Plane)<br />
Compute Server<br />
(Control Plane)
Cisco <strong>IOS</strong> <strong>XR</strong>v 9000<br />
Data Plane Controller & Agent<br />
Routers/Compute<br />
<strong>IOS</strong> <strong>XR</strong>v 9000<br />
Compute<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
LC (Data Plane)<br />
Compute<br />
Compute<br />
Compute Compute<br />
Compute<br />
Compute<br />
Compute<br />
Data Plane Agent<br />
(DPA)<br />
Low level forwarding<br />
objects<br />
Data Plane<br />
Controller<br />
(DPC)
Cisco <strong>IOS</strong> <strong>XR</strong>v 9000<br />
Evolution through Data Plane Controller & Agent<br />
Abstraction Layer (NetConf / YANG / SDN APIs)<br />
<strong>IOS</strong> <strong>XR</strong><br />
<strong>IOS</strong> <strong>XR</strong><br />
<strong>IOS</strong> <strong>XR</strong><br />
<strong>IOS</strong> <strong>XR</strong> DPC<br />
DPC<br />
DPC<br />
DPC<br />
DPA Forwarding Agent<br />
Physical Dataplanes<br />
Virtual <strong>XR</strong><br />
Dataplanes<br />
Virtual<br />
<strong>XR</strong> DP<br />
Physical Merchant Silicon
Cisco <strong>IOS</strong> <strong>XR</strong>v 9000<br />
Design Trade Offs<br />
Possible to degrade<br />
overall performance<br />
by improving<br />
performance for one<br />
particular metric<br />
Physical <strong>XR</strong> Router<br />
<strong>IOS</strong> <strong>XR</strong>v 9000<br />
Virtual Router X<br />
Features<br />
Performance:<br />
ACE, TM, &<br />
Queues
<strong>IOS</strong> <strong>XR</strong>v 9000 Positioning<br />
Completing the <strong>XR</strong> Edge Portfolio<br />
32768<br />
8192<br />
2048<br />
512<br />
128<br />
32<br />
<strong>IOS</strong> <strong>XR</strong>v 9000 ASR 9001 ASR 9006<br />
ASR 9904<br />
ASR 9010<br />
ASR 9912<br />
ASR 9922<br />
Virtual<br />
<strong>XR</strong> DP<br />
8<br />
2
Benefits & Use Cases
<strong>IOS</strong> <strong>XR</strong>v & <strong>IOS</strong> <strong>XR</strong>v 9000<br />
Benefits<br />
Lower<br />
Opex<br />
• Easy<br />
provisioning ,<br />
configuration<br />
&<br />
deployment<br />
for VMs<br />
Lower<br />
Capex<br />
• <strong>IOS</strong> <strong>XR</strong>v on<br />
standard<br />
compute<br />
resources<br />
Small<br />
Footprint<br />
• Multiple <strong>XR</strong>s<br />
on same<br />
device<br />
Greener<br />
• low power<br />
consumption<br />
Lower<br />
carbon<br />
footprint<br />
Flexible<br />
Growth<br />
• CP & DP<br />
Separation<br />
and<br />
independent<br />
resource<br />
allocation<br />
SDN<br />
Ready<br />
• Independent<br />
control and<br />
forwarding
Use Cases<br />
Education and<br />
Training<br />
<strong>Network</strong><br />
Simulation<br />
<strong>Network</strong><br />
Deployment
<strong>XR</strong>v<br />
Use Cases: `<br />
Training & Education<br />
Students Need “Hands-On”<br />
Experience<br />
Virtualized OS<br />
1 student : 10 routers<br />
Scalable resources<br />
OS on Hardware<br />
10 students : 1 router<br />
Limited hardware<br />
<strong>XR</strong> Routers
Use Cases:<br />
<strong>Network</strong> Simulation & modeling<br />
Test & Try new control-plane capabilities<br />
Evaluate network against failures<br />
Design & plan changes and new features<br />
Equipment Cost<br />
Setup Time<br />
Cumbersome to change<br />
Low Cost<br />
Easy Orchestration<br />
Quick setup & changes<br />
Lab validation <strong>XR</strong>v / 9000
Use Cases:<br />
<strong>Network</strong> Deployment (vRR & vPE)<br />
• Consumption based model - <strong>Network</strong> growth to match needs<br />
• Redundant devices provisioning without added cost<br />
• Service segregation on same hardware<br />
• Grow and scale VM’s server resources to match needs<br />
vRR<br />
1<br />
vPE<br />
1<br />
vRR2<br />
vPE2<br />
vRR<br />
1<br />
vPE1
Virtual Route Reflector<br />
(vRR)<br />
&<br />
Virtual Provider Edge<br />
(vPE)
<strong>IOS</strong> <strong>XR</strong>v as vRR<br />
• Traditional Role of RR<br />
• BGP peering<br />
• Solve N*N full-mesh BGP interconnect<br />
• Distribute BGP routes to PEs<br />
NxN<br />
Nx1 +<br />
redundancy<br />
Nx1<br />
Nx1 + Segregation
<strong>IOS</strong> <strong>XR</strong>v as vRR<br />
RR role expanding -<br />
centralized provision, services, and applications<br />
Per Service<br />
Per Address Family<br />
Redundant<br />
Optimized Placement<br />
Primary<br />
Backup<br />
L2VPN RR<br />
L3VPN RR<br />
Vpnv4 RR<br />
IPv6 RR<br />
IPv4 RR<br />
Scalable<br />
Easy Provisioning
<strong>IOS</strong> <strong>XR</strong>v as vRR<br />
Primary Backup<br />
IPv4 RR<br />
Vpnv4 RR<br />
IPv6 RR<br />
L2vpn vRR<br />
8 Physical Devices<br />
Primary Backup<br />
IPv4 vRR<br />
Vpnv4 vRR<br />
IPv6 vRR<br />
L2vpn vRR<br />
2 Physical Devices<br />
Virtualized RRs per AFI<br />
Without Compromising<br />
Performance<br />
(Multi-Core)<br />
Independent<br />
Operation<br />
High<br />
Availability<br />
Same BGP<br />
Implementati<br />
on (<strong>XR</strong>)
<strong>IOS</strong> <strong>XR</strong>v as vPE<br />
<strong>IOS</strong> <strong>XR</strong><br />
<strong>IOS</strong> <strong>XR</strong>v 9000<br />
Virtual<br />
<strong>XR</strong> DP<br />
Virtual<br />
<strong>XR</strong> DP<br />
Virtual<br />
<strong>XR</strong> DP<br />
<strong>IOS</strong> <strong>XR</strong><br />
Forwarding<br />
Performance<br />
(Multi-Core)<br />
Consumption<br />
Based Growth<br />
Control Plane<br />
&<br />
High-Performance<br />
Data Plane<br />
High Availability
vRR & vPE <strong>using</strong> <strong>IOS</strong> <strong>XR</strong><br />
Performance<br />
(Multi-Core)<br />
Independent<br />
Operation<br />
High<br />
Availability<br />
<strong>IOS</strong> <strong>XR</strong> Based<br />
Implementation<br />
Resource<br />
Allocation<br />
Flexibility<br />
(CPU/Memory)<br />
Portability &<br />
Agility<br />
Route<br />
Scalability<br />
(32/64b OS)<br />
Management<br />
&<br />
Orchestration<br />
Lower<br />
Opex/Capex
vRR & vPE <strong>using</strong> <strong>IOS</strong> <strong>XR</strong><br />
Primary Backup<br />
Primary Backup<br />
Physical Router<br />
VRR on UCS Server<br />
Max. Power consumption ~425W Max Power consumption ~410W<br />
Total power for 8 instance ~3.4kW Total power for 8 instances ~820W<br />
Power/Year = 29,785 KWh<br />
Power Cost/Year = $5,659<br />
(19c/kWh)<br />
Power/Year = 7,182 KWh<br />
Power Cost/Year= $1,364<br />
(19c/KWh)<br />
Power Calculations based on<br />
ASR9001 (Max Power)<br />
UCS C240 M3 SFF with Intel E5-2643 v2 3.30 GHz/130W 6C/25MB Cache/DDR3 1866MHz with 96 GB Mem, 4 HDD<br />
with RAID, and 1 Adapters.
CPU, GB, bps<br />
CPU, GB, bps<br />
Physical <strong>Network</strong> Device vs <strong>NFV</strong><br />
Consumption Based Deployment<br />
Physical <strong>Network</strong> Device<br />
<strong>NFV</strong>
<strong>IOS</strong> <strong>XR</strong>v Deployment
<strong>IOS</strong> <strong>XR</strong>v Flavors<br />
Demo<br />
iosxrv[-k9]-demo.vmdk/ova<br />
Simulation<br />
iosxrv[-k9].vmdk/ova<br />
Production<br />
iosxrv[-k9].vmdk/ova<br />
• <strong>XR</strong> Familiarization<br />
• Free<br />
• Limited Performance (2Mbps Rate Limit)<br />
• Anti-Security (Hard Coded AAA Users)<br />
• No Support<br />
• <strong>Network</strong> Modeling<br />
• 1-3 years license<br />
• Enhanced Performance (50Mbps Rate Limit)<br />
• TAC Supported<br />
• Deploy as product<br />
• vRR Application<br />
• 1-3 years license<br />
• Full Performance (no Rate Limit)<br />
• TAC Supported<br />
Training &<br />
Education<br />
Staging &<br />
Testing<br />
Production<br />
https://upload.cisco.com/cgi-bin/swc/fileexg/main.cgi?CONTYPES=Cisco-<strong>IOS</strong>-<strong>XR</strong>v
<strong>IOS</strong> <strong>XR</strong>v Licenses<br />
Address Family<br />
Feature Sets<br />
Scale<br />
Term<br />
Length<br />
Base:<br />
BGP, IPv4/v6,<br />
Mcast<br />
Low(1M)<br />
1 year<br />
Advanced:<br />
MP-BGP,<br />
MPLS-VPN,<br />
Mcast VPN<br />
Medium<br />
(4M)<br />
High (No<br />
limit)<br />
3 years<br />
L-<strong>XR</strong>V-RR-A-L-1YR
<strong>IOS</strong> <strong>XR</strong>v Hardware/Software Requirements<br />
• Hardware<br />
• Any x86-based server capable of virtualization<br />
• e.g. Intel® CPUs with VT-x support<br />
• Hypervisor<br />
• VMWare ESXi 5.x , QEMU/KVM 1.0<br />
Parameter<br />
CPU (Cores) 1<br />
Memory (RAM)<br />
Hard Disk<br />
Serial Port<br />
NIC Port (E1000/VirtIO) 1<br />
3GB<br />
1x 2GB<br />
Minimum<br />
1 (for console)
<strong>IOS</strong> <strong>XR</strong>v 9000 Hardware/Software Requirements<br />
• Hardware<br />
• Any x86-based server capable of virtualization<br />
• e.g. Intel® CPUs with VT-x support<br />
• Hypervisor<br />
• VMWare ESXi 5.5 , QEMU/KVM 1.0<br />
Parameter<br />
CPU (Cores) 2<br />
Memory (RAM)<br />
Hard Disk<br />
Serial Port<br />
NIC Port (E1000/VirtIO/Niantic 10G<br />
)<br />
12GB<br />
5GB<br />
1 (for console)<br />
2<br />
Minimum
<strong>IOS</strong> <strong>XR</strong>v Features<br />
• <strong>IOS</strong> <strong>XR</strong> Manageability & Control Plane<br />
• PIE/SMU Upgrades<br />
• NTP, EIGRP, ISIS, OSPF, MPLS (LDP/TE)….<br />
• BGP<br />
• AFI / SAFI<br />
• Unicast, Mcast, LS, MDT(mVPN), VPLS, L3VPN ….<br />
• Multi-Instance BGP<br />
• Route Policy Language (RPL)
<strong>IOS</strong> <strong>XR</strong>v 9000 Features<br />
• OSPF/ISIS,<br />
• MP-BGP/eBGP , BGP 3107<br />
• BFD<br />
• LDP/MPLS, 6PE, 6vPE, RFC 3107 (3 labels), L3VPN<br />
• IPv4 ACL (chained), uRPFv4/v6, LPTS<br />
• Netconf/YANG & SNMP<br />
• Hierarchical QoS policing, WRED<br />
• EFD<br />
(Bidirectional Forwarding Detection)<br />
(Early Fast Discard)<br />
• Lawful Intercept
<strong>XR</strong>v Example Scale<br />
Address<br />
Family<br />
eBGP Sessions Routes per Session Total Routes<br />
IPv4 200 4000 800,000<br />
IPv6 50 4000 200,000<br />
Address<br />
Family<br />
Sessions Routes per Session Total Routes<br />
VPNv4 250 8400 2,100,000<br />
VPNv6 50 2000 100,000<br />
<strong>IOS</strong> <strong>XR</strong>v : version 5.1.1
<strong>XR</strong>v 9000 Example Scale<br />
Address<br />
Family<br />
eBGP Sessions OSPF Routes Total Routes<br />
IPv4 5000 40,000 4,000,000<br />
IPv6 2000 - 2,000,000<br />
<strong>IOS</strong> <strong>XR</strong>v 9000 : subjected to change
<strong>IOS</strong> <strong>XR</strong>v 9000 Performance<br />
<strong>XR</strong>v CP <strong>XR</strong>v CP <strong>XR</strong>v CP<br />
<strong>XR</strong>v CP <strong>XR</strong>v CP <strong>XR</strong>v CP<br />
40<br />
GPBS<br />
8<br />
GPBS<br />
160<br />
GPBS<br />
40<br />
GPBS<br />
?<br />
GPBS<br />
Vanilla IPv4<br />
IMIX traffic packet size<br />
with features enabled<br />
<strong>XR</strong>v CP<br />
<strong>XR</strong>v CP<br />
?<br />
GPBS<br />
Single Core Multi-Core Multi-Socket Multi-Server<br />
2015<br />
2015 2016+
<strong>IOS</strong> <strong>XR</strong>v Bring-Up<br />
Physical Interfaces<br />
Virtual Interface<br />
Virtual Interface<br />
Virtual Machine<br />
Host<br />
Eth0<br />
Mgmt<br />
Bridge<br />
Tap 01<br />
Mgmt<br />
Eth1<br />
Eth2<br />
Data<br />
Bridge-1<br />
Data<br />
Bridge-2<br />
Tap 02<br />
Tap 03<br />
G0/0/0/0<br />
G0/0/0/1<br />
G0/0/0/2<br />
<strong>XR</strong>v<br />
Copy <strong>XR</strong>v 9000<br />
image (.iso/.vmdk)<br />
on server<br />
Create Virtual (Tap)<br />
interfaces<br />
Start simulation
Passthrough<br />
Passthrough vs Device Emulation<br />
Guest OS (VM)<br />
Physical driver<br />
Guest OS(VM)<br />
Guest driver<br />
Hypervisor<br />
Hypervisor<br />
Emulated device<br />
Physical driver<br />
Physical device<br />
Hardware Platform<br />
Hardware Platform<br />
Physical device
<strong>XR</strong>v 9000 Bring-Up<br />
Hypervisor Interface<br />
Data Plane<br />
Control Plane<br />
Physical Interfaces<br />
Virtual Interface<br />
Virtual Interface<br />
Virtual Machine<br />
Admin Plane<br />
Host<br />
Sysadmin<br />
Eth0<br />
Mgmt<br />
Bridge<br />
Tap 01<br />
Mgmt<br />
<strong>XR</strong> (DPC)<br />
Eth1<br />
Eth2<br />
Data<br />
Bridge-1<br />
Tap 02<br />
Tap 03<br />
G0/0/0/0<br />
G0/0/0/1<br />
G0/0/0/2<br />
<strong>XR</strong> (DPA)<br />
Copy <strong>XR</strong>v 9000<br />
image (.iso/.vmdk)<br />
on server<br />
Create Virtual (Tap)<br />
interfaces<br />
Start simulation
<strong>IOS</strong> <strong>XR</strong>v Bring-up<br />
Creating TAP and Bridge<br />
cisco@epn-sjcj-ucs1:~$ sudo tunctl -t Tap1<br />
Set 'Tap1' persistent and owned by uid 0<br />
cisco@epn-sjcj-ucs1:~$ sudo tunctl -t Tap2<br />
Set 'Tap2' persistent and owned by uid 0<br />
cisco@epn-sjcj-ucs1:~$ sudo ifconfig Tap1 up<br />
cisco@epn-sjcj-ucs1:~$ sudo ifconfig Tap2 up<br />
cisco@epn-sjcj-ucs1:~$ sudo brctl addbr vRR-bridge<br />
cisco@epn-sjcj-ucs1:~$ sudo brctl addif vRR-bridge Tap1<br />
cisco@epn-sjcj-ucs1:~$ sudo brctl addif vRR-bridge Tap1<br />
cisco@epn-sjcj-ucs1:~$ brctl show<br />
bridge name bridge id STP enabled interfaces<br />
vRR-bridge 8000.72ee4e89d284 no Tap1<br />
Tap2
<strong>IOS</strong> <strong>XR</strong>v Bring-up<br />
Launching the <strong>IOS</strong> <strong>XR</strong>v Virtual Machine<br />
cisco@epn-sjcj-ucs1:~$ sudo /usr/bin/qemu-system-x86_64 \\<br />
-m 4024 \\<br />
-name <strong>XR</strong>v-Test-Launch \\<br />
-hda /home/cisco/iosxrv-k9.vmdk-5.1.1-3 \\<br />
-serial telnet:0.0.0.0:2345,server,nowait \\<br />
-device e1000,netdev=first-intf \\<br />
-netdev tap,ifname=Tap1,script=no,downscript=no,id=first-intf \\<br />
-device e1000,netdev=second-intf \\<br />
-netdev tap,ifname=Tap2,script=no,downscript=no,id=second-intf \\<br />
-nographic -no-kvm<br />
4G Memory<br />
<strong>XR</strong>v Instance<br />
<strong>XR</strong>v Image File<br />
Console port<br />
Ethernet (Mgmt)<br />
Ethernet (GigE)
<strong>IOS</strong> <strong>XR</strong>v Bring-up<br />
Accessing the <strong>IOS</strong> <strong>XR</strong>v Virtual Machine<br />
cisco@epn-sjcj-ucs1:~$ telnet 10.29.212.225 2345
<strong>IOS</strong> <strong>XR</strong>v Deployment<br />
Accessing the <strong>IOS</strong> <strong>XR</strong>v Virtual Machine<br />
cisco@epn-sjcj-ucs1:~$ telnet 10.29.212.225 2345<br />
RP/0/0/CPU0:Apr 13 22:17:30.093 : ike[226]: %SECURITY-IKE-4-WARNING : You may want to<br />
configure a domain-name<br />
!!!!!!!!!!!!!!!!!!!! NO root-system username is configured. Need to configure rootsystem<br />
username. !!!!!!!!!!!!!!!!!!!!<br />
--- Administrative User Dialog ---<br />
Enter root-system username: test-user<br />
Enter secret:<br />
Use the 'admin' mode 'configure' command to modify this configuration.<br />
IMPORTANT: READ CAREFULLY<br />
Welcome to the Demo Version of Cisco <strong>IOS</strong> <strong>XR</strong>v (the "Software").<br />
The Software is subject to and governed by the terms and conditions
<strong>IOS</strong> <strong>XR</strong>v Deployment<br />
Configuring and accepting production license<br />
RP/0/0/CPU0:ios#conf t<br />
RP/0/0/CPU0:ios(config)#platform mode production accept-eula<br />
RP/0/0/CPU0:ios(config)#commit<br />
Sun Apr 13 22:21:38.316 UTC<br />
RP/0/0/CPU0:Apr 13 22:21:38.526 : xrvr_lic_mgr[397]: %OS-<strong>IOS</strong><strong>XR</strong>V_LIC_MGR-3-EULA_ACCEPTED<br />
: End User License Agreement accepted. Welcome to the Production Version of Cisco <strong>IOS</strong><br />
<strong>XR</strong>v.<br />
RP/0/0/CPU0:ios(config)#end<br />
………<br />
Press RETURN to get started.<br />
IMPORTANT: READ CAREFULLY<br />
Welcome to the Production Version of Cisco <strong>IOS</strong> <strong>XR</strong>v (the "Software").<br />
The Software is subject to and governed by the terms and conditions
<strong>IOS</strong> <strong>XR</strong>v Deployment<br />
Show Commands<br />
RP/0/0/CPU0:ios#show ver<br />
Cisco <strong>IOS</strong> <strong>XR</strong> Software, Version 5.1.1[Default]<br />
Copyright (c) 2014 by Cisco Systems, Inc.<br />
ROM: GRUB, Version 1.99(0), DEV RELEASE<br />
ios uptime is 39 minutes<br />
System image file is "bootflash:disk0/xrvr-os-mbi-5.1.1/mbixrvr-rp.vm"<br />
cisco <strong>IOS</strong> <strong>XR</strong>v Series (AMD 686 F6M2S3) processor with 4120177K bytes of memory.<br />
AMD 686 F6M2S3 processor at 2820MHz, Revision 2.174<br />
<strong>IOS</strong> <strong>XR</strong>v Chassis<br />
2 GigabitEthernet<br />
1 Management Ethernet<br />
96050k bytes of non-volatile configuration memory.<br />
866M bytes of hard disk.
<strong>IOS</strong> <strong>XR</strong>v Deployment<br />
Show Commands<br />
Single RP. No LineCard<br />
RP/0/0/CPU0:ios#show platform<br />
Sun Apr 13 21:11:31.862 UTC<br />
Node Type PLIM State Config State<br />
-----------------------------------------------------------------------------<br />
0/0/CPU0 RP N/A <strong>IOS</strong> <strong>XR</strong> RUN PWR,NSHUT,MON<br />
RP/0/0/CPU0:ios#show ipv4 int br<br />
Sun Apr 13 21:11:35.772 UTC<br />
Interface IP-Address Status Protocol<br />
MgmtEth0/0/CPU0/0 unassigned Shutdown Down<br />
GigabitEthernet0/0/0/0 unassigned Shutdown Down<br />
GigabitEthernet0/0/0/1 unassigned Shutdown Down<br />
RP/0/0/CPU0:ios#
<strong>IOS</strong> <strong>XR</strong>v Other Deployment Methods<br />
• vSphere for ESXi management<br />
• Virt-manager on Ubuntu
<strong>IOS</strong> <strong>XR</strong>v Deployment on ESXi<br />
Image Upload<br />
Create new<br />
guest OS<br />
<strong>Network</strong> interface<br />
Creating Serial Interface<br />
<strong>XR</strong> Virtual Disk
<strong>IOS</strong> <strong>XR</strong>v Deployment on<br />
ESXi<br />
Accessing the <strong>IOS</strong>-<strong>XR</strong>v VM<br />
• Telnet to the <strong>IOS</strong>-<strong>XR</strong>v VM port<br />
• telnet <br />
• Will go through TURBOBOOT process on first boot up and reload<br />
• Only happens once, during the first bootup.<br />
• Create Username and Password<br />
• Login and start configuring!<br />
Cisco <strong>IOS</strong> <strong>XR</strong> Software for the Cisco <strong>XR</strong> <strong>IOS</strong><strong>XR</strong>v, Version 4.3.2<br />
Copyright (c) 2013 by Cisco Systems, Inc.<br />
Sep 26 23:46:24.067: Install Setup: Booting with committed software<br />
Sep 26 23:46:39.886 : TURBOBOOT: Turboboot process started<br />
Sep 26 23:46:39.906 : TURBOBOOT: Checking size of device disk0:<br />
Sep 26 23:46:39.906 : TURBOBOOT: OK<br />
Sep 26 23:46:39.916 : TURBOBOOT: Checking size of MBI device bootflash:<br />
Sep 26 23:46:39.916 : TURBOBOOT: OK<br />
Sep 26 23:46:39.926 : TURBOBOOT: Waiting for Admin Config to complete<br />
<br />
Sep 26 23:47:19.574 : TURBOBOOT: All node preparations complete:<br />
Node 0/0/CPU0 successfully completed the preparation.<br />
Sep 26 23:47:19.584 : TURBOBOOT: Resetting TURBOBOOT rommon variable to<br />
(TURBOBOOT=).<br />
Sep 26 23:47:19.594 : TURBOBOOT: Setting config-register to autoboot<br />
the router and disable send break.<br />
Sep 26 23:47:19.614 : TURBOBOOT: Turboboot completed successfully: the<br />
router will now reload from disk<br />
Sep 26 23:47:19.624 : TURBOBOOT: *** RESETTING IN 30 SECONDS ***<br />
Calling platform_kd_reboot ...<br />
<br />
!!!!!!!!!!!!!!!!!!!! NO root-system username is configured. Need to<br />
configure root-system username. !!!!!!!!!!!!!!!!!!!!<br />
--- Administrative User Dialog ---<br />
Enter root-system username: cisco<br />
Enter secret:<br />
Use the 'admin' mode 'configure' command to modify this configuration.
Using ESXi Hypervisor<br />
• Creating <strong>XR</strong>v Virtual Machine <strong>using</strong> vSphere GUI<br />
Parameters<br />
Recommendation<br />
Configuration<br />
Name and Location<br />
Storage<br />
Custom<br />
as with any other VM<br />
as with any other VM<br />
Virtual Machine Version "Virtual Machine Version 8 or 9” *<br />
Guest Operating System<br />
CPUs<br />
Memory<br />
<strong>Network</strong><br />
"Other", version "Other (32-bit)"<br />
Max 8 cores<br />
Min 3 GB, Max 8 GB<br />
1-4 NICs, each NIC must use "E1000" adapter type.<br />
First NIC will be MgmtEthernet0/0/CPU0/0 while subsequent<br />
NICs will be GigabitEthernet
Using ESXi Hypervisor<br />
• Creating <strong>XR</strong>v Virtual Machine <strong>using</strong> vSphere GUI (Con’t)<br />
Parameters<br />
SCI Controller<br />
Select a disk<br />
Select Existing Disk<br />
Advanced Options<br />
Ready to Complete<br />
"Virtual Machine Properties" window – add 2 serial ports as:<br />
•<br />
Recommendation<br />
LSI Logic Parallel (default)<br />
"Use an existing virtual disk"<br />
select <strong>XR</strong>v VMDK image<br />
Must be an IDE disk<br />
select "Edit the virtual machine settings before completion”<br />
Under "Hardware", click "Add..."<br />
Select "Serial Port"<br />
Select "Connect via <strong>Network</strong>"<br />
Select "Server" and enter a telnet URI with an unused port (e.g.,<br />
telnet://:5001) - each VM and each serial port<br />
must use a unique port number.<br />
Repeat this to add a second serial port. The first serial port will be<br />
the console port, and the second will be the aux port.<br />
• Start the VM. Telnet to the configured serial port(s) to interact with and configure the VM
<strong>IOS</strong> <strong>XR</strong>v Troubleshooting
<strong>IOS</strong> <strong>XR</strong>v Troubleshooting<br />
Physical Interface<br />
Virtual Bridge<br />
Hypervisor<br />
interface<br />
<strong>IOS</strong> <strong>XR</strong>v<br />
Management<br />
Domain<br />
Host<br />
Data Domain
<strong>IOS</strong> <strong>XR</strong>v Troubleshooting<br />
Hierarchy<br />
<strong>IOS</strong> <strong>XR</strong>v Virtual Machine<br />
• Regular <strong>IOS</strong> <strong>XR</strong> troubleshooting methods<br />
Hypervisor<br />
• Hypervisor specific troubleshooting commands/views<br />
Host OS<br />
• Unix/Linux troubleshooting<br />
Hardware<br />
• Regular x86 Server troubleshooting
<strong>IOS</strong> <strong>XR</strong>v Troubleshooting<br />
Hypervisor Commands<br />
(qemu) info status<br />
VM status: running<br />
(qemu) info network<br />
Devices not on any VLAN:<br />
e1000.0: type=nic,model=e1000,macaddr=52:54:00:12:34:56<br />
\ first-intf: type=tap,ifname=Tap1,script=no,downscript=no<br />
e1000.1: type=nic,model=e1000,macaddr=52:54:00:12:34:57<br />
\ second-intf: type=tap,ifname=Tap2,script=no,downscript=no<br />
(qemu) info chardev<br />
parallel0: filename=null<br />
serial0: filename=telnet:0.0.0.0:2345,server<br />
compat_monitor0: filename=stdio<br />
(qemu)<br />
Status verification of Guest OS
<strong>IOS</strong> <strong>XR</strong>v Troubleshooting<br />
Hypervisor Common mistakes<br />
• Multiple <strong>XR</strong>v <strong>using</strong> same disk image<br />
– Each instance needs a separate disk<br />
• Multiple <strong>XR</strong>v <strong>using</strong> same console<br />
$ qemu-system-x86_64 -serial telnet::2345,server,nowait <br />
inet_listen_opts: bind(ipv4,0.0.0.0,2345): Address already in use<br />
inet_listen_opts: FAILED<br />
chardev: opening backend "socket" failed: Address already in use<br />
qemu: could not open serial device 'telnet:0.0.0.0:2345,server,nowait': Address already<br />
in use
<strong>IOS</strong> <strong>XR</strong>v Troubleshooting<br />
Host Commands<br />
Process & CPU Status<br />
cisco@epn-sjcj-ucs1:~$ ps -ef | grep <strong>XR</strong>v<br />
root 6614 6436 0 04:32 pts/1 00:00:00 sudo /usr/bin/qemu-system-x86_64 -m<br />
4024 -name <strong>XR</strong>v-Test-Launch -hda /home/cisco/iosxrv-k9.vmdk-5.1.1-5 -serial<br />
telnet:0.0.0.0:2345,server,nowait -device e1000,netdev=first-intf -netdev<br />
tap,ifname=Tap1,script=no,downscript=no,id=first-intf -device e1000,netdev=second-intf<br />
-netdev tap,ifname=Tap2,script=no,downscript=no,id=second-intf -nographic -no-kvm -<br />
device e1000,netdev=third-intf -netdev<br />
tap,ifname=Tap3,script=no,downscript=no,id=third-intf<br />
top - 09:26:59 up 13 days, 58 min, 2 users, load average: 0.49, 0.47, 0.50<br />
Tasks: 325 total, 2 running, 322 sleeping, 0 stopped, 1 zombie<br />
Cpu(s): 1.6%us, 0.4%sy, 0.1%ni, 98.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st<br />
Mem: 181507016k total, 8715152k used, 172791864k free, 146552k buffers<br />
Swap: 134143996k total, 0k used, 134143996k free, 4476556k cached<br />
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND<br />
5477 cisco 20 0 50460 26m 3808 R 39 0.0 4843:57 Xtightvnc<br />
31187 libvirt- 20 0 5972m 1.9g 7640 S 9 1.1 377:28.36 qemu-system-x86<br />
34605 libvirt- 20 0 5972m 1.8g 7628 S 7 1.0 348:28.40 qemu-system-x86<br />
24982 cisco 30 10 32068 1844 1488 S 4 0.0 0:05.99 fuzzyflakes
<strong>IOS</strong> <strong>XR</strong>v Troubleshooting<br />
Host OS Common Issues<br />
• Missing qemu/KVM package<br />
– apt-get install qemu-kvm; mobprobe kvm<br />
• Not able to create TAP interface:<br />
– apt-get install uml-utilities (required for tap interface for bridge to physical)<br />
• <strong>Virtualization</strong> not enabled:<br />
– Ensure VT-x flag (or equivalent) is exposed to operating system<br />
• egrep -c '(vmx|svm)' /proc/cpuinfo<br />
• Ensure that user is added to ‘kvm’ group<br />
– sudo addgroup `id -un` kvm
Service Orchestration for<br />
<strong>NFV</strong>
vRR<br />
vRR<br />
vRR<br />
Apps<br />
Apps<br />
Apps<br />
Service Orchestration for <strong>NFV</strong><br />
<strong>Network</strong> <strong>Function</strong> <strong>Virtualization</strong> Software Defined <strong>Network</strong>ing Service Orchestration<br />
Orchestration<br />
• Architecture, Tools & Processes<br />
• Stitching of software and hardware components<br />
Service Catalog and Workflow<br />
Service Orchestration<br />
Catalog<br />
• Automating of work flows<br />
VM/Storage<br />
Control<br />
<strong>Network</strong><br />
Control
<strong>NFV</strong> with <strong>IOS</strong> <strong>XR</strong><br />
Right Sizing Your Deployment<br />
Choose your Service Size up your Data Plane Adapt your Control Plane<br />
Core / Transport<br />
High<br />
High<br />
Peering<br />
DCI<br />
PE<br />
Subscriber Services<br />
Virtual PE (vPE)<br />
Virtual RR (vRR)<br />
Multichassis NCS 6000<br />
Multichassis CRS-X<br />
NCS 6000<br />
ASR 9000 Tomahawk<br />
CRS-X<br />
CRS<br />
ASR 9000 Typhoon<br />
<strong>IOS</strong>-<strong>XR</strong>v 9K<br />
Choose<br />
between<br />
On-box,<br />
Hybrid or<br />
Pure<br />
Virtual CP<br />
Based on<br />
Use Case<br />
Virtualized CP or<br />
Expansion CP from<br />
Physical System<br />
Today’s <strong>IOS</strong>-<strong>XR</strong><br />
on box Control<br />
Plane<br />
Low<br />
Data Plane<br />
Low<br />
Control Plane
<strong>NFV</strong> <strong>using</strong> <strong>IOS</strong> <strong>XR</strong><br />
Completing Portfolio<br />
<strong>IOS</strong>-<strong>XR</strong><br />
vPE, vRR<br />
X86 Virtual Router<br />
Virtual<br />
<strong>XR</strong> DP<br />
CRS Portfolio Edge Routing NCS 6000<br />
ASR 9000 Portfolio Single & Multi<br />
Chassis<br />
<strong>NFV</strong> Virtual Router<br />
<strong>IOS</strong>-<strong>XR</strong>v
Putting it all together…<br />
Compute<br />
<strong>Network</strong><br />
Storage<br />
Hypervisors<br />
Virtual <strong>Function</strong>s<br />
B<br />
S<br />
S<br />
O<br />
S<br />
S<br />
SMU-ability<br />
Opex Saving<br />
Scalable<br />
High<br />
Availability<br />
<strong>IOS</strong> <strong>XR</strong>v<br />
Low Capex<br />
Multithreaded<br />
Flexible<br />
Carrier Class
Re-cap<br />
• Role of <strong>NFV</strong> in EPN?<br />
• Introducing <strong>IOS</strong> <strong>XR</strong>v & <strong>XR</strong>v 9000<br />
• vRR and vPE Use Cases<br />
• Deployment & Troubleshooting<br />
• Summary
Participate in the “My Favorite Speaker” Contest<br />
Promote Your Favorite Speaker and You Could Be a Winner<br />
• Promote your favorite speaker through Twitter and you could win $200 of Cisco<br />
Press products (@CiscoPress)<br />
• Send a tweet and include<br />
• Your favorite speaker’s Twitter handle<br />
• Two hashtags: #CLUS #MyFavoriteSpeaker<br />
• You can submit an entry for more than one of your “favorite” speakers<br />
• Don’t forget to follow @CiscoLive and @CiscoPress<br />
• View the official rules at http://bit.ly/CLUSwin
Complete Your Online Session Evaluation<br />
• Give us your feedback to be<br />
entered into a Daily Survey<br />
Drawing. A daily winner<br />
will receive a $750 Amazon<br />
gift card.<br />
• Complete your session surveys<br />
though the Cisco Live mobile<br />
app or your computer on<br />
Cisco Live Connect.<br />
Don’t forget: Cisco Live sessions will be available<br />
for viewing on-demand after the event at<br />
CiscoLive.com/Online
Continue Your Education<br />
• Demos in the Cisco campus<br />
• Walk-in Self-Paced Labs<br />
• Table Topics<br />
• Meet the Engineer 1:1 meetings<br />
• Related sessions:<br />
• BRKSDN-2063 - SDN/<strong>NFV</strong> for Service Provider IP/MPLS <strong>Network</strong>s<br />
• BRKSDN-2065 - <strong>NFV</strong> Architecture & Orchestration for Cloud based Virtual Managed Services<br />
• BRKCRS-3447 - <strong>Network</strong> <strong>Function</strong> <strong>Virtualization</strong> for Enterprise <strong>Network</strong>s<br />
• BRKRST-2319 - <strong>Network</strong> Service Chaining Solutions<br />
• CISSOL-1019 - Business Transformation with Evolved Services Platform and Evolved Programmable <strong>Network</strong>
Thank you
Change language