Achieving Top Network Performance - Red Hat Summit
Achieving Top Network Performance - Red Hat Summit Achieving Top Network Performance - Red Hat Summit
Tuning – are we done ?●Look for bottlenecks● Transmit is CPU bound● 11:54:54 PM CPU %usr %nice %sys %iowait %irq %soft %steal %guest %idle● 11:54:57 PM all 0.08 0.00 6.16 0.00 0.00 0.11 0.00 0.00 93.65● 11:54:57 PM 0 0.33 0.00 0.33 0.00 0.00 0.00 0.00 0.00 99.34● 11:54:57 PM 1 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 2 0.33 0.00 0.00 0.00 0.00 0.00 0.00 0.00 99.67● 11:54:57 PM 3 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 4 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 5 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 6 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 7 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 8 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 9 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 10 0.00 0.00 0.00 0.00 0.00 0.39 0.00 0.00 99.61● 11:54:57 PM 11 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 12 1.00 0.00 97.66 0.00 0.00 1.34 0.00 0.00 0.00● 11:54:57 PM 13 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 14 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00● 11:54:57 PM 15 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 100.00
Tuning – checking ethtool -S eth4●●Check for errors, pause frames, etc.Check nic on TX side# ethtool -S eth4NIC statistics:rx_packets: 135224755tx_packets: 1137704051rx_bytes: 8729946637tx_bytes: 9906371184752rx_errors: 0tx_errors: 0rx_dropped: 0tx_dropped: 0tso_packets: 20844101queue_stopped: 92899164wake_queue: 92899164
- Page 30 and 31: NPtcp latency vs cstates - c7 vs c0
- Page 32 and 33: RHEL6 “tuned-adm” profiles# tun
- Page 34 and 35: Kernel Bypass Technologies - Pros a
- Page 36 and 37: Offload - Solarflare OpenOnloadAver
- Page 38 and 39: KVM Network ArchitectureVirtioConte
- Page 40 and 41: KVM Network Architecture - vhost_ne
- Page 42 and 43: Latency comparison - RHEL 6Network
- Page 44 and 45: Host CPU Consumption virtio vs vhos
- Page 46 and 47: KVM Network Architecture - PCI Devi
- Page 48 and 49: KVM Network Architecture - SR-IOV
- Page 50 and 51: KVM Architecture - Device Assignmen
- Page 52 and 53: RHEL6 - new features●●●●●
- Page 54 and 55: RHEL6 - new features●●Add getso
- Page 56 and 57: Receive Steering - improved message
- Page 58 and 59: Tuning Knobs - Overview●●●By
- Page 60 and 61: sysctl - View and set /proc/sys set
- Page 62 and 63: sysctl - TCP related settings●TCP
- Page 64 and 65: Why Bother ? - Teaser 1effect of ne
- Page 67 and 68: lspci - details# lspci -vvvs 81:00.
- Page 69 and 70: Why Bother - A quick teaser● ifco
- Page 71 and 72: Tuning- first pass bottleneck resol
- Page 73 and 74: Tuning - second pass setup●●●
- Page 75 and 76: Tuning - irqbalance disabled, netpe
- Page 77 and 78: Tuning - second pass●mpstat on th
- Page 79: Tuning - step 3●Try TCP_SENDFILE#
- Page 83 and 84: Tuning - step 4●More buffers# ./n
- Page 85 and 86: Tuning - sanity check●Sometimes m
- Page 87 and 88: Throttling - cgroups in Action
- Page 89 and 90: Cgroup default mount points# cat /e
- Page 91 and 92: cgroups[root@dhcp1001950 ~]#
- Page 93 and 94: incorrect bindings![root@dhcp47-183
- Page 95 and 96: Throttle with cgroups●●memory
- Page 97 and 98: Network Tuning Tips●Separate netw
- Page 99 and 100: For More Information - Other talks
- Page 101: Stay connected through the Red Hat
- Page 104 and 105: Configuration Tools - System Level
- Page 106 and 107: sar - some common flags●Some comm
Tuning – checking ethtool -S eth4●●Check for errors, pause frames, etc.Check nic on TX side# ethtool -S eth4NIC statistics:rx_packets: 135224755tx_packets: 1137704051rx_bytes: 8729946637tx_bytes: 9906371184752rx_errors: 0tx_errors: 0rx_dropped: 0tx_dropped: 0tso_packets: 20844101queue_stopped: 92899164wake_queue: 92899164