EMC NetWorker - Amiando
EMC NetWorker - Amiando
EMC NetWorker - Amiando
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
30.06. Zürich<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
1
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Deduplication<br />
Backup Platform of the future<br />
Andreas Ulrich<br />
BRS Division Switzerland<br />
2
Agenda<br />
• The circle of pain<br />
• Reason why customer chosen disk based backup<br />
• What’s the new approach for data protection?<br />
• Is deduplication a walk in the park?<br />
• Is dedup always dedup?<br />
• Why you should consider dedup<br />
• <strong>EMC</strong>’s <strong>EMC</strong> s portfolio in backup deduplication<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
3
The circle of pain<br />
Offsite copy<br />
• Preparation Lock Boxes<br />
• Retrieve/ organize reports<br />
Monitoring<br />
• Success/ Failures<br />
• Long running jobs<br />
• Media errors<br />
• Issue field service calls<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Troubleshooting<br />
• 80% media errors related<br />
• 10% network interrupts<br />
• 10% plugin p g and others<br />
Change Control<br />
Media Growth<br />
• Tickets for media purchases<br />
• Tickets for network changes<br />
• Tickets for client timeouts<br />
• Expand disk pools<br />
• NNew ttape media di<br />
• Robot / Drive upgrades<br />
• Hardware Migrations<br />
Restores<br />
• > 20% fails<br />
• Always y unplanned p<br />
• Resource planning<br />
4
Reason why customer<br />
more often chose disk based backup<br />
• Massive data growth g<br />
• Scalability of traditional solutions are limited<br />
• Virtualization changes the game<br />
– Shared infrastructure brings new challenges<br />
– Features like VADP (Image Level Backup for vSphere)<br />
– …<br />
• Higher requirements at data integrity<br />
• Footprint Footprint and Energy constrains<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
5
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Whats the new approach<br />
for data protection?<br />
6
It depends on the point of view view…<br />
Virtualisation<br />
“All All is virtualized virtualized,<br />
so let‘s go for<br />
VADP!”<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Storage Admin<br />
Admin<br />
“Snaps are<br />
good enough!<br />
Why backup?”<br />
↓ Cost<br />
↓ Risk<br />
↓ Leverage<br />
DBA<br />
“RMA can do it as<br />
well, and I have it<br />
under controll at<br />
any time”<br />
Backup Admin.<br />
“With With LTO5 we are<br />
unbeatable! Let‘s<br />
buy more tapes”<br />
7
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Is deduplication<br />
a walk in the park?<br />
8
Some point to consider consider…<br />
• Where makes it most sense? Can I chose?<br />
– Source/ Client?<br />
– Backup p Server?<br />
– Backup Device?<br />
• Integrity! RAID is not enough!<br />
• 200TB Backup File Systems: interesting rebuild..<br />
• Replication is the off site copy. Timing matters!<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
9
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Is dedup always dedup?<br />
10
The Methodology matters!<br />
Whitespace reduction<br />
File level<br />
Fixed blocks, snapshots<br />
Backup target, variable segment<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Regular storage array<br />
1:1<br />
LZ compression p<br />
~ 2:1<br />
Single instance storage<br />
~ 3:1<br />
Fi Fixed d bl block k<br />
~ 3:1<br />
Variable<br />
segment<br />
~20:1<br />
DDeduplication d li ti significantly i ifi tl reduces: d<br />
• Replication WAN bandwidth<br />
• Power<br />
• Heat<br />
• Cooling<br />
• Management<br />
11
Methodology: Inline versus Post Post-Process Process<br />
INLINE<br />
POST- OR ADABTIVE PROCESS<br />
Deduplication Before Storing<br />
Deduplication<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Store<br />
Deduplication After Storing<br />
Deduplication<br />
3x disk accesses<br />
to shared store<br />
12
Throughput<br />
T t MB/s<br />
CPU CPU-Centric Centric versus Spindle Spindle-Bound Bound<br />
1,500<br />
50<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Data Domain Improvement since 2004:<br />
-Throughput: Throughput: 175x<br />
-Capacity: 450x<br />
Fibre Channel<br />
Most<br />
deduplication p<br />
vendors<br />
Number of Disk Spindles<br />
SATA<br />
50 100 150 200<br />
13
Why yy you should consider deduplication? p<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
14
A happy day with Diskbased Deduplication!<br />
Offsite copy<br />
• No tapes<br />
• Centralized Management<br />
• No risk in transportation<br />
Monitoring<br />
• No tape errors<br />
• End to end phone home support<br />
• Performance results faster backups<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Troubleshooting<br />
• 80% media error relieved -> no tape<br />
• 10% network Interrupts relieved -> deduplication<br />
• 10% -> OK, we‘ll we ll take this...<br />
Change Control<br />
Media Growth<br />
• Single pool of storage<br />
• 90% ddata t reduction d ti<br />
• No ongoing capacity mang.<br />
Restores<br />
• Less changes = less risk = higher SLA‘s<br />
• > 99% success rate<br />
• YES, spend more on on this!<br />
15
<strong>EMC</strong>’s <strong>EMC</strong> s portfolio in deduplication<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
16
<strong>EMC</strong> Backup Recovery Systems Division<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
• Division HQ: Santa Clara, CA<br />
• 10 R&D locations<br />
– 2,000 employees p y<br />
• Data protection storage systems<br />
– More than 60,000 systems y installed<br />
– More than 45,000 customers<br />
– More than 15,000 PB under protection<br />
worldwide<br />
• Global sales, support, and services<br />
– Approximately 66,000 000 channel partners<br />
17
<strong>EMC</strong>’s <strong>EMC</strong> s backup recovery systems<br />
<strong>EMC</strong> Avamar <strong>EMC</strong> <strong>NetWorker</strong><br />
• #1 deduplication backup software worldwide<br />
• > 8,000 installations<br />
• > 4,400 customers<br />
Virtual and<br />
ROBO Solution<br />
<strong>EMC</strong> Data Domain<br />
• #1 deduplication storage<br />
• > 15,000 installations<br />
• > 6,000 customers<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Purpose built<br />
Backup Appliances<br />
Unified<br />
Data<br />
PProtection t ti<br />
Central<br />
Backup p Management g<br />
Data Protection<br />
QA & Reporting<br />
<strong>EMC</strong> <strong>NetWorker</strong><br />
• top three enterprise backup software<br />
• 30,000 customers<br />
<strong>EMC</strong> DPA<br />
• #1 heterogeneous backup management<br />
software<br />
• > 8,000 customers<br />
18
Market Leadership<br />
Data Domain (<strong>EMC</strong>)<br />
<strong>EMC</strong> Avamar<br />
NetApp<br />
IBM ProtecTIER<br />
HP<br />
<strong>EMC</strong> VTL<br />
Sun VTL<br />
Quantum<br />
Copan<br />
ExaGrid<br />
Sepaton<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Hardware-based Hardware based Deduplication Vendors<br />
53 5.3<br />
9.2<br />
8.7<br />
11.6<br />
13.5<br />
Percent selected<br />
16.9<br />
15.9<br />
21<br />
24.2<br />
23.2<br />
26.1<br />
29<br />
31<br />
33<br />
0 10 20 30 40 50 60 70<br />
35.3<br />
37<br />
46<br />
48<br />
49<br />
53<br />
53<br />
60<br />
Evaluating/Evaluted Chosen<br />
19
Where do do we offer deduplication?<br />
Backup/Recovery Application Backup Backup/Media Onsite Backup Disaster Recovery<br />
Architecture CClients<br />
Manager SStorage<br />
SStorage<br />
Conventional<br />
(Tape-centric)<br />
Transformational<br />
(Disk-centric)<br />
DB<br />
Home<br />
Point of Deduplication<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Backup <strong>NetWorker</strong> software Tape Tape<br />
Backup <strong>NetWorker</strong> software DLm VTL VTL/Tape<br />
Backup <strong>NetWorker</strong> software<br />
Deduplication Data Domain storage<br />
Deduplication Avamar backup software and system<br />
Data Protection Data Protection Management Advisor Software<br />
on premise off premise<br />
20
<strong>EMC</strong> Avamar and <strong>EMC</strong> Data Domain<br />
Retain, replicate, recover<br />
Purpose built<br />
Integrated deduplication<br />
deduplication appliance backup software<br />
Data Domain Deduplication<br />
Storage Systems<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Avamar<br />
Deduplication<br />
Backup p<br />
Software<br />
21
Deduplication Impact on Data Size<br />
Data Stored S<br />
Deduplication<br />
10 10–30 30 ti times lless ddata t stored t d versus ffulls ll plus l iincrementals t l with ith ttypical i l retention t ti policies li i<br />
30<br />
20<br />
10<br />
0 1 5 10 15 20<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Weeks in Use<br />
Deduplication storage<br />
Traditional storage g<br />
22
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Datadomain<br />
23
What is Datadomain?<br />
„Storage Storage Tier to protect business-essential<br />
information with scalable high-end deduplication<br />
storage t th thatt dli delivers th the aggregate t th throughput h t<br />
performance needed for enterprise data centers.“<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
24
<strong>EMC</strong> Datadomain<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
“Set and forget” Approach<br />
Extremely efficient Deduplication<br />
Open (CIFS, NFS, VTL over FC, IBM i-Series)<br />
Intelligent (BOOST, distributed Dedup etc)<br />
Self healingg<br />
Scalable from 1TB to >PB’s<br />
Green (d (data t reduction, d ti LLow power Di Disks k etc) t )<br />
Deepest Cost per GB (DD Archiver)<br />
25
Industry’s Most Scalable Inline<br />
Deduplication Systems<br />
Softwareoptionen:<br />
• DD Boost,<br />
• DD Virtual Tape Library,<br />
• DD Replicator,<br />
• DD Retention Lock<br />
• DD Encryption<br />
DD140 DD610 DD630 DD670 DD860 DD890<br />
Global<br />
Deduplication Array<br />
DD Archiver<br />
Speed (DD Boost) 490 GB/hr 1.3 TB/hr 2.1 TB/hr 5.4 TB/hr 9.8 TB/hr 14.7 TB/hr 26.3 TB/hr 9.8 TB/hr<br />
Speed (other) 450 GB/hr 675 GB/hr 1.1 TB/hr 3.6 TB/hr 5.1 TB/hr 8.1 TB/hr 10.7 TB/hr 4.3 TB/hr<br />
Logical capacity 9–43 TB 40–195 TB 84–420 TB 0.6–2.7 PB 1.4–7.1 PB 2.9–14.2 PB 5.7–28.5 PB 5.7–28.5 PB<br />
Raw capacity 1.5 TB Up to 6 TB Up to 12 TB Up to 76 TB Up to 192 TB Up to 384 TB Up to 768 TB Up to 768 TB<br />
Usable capacity 0.86 TB Up to 3.98 TB Up to 8.4 TB Up to 55.9 TB Up to 142 TB Up to 285 TB Up to 570 TB Up to 570 TB<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
26
Customer Example Swiss Outsourcer<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
• >90% Data Reduction<br />
– 1300TB logical<br />
– Backed up on 100TB storage<br />
• >1TB/ hour throughput<br />
• Significant handling reduction<br />
• Management/ Reporting by DPA<br />
• Actual Use cases:<br />
– Symantec, <strong>EMC</strong> and TSM Backup<br />
– Oracle high performance backup<br />
– Boost integration over IP<br />
– VTL integration over FC SAN<br />
27
Customer Example Swiss Financial Inst Inst.<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
• >94% Data Reduction<br />
– >300TB 300TB logical<br />
– Backed up on 22TB storage<br />
• In total 11 Dedup systems<br />
• Replications over 3 regions<br />
• Significant handling reduction<br />
• Multiple use cases in place<br />
– <strong>EMC</strong> Networker Backup<br />
– Native Oracle RMAN<br />
– Native VMWare<br />
– NAS NDMP<br />
28
Customer Example Swiss mid size<br />
outsourcer<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
• >96% Data Reduction<br />
– >350TB 350TB logical<br />
– Backed up on 20TB storage<br />
• In total 14 Dedup systems<br />
• Multi customer environment<br />
• Round robin replications<br />
• Significant handling reduction<br />
• Multiple use cases in place<br />
– <strong>EMC</strong> Networker Backup<br />
– Native Oracle RMAN<br />
29
Why Data Domain?<br />
• Save Money<br />
– Less disk to resource, less to manage<br />
– < 0.1 FTE/ PB<br />
– Simple Simple, mature appliance<br />
• Simplification<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
– Any fabric, fabric any software, software backup or archive applications<br />
– Self healing through DIA<br />
– Multi-Protocol and Multi-Purpose p usage g<br />
• Resilience and disaster recovery<br />
– CPU-centric inline deduplication p<br />
– Most flexible Replication Capabilities<br />
– Fast time-to-DR readiness<br />
30
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Avamar<br />
31
What is Avamar?<br />
„Ensure Ensure fast fast, secure backup and recovery for<br />
your VMware environments, regional offices,<br />
andd ddata t center t LAN LANs with ith global, l b l source-based b d<br />
data deduplication.“<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
32
<strong>EMC</strong> Avamar<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
Extremely efficient Source Dedup<br />
Integrated with Vmware vCenter<br />
Runs virtualized<br />
Easy to use and deploy<br />
Integrated g with <strong>EMC</strong> Networker<br />
Backup’s VM’s in seconds<br />
Increase VM to host server ratio<br />
33
Avamar Family<br />
UNIFIED<br />
MANAGEMENT<br />
<strong>EMC</strong> Data<br />
Protection<br />
Advisor<br />
<strong>EMC</strong><br />
<strong>NetWorker</strong><br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
EXAMPLE USE CASES<br />
VM VMware RRemote/Branch t /B h Offi Offices DDesktop/Laptop kt /L t<br />
NAS/NDMP<br />
Lotus Notes<br />
CLIENTS<br />
CORE PLATFORMS<br />
IBM DB2<br />
Avamar<br />
VM<br />
<strong>EMC</strong> Avamar <strong>EMC</strong> Avamar Data <strong>EMC</strong> Avamar Virtual<br />
Store<br />
Edition for VMware<br />
34
Why Avamar?<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
• Save Money<br />
– Reduces required daily network bandwidth and client stress<br />
– Scalable VMware backup for greater server consolidation<br />
– Easy management through vCenter<br />
• Simplification and increasing SLA<br />
– Shorter backup windows<br />
– Less data moved reduces daily full backup times<br />
– Single-step restore; no need for full and incremental backups<br />
– Integrated and managed through vCenter<br />
– Streamlined, centralized management of remote backups<br />
• Resilience and disaster recovery<br />
– Recoverability guaranteed<br />
– Daily integrity checks, RAIN and replication ensure high<br />
availability<br />
35
Why <strong>EMC</strong> for Deduplication?<br />
• Longest experience<br />
• Record breaking performance<br />
• Deduplication end to end!<br />
• 1000’s of happy customers<br />
• It’s important to us!<br />
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
36
© Copyright 2011 <strong>EMC</strong> Corporation. All rights reserved.<br />
37