Sun Grid Engine Update
Sun Grid Engine Update
Sun Grid Engine Update
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>Sun</strong> <strong>Grid</strong> <strong>Engine</strong><br />
<strong>Update</strong><br />
Daniel Gruber<br />
Software <strong>Engine</strong>er<br />
<strong>Sun</strong> Microsystems Deutschland GmbH<br />
<strong>Sun</strong> is a wholly-owned subsidiary of Oracle<br />
1
Content<br />
What's new in SGE?<br />
DRMAA Customer Feedback<br />
2
<strong>Sun</strong> <strong>Grid</strong> <strong>Engine</strong> Releases<br />
Release Announcement Some Features...<br />
6.2 major 23.09.2008 SDM, scalability (> 60000 cores), AR, IJS<br />
6.2 update 1 18.12.2008<br />
maintenance release<br />
6.2 update 2<br />
6.2 update 3<br />
31.03.2009<br />
23.06.2009<br />
GUI Installer, JSV, Per Job Resources,<br />
jemalloc<br />
SGE Inspect, SDM Cloud Adapter,<br />
Exclusive Host<br />
6.2 update 4 23.10.2009<br />
maintenance release<br />
6.2 update 5<br />
22.12.2009<br />
Slotwise Preemption, Core Binding,<br />
enhanced Inspect, Java JSV, Array Job<br />
Throttling, Hadoop Support<br />
<strong>Sun</strong> Confidential: Internal Only 3
SDM – Service Domain Manager<br />
<strong>Grid</strong><br />
<strong>Engine</strong><br />
A<br />
<strong>Grid</strong><br />
<strong>Engine</strong><br />
B<br />
<strong>Grid</strong><br />
<strong>Engine</strong><br />
C<br />
Service Domain Manager<br />
Zzzzz Zzzzz<br />
Power Saving Spare<br />
Pool (via IPMI)<br />
Spare Pool<br />
CloudService<br />
<strong>Sun</strong> Confidential: Internal Only 4
JSV – Job Submission Verifier<br />
• Administrator (or users) can reformulate (insert,<br />
delete) job submission parameters based on a<br />
JSV scripts<br />
• Jobs can be rejected based on parameters<br />
• bash, csh, tcl, perl and JSV scripts are<br />
supported<br />
<strong>Sun</strong> Confidential: Internal Only 5
GUI Installer<br />
• Installs a complete SGE cluster<br />
<strong>Sun</strong> Confidential: Internal Only 6
Slot-wise preemption<br />
• Slot limit per host<br />
• Suspends jobs from subordinate queues in order<br />
to get high priority jobs to run<br />
• Suspends longest/shortest running jobs<br />
• Multiple layers (suspend trees) possible<br />
• Per layer: Order definable<br />
<strong>Sun</strong> Confidential: Internal Only 7
Core Binding<br />
• Job submission extension<br />
• Binds job on specific cores and sockets,<br />
which prevents from migration through OS sheduler<br />
• Significant performance increase possible<br />
• Stable runtime results in case of oversubscription<br />
• Job isolation<br />
• Available for DRMAA applications<br />
(native_specification)<br />
<strong>Sun</strong> Confidential: Internal Only 8
Core Binding<br />
• qsub -binding striding:2:2 job.sh<br />
• qsub -binding linear:4 job.sh<br />
Sockets<br />
Host<br />
Cores<br />
<strong>Sun</strong> Confidential: Internal Only 9
DRMAA Customer Feedback<br />
• Number of customers and ISVs using DRMAA<br />
• Most successful: Java language binding<br />
• Join DRMAAv2.0 sessions<br />
• Example for applications in complex workflows:<br />
KNIME – Konstanz Information Miner<br />
www.knime.org<br />
<strong>Sun</strong> Confidential: Internal Only 10
The KNIME Platform<br />
<strong>Sun</strong> Confidential: Internal Only 11
KNIME Cluster Execution<br />
Task Splitting and DRMAA Submission<br />
<strong>Sun</strong> Confidential: Internal Only 12
Thank you!<br />
<strong>Sun</strong> <strong>Grid</strong> <strong>Engine</strong> <strong>Update</strong><br />
Daniel Gruber<br />
d.gruber@sun.com<br />
13
Change language