PARALLEL PROCESSING

More documents

Recommendations

Info

IMPLICIT VS EXPLICIT Not necessary to develop a custom solution for each problem SAS, Stata, and Matlab all have internal parallel algorithms that will do much if not all of the hard work for you. They will spawn the threads and gather the results using well tested routines Your job is to manage the number of threads Amdahl’s law shows that there are diminishing returns to additional cores Programs assume all cores on a node are available for parallel processing On a large node this may not be desirable (return for using each additional core may not be worth the opportunity cost) Tuesday, August 20, 13
TAKE CONTROL OF IMPLICIT THREADS SAS Stata THREADS and CPUCOUNT=X NOTHREADS set processors X Matlab -singleCompThread to restrict jobs to the approximate usage of a single core Launch multiple Matlab processes on a single node, each with - singleCompThread enabled Tuesday, August 20, 13
Page 1 and 2: Tuesday, August 20, 13 PARALLEL PRO
Page 3 and 4: THREADS VS PROCESSES Both can be us
Page 5 and 6: BENEFITS VS COSTS Using more cores
Page 7 and 8: AMDAHL’S LAW P=Number of Cores al
Page 9 and 10: EXAMPLE (CONTINUED) Within each gro
Page 11: SHOULD I GO PARALLEL? Careful tunin
Page 15 and 16: PBS PRO Job scheduler on the SSG th

PARALLEL PROCESSING

Create successful ePaper yourself

Delete template?

Save as template?