Documentation of the Evaluation of CALPUFF and Other Long ...
Documentation of the Evaluation of CALPUFF and Other Long ...
Documentation of the Evaluation of CALPUFF and Other Long ...
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
Figure C‐ ‐40 lists <strong>the</strong> RANK model<br />
performance<br />
statistics for <strong>the</strong> six LLRT<br />
models. CAMx is <strong>the</strong>e<br />
highest rranked<br />
mode el using <strong>the</strong> RANK metricc<br />
with a valuue<br />
<strong>of</strong> 1.91 foollowed<br />
by HYSPLIT<br />
at 1. 8. It<br />
is importtant<br />
to note, , however, that<br />
both CAMx<br />
<strong>and</strong> HYSSPLIT<br />
exhibit high scores in all four areas<br />
<strong>of</strong> modell<br />
performanc ce (correlation,<br />
bias, spaatial<br />
<strong>and</strong> cummulative<br />
disttribution).<br />
Itt<br />
is an imporrtant<br />
attributee<br />
<strong>of</strong> model pe erformance to score higgh<br />
in all areas<br />
<strong>of</strong> model pperformancee.<br />
The next best<br />
performing<br />
model ac ccording to t<strong>the</strong><br />
RANK meetric<br />
is CALGGRID<br />
with a sscore<br />
<strong>of</strong> 1.577,<br />
followed bby<br />
SCIPUFF (1.53), FLEXPART<br />
(1.45), , <strong>and</strong> finally <strong>CALPUFF</strong> (1.28).<br />
Howevver,<br />
<strong>the</strong> CALGRID<br />
third bbest<br />
RANK meetric<br />
comes at <strong>the</strong> expense<br />
<strong>of</strong> low spatial<br />
(FMS) ) <strong>and</strong> zero coorrelation<br />
(PPCC<br />
or R2)<br />
performaance<br />
skill.<br />
Figure C‐ ‐40. RANK statistical s peerformance<br />
metric for thhe<br />
six LRT mmodels<br />
<strong>and</strong> CCAPTEX<br />
Releease<br />
5.<br />
C.5.2.1 SSUMMARY<br />
OF O SIX LRT MMODEL<br />
RANKINGS<br />
FOR CTEX5 USING<br />
STATISTICCAL<br />
PERFORMMANCE<br />
MEA ASURES<br />
Table C‐66<br />
summarize es <strong>the</strong> rankinngs<br />
<strong>of</strong> <strong>the</strong> sixx<br />
LRT modelss<br />
for <strong>the</strong> 11 performance<br />
statistics<br />
analyzed in CAPTEX Release R 5 annd<br />
comparess<br />
<strong>the</strong> averagiing<br />
ranking aacross<br />
<strong>the</strong> 11<br />
statistics<br />
against <strong>the</strong><br />
RANK me etric. Depennding<br />
on <strong>the</strong> statistical mmetric,<br />
five o<strong>of</strong><br />
<strong>the</strong> six moodels<br />
were<br />
ranked as<br />
<strong>the</strong> best pe erforming mmodel<br />
for a pparticular<br />
staatistic.<br />
CALGGRID<br />
was <strong>the</strong>e<br />
only modeel<br />
not<br />
ranked fiirst<br />
for any performance<br />
p e statistics, aalthough<br />
it tiied<br />
with CAMMx<br />
for havinng<br />
<strong>the</strong> lowestt<br />
(best) FBB<br />
value (‐0.49 9), but it wass<br />
ranked behhind<br />
CAMx ( FB <strong>of</strong> +0.49) ) due to a deesire<br />
for<br />
regulatorry<br />
models to o not have an<br />
underestimmation<br />
bias. HYSPLIT waas<br />
ranked thhe<br />
best<br />
40