Documentation of the Evaluation of CALPUFF and Other Long ...

Documentation of the Evaluation of CALPUFF and Other Long ... Documentation of the Evaluation of CALPUFF and Other Long ...

20.04.2013 Views

Figure C‐ ‐27. Fraction nal Bias(FB) statistical pperformancee metric for the six LRT models and CAPTEX RRelease 3. The KS paarameters fo or the six LRRT models are shown in FFigure C‐28. HYSPLIT (31%) has the best KS parammeter, which h indicates thhe best matcch between the predicteed and observed tracer concentrration distrib butions, folloowed by CAMMx (38%) annd then SCIPUFF (43%). FLEXPART and CALGRIDD are essentia ally tied withh the worst KS parameteer with a vallue of 58%. Figure C‐ ‐28. Kolmog gorov – Smirrnov Parameeter (KSP) sttatistical performance mmetrics for tthe six LRT mmodels for CA APTEX Releaase 3. 30

The RANK statistical performancce metric wa performaance metric that equallyy ranks the c (PCC or RR), bias (FB), spatial analysis (FMS) a RANK meetrics ranges s from 0.0 too 4.0 with a p lists the RRANK model performance statistics model ussing the RAN NK metric with a value of of modell performanc ce (correlation, bias, spa performing model ac ccording to tthe RANK me scores reelatively well across all oof the four m distributiion and corr relation metrics compare FLEXPART and CALPU UFF are nearrly even in te and 1.43 respectively y. FLEXPARTT scores bett the reverrse is true fo or the correlaation (R 2 s proposed by Draxler (22001) as a siingle model ombination of performaance metricss for correlattion nd unpairedd distributionn comparisoons (KS). Thee perfect moddel receiving a score of 44.0. Figure CC‐29 for the six LLRT models. CAMx is thee highest rannked f 1.91. Notee that CAMx scores high in all four areas atial and cummulative disttribution). TThe next besst etric is SCIPUUFF with a score of 1.711. SCIPUFF metrics, with slightly loweer scores in cumulative ed to CAMx, , contributinng to its secoond rank. erms of their performannce with RANNK values of 1.44 ter than CALLPUFF with tthe bias (FB) metric, wheereas ) metric. Figure C‐ ‐29. RANK statistical s peerformance metric for thhe six LRT mmodels and CCAPTEX Releease 3. 31

Figure C‐ ‐27. Fraction nal Bias(FB) statistical pperformancee<br />

metric for <strong>the</strong> six LRT models <strong>and</strong><br />

CAPTEX RRelease<br />

3.<br />

The KS paarameters<br />

fo or <strong>the</strong> six LRRT<br />

models are<br />

shown in FFigure<br />

C‐28. HYSPLIT (31%)<br />

has <strong>the</strong> best<br />

KS parammeter,<br />

which h indicates thhe<br />

best matcch<br />

between <strong>the</strong> predicteed<br />

<strong>and</strong> observed<br />

tracer<br />

concentrration<br />

distrib butions, folloowed<br />

by CAMMx<br />

(38%) annd<br />

<strong>the</strong>n SCIPUFF<br />

(43%). FLEXPART <strong>and</strong><br />

CALGRIDD<br />

are essentia ally tied withh<br />

<strong>the</strong> worst KS parameteer<br />

with a vallue<br />

<strong>of</strong> 58%.<br />

Figure C‐ ‐28. Kolmog gorov – Smirrnov<br />

Parameeter<br />

(KSP) sttatistical<br />

performance<br />

mmetrics<br />

for t<strong>the</strong><br />

six LRT mmodels<br />

for CA APTEX Releaase<br />

3.<br />

30

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!