Documentation of the Evaluation of CALPUFF and Other Long ...
Documentation of the Evaluation of CALPUFF and Other Long ... Documentation of the Evaluation of CALPUFF and Other Long ...
Figure B‐1 displays the wind speed and direction performance metrics for the second group of CALMET sensitivity tests that uses CALMET grid resolutions of 18 km (EXP1) and 12 km (EXP3 and EXP4) and uses 36 km MM5 (EXP1 and EXP3) and 12 km MM5 (EXP4) data as input to CALMET. EXP1B, EXP3B and EXP4B CALMET sensitivity tests all conform to the recommended settings in the Clarification Memorandum. The “B” series most closely matches observation data. The CALMET model performance statistics for the final group of CTEX3 sensitivity tests corresponding to the EXP5 and EXP6 series of experiments are shown in Figure B‐1. These experiments correspond to using a 4 km grid resolution in CALMET, which is the finest scale recommended in the Clarification Memorandum. They differ in the resolution of MM5 data used as input (36 or 12 km) and how observations are blended into the wind fields (different RMAX1/RMAX2 or no observations). When looking across all wind speed and direction statistics, the CALMET sensitivity simulations that conform to the CALMET settings in the August 2009 Clarification Memorandum (EXP5B and EXP6B) compare most closely to observations. Figure B‐1 displays the CALMET model performance statistics for all sensitivity tests that conform to the recommended CALMET settings in the Clarification Memorandum. The Clarification Memorandum specifies that prognostic meteorological model output data should be used as a first guess wind field in CALMET (IPROG = 14), but doesn’t specify the resolution that the prognostic meteorological model should be run at. For the CALMET grid resolution, the Clarification Memorandum just specifies that it should be ≥ 4 km. Thus these CALMET sensitivity tests vary by grid resolution used in the prognostic meteorological model (80, 36 and 12 km) whose output is used as input to CALMET and the CALMET grid resolution (18, 12 and 4 km). 4
Table B‐2a. Summary wind speed model performance statistics for the CALMET CTEX3 sensitivity tests. RUN WS Gross Error (ms ‐1 WS Bias ) (ms ‐1 WS RMSE ) (ms ‐1 ) IOA BASE A 0.87 ‐0.43 0.81 BASE B 0.85 ‐0.44 1.60 0.82 BASE C 1.22 ‐0.44 1.62 0.63 BASE D 0.80 ‐0.29 1.23 0.83 BASE E 1.14 ‐0.43 1.52 0.68 BASE F 1.22 ‐0.44 1.62 0.63 BASE G NA NA NA NA BASE H 0.85 ‐0.44 1.30 0.82 BASE I 0.81 ‐0.36 1.30 0.82 BASE J 0.93 ‐0.58 1.36 0.80 BASE K 0.80 ‐0.29 1.23 0.83 EXP 1A 0.85 ‐0.44 1.29 0.82 EXP 1B 0.79 ‐0.29 1.22 0.83 EXP 1C 1.18 ‐0.34 1.57 0.68 EXP 1D 1.24 ‐0.34 1.64 0.65 EXP 3A 0.78 ‐0.37 1.26 0.83 EXP 3B 0.73 ‐0.24 1.20 0.85 EXP 3C 1.14 ‐0.37 1.52 0.70 EXP 3D 1.24 ‐0.38 1.64 0.65 EXP 4A 0.78 ‐0.37 1.26 0.83 EXP 4B 0.73 ‐0.24 1.20 0.85 EXP 4C 1.14 ‐0.37 1.52 0.70 EXP 4D 1.24 ‐0.38 1.64 0.65 EXP 5A 0.67 ‐0.29 1.24 0.84 EXP 5B 0.65 ‐0.18 1.19 0.85 EXP 5C 0.91 ‐0.33 1.31 0.80 EXP 5D 1.25 ‐0.45 1.25 0.65 EXP 6A 0.67 ‐0.29 1.24 0.84 EXP 6B 0.65 ‐0.18 1.19 0.85 EXP 6C 0.91 ‐0.33 1.31 0.80 EXP 6D 1.25 ‐0.45 1.66 0.65 5
- Page 149 and 150: 70% 60% 50% 40% 30% 20% 10% 0% Figu
- Page 151 and 152: Figure 6‐9. Factor of Exceedance
- Page 153 and 154: eceiving a 0.0 score. Figure 6‐13
- Page 155 and 156: Table 6‐1. Summary of model ranki
- Page 157 and 158: plume spread and observed surface c
- Page 159 and 160: Figure 6‐16c. Comparison of spati
- Page 161 and 162: • NoPiG: The tracer emissions wer
- Page 163 and 164: Using the NMSE statistical performa
- Page 165 and 166: 6.4.3.2 Effect of PiG on Model Perf
- Page 167 and 168: 80 70 60 50 40 30 20 10 0 1 2 3 4 5
- Page 169 and 170: Table 6‐3. Summary of CALPUFF puf
- Page 171 and 172: 0.2 0.18 0.16 0.14 0.12 0.1 0.08 0.
- Page 173 and 174: Figure 6‐ ‐22 displays the t sp
- Page 175 and 176: Figure 6‐ ‐23a. Global model pe
- Page 177 and 178: Figure 6‐24. Figure of Merit (FMS
- Page 179 and 180: 7.0 REFERENCES Anderson, B. 2008. T
- Page 181 and 182: EPA, 1984: Interim Procedures for E
- Page 183 and 184: Mlawer, E.J., S.J. Taubman, P.D. Br
- Page 185 and 186: 148 Appendix A Evaluation of the MM
- Page 187 and 188: Table A‐1. Wind speed and wind di
- Page 189 and 190: Table A‐3. Definition of the CTEX
- Page 191 and 192: Figure A‐ ‐1. Wind speed bias (
- Page 193 and 194: Figure A‐ ‐3. Humidity bias and
- Page 195 and 196: Table A‐5. Comparison of CTEX5 MM
- Page 197 and 198: B.1 CALMET MODEL EVALUATION TO IDEN
- Page 199: Figure B‐ ‐1 displays th he win
- Page 203 and 204: B.2 CONCLUSIONS OF CTEX3 CALMET SEN
- Page 205 and 206: C.1 INTRODUCTION In this section, t
- Page 207 and 208: C.2.2 HYYSPLIT GLOB BAL STATISTIICS
- Page 209 and 210: The final panel in Figure C‐3 (bo
- Page 211 and 212: Figure C‐ ‐5. Global model m pe
- Page 213 and 214: C.3 CAMX SENSITIVITY TESTS Followin
- Page 215 and 216: ACM2 Kzz combinatio ons rank as the
- Page 217 and 218: Figure C‐ ‐10. Spatial model pe
- Page 219 and 220: Figure C‐ ‐12. Global model per
- Page 221 and 222: Figure C‐ ‐13. Spatial model pe
- Page 223 and 224: Figure C‐ ‐15. Global model per
- Page 225 and 226: Figure C‐ ‐17. Global model per
- Page 227 and 228: Table C‐3. CAMx FMS and POD spati
- Page 229 and 230: Figure C‐ ‐20. False Alarm Rate
- Page 231 and 232: Figure C‐ ‐23. Factor of o Exce
- Page 233 and 234: The PCC values for th he six LRT mo
- Page 235 and 236: The RANK statistical performancce m
- Page 237 and 238: Table C‐55. Summary y of model r
- Page 239 and 240: Results foor the TS me etric are pr
- Page 241 and 242: Figure C‐ ‐35. Factor of o 2 (F
- Page 243 and 244: a negativve FB. The best b performm
- Page 245 and 246: performing model the most often sco
- Page 247: United States Environmental Protect
Figure B‐1 displays <strong>the</strong> wind speed <strong>and</strong> direction performance metrics for <strong>the</strong> second group <strong>of</strong><br />
CALMET sensitivity tests that uses CALMET grid resolutions <strong>of</strong> 18 km (EXP1) <strong>and</strong> 12 km (EXP3<br />
<strong>and</strong> EXP4) <strong>and</strong> uses 36 km MM5 (EXP1 <strong>and</strong> EXP3) <strong>and</strong> 12 km MM5 (EXP4) data as input to<br />
CALMET. EXP1B, EXP3B <strong>and</strong> EXP4B CALMET sensitivity tests all conform to <strong>the</strong> recommended<br />
settings in <strong>the</strong> Clarification Memor<strong>and</strong>um. The “B” series most closely matches observation<br />
data.<br />
The CALMET model performance statistics for <strong>the</strong> final group <strong>of</strong> CTEX3 sensitivity tests<br />
corresponding to <strong>the</strong> EXP5 <strong>and</strong> EXP6 series <strong>of</strong> experiments are shown in Figure B‐1. These<br />
experiments correspond to using a 4 km grid resolution in CALMET, which is <strong>the</strong> finest scale<br />
recommended in <strong>the</strong> Clarification Memor<strong>and</strong>um. They differ in <strong>the</strong> resolution <strong>of</strong> MM5 data<br />
used as input (36 or 12 km) <strong>and</strong> how observations are blended into <strong>the</strong> wind fields (different<br />
RMAX1/RMAX2 or no observations). When looking across all wind speed <strong>and</strong> direction<br />
statistics, <strong>the</strong> CALMET sensitivity simulations that conform to <strong>the</strong> CALMET settings in <strong>the</strong><br />
August 2009 Clarification Memor<strong>and</strong>um (EXP5B <strong>and</strong> EXP6B) compare most closely to<br />
observations.<br />
Figure B‐1 displays <strong>the</strong> CALMET model performance statistics for all sensitivity tests that<br />
conform to <strong>the</strong> recommended CALMET settings in <strong>the</strong> Clarification Memor<strong>and</strong>um. The<br />
Clarification Memor<strong>and</strong>um specifies that prognostic meteorological model output data should<br />
be used as a first guess wind field in CALMET (IPROG = 14), but doesn’t specify <strong>the</strong> resolution<br />
that <strong>the</strong> prognostic meteorological model should be run at. For <strong>the</strong> CALMET grid resolution,<br />
<strong>the</strong> Clarification Memor<strong>and</strong>um just specifies that it should be ≥ 4 km. Thus <strong>the</strong>se CALMET<br />
sensitivity tests vary by grid resolution used in <strong>the</strong> prognostic meteorological model (80, 36 <strong>and</strong><br />
12 km) whose output is used as input to CALMET <strong>and</strong> <strong>the</strong> CALMET grid resolution (18, 12 <strong>and</strong> 4<br />
km).<br />
4
Change language