D5 Annex report WP 3: ETIS Database methodology ... - ETIS plus
D5 Annex report WP 3: ETIS Database methodology ... - ETIS plus D5 Annex report WP 3: ETIS Database methodology ... - ETIS plus
D5 Annex WP 3: DATABASE METHODOLOGY AND DATABASE USER MANUAL – FREIGHT TRANSPORT DEMAND To take advantage of the different areas of specialisation between the team members, the work has been subdivided. MDSTransmodal were responsible for obtaining and processing data from: · France · Spain, and · The United Kingdom In addition, MDSTransmodal was required to produce a database of countrycountrycommodity totals based on the Eurostat Comext (Trade Statistics) database. The database was enhanced by the estimation of the unitised/nonunitised split for each trade flow. This is fundamental for understanding the demand for specific types of transport e.g. trailers, containers, general cargo, liquid bulk, dry bulk etc. Finally, MDSTransmodal was supplied with a German regional database, which was combined with the regional data from the other listed countries to produce a regionregion matrix covering France, Spain, the UK and Germany. Data Collection The success of this project depends to large extent on the type of data readily available from the member states. Although it is technically possible to construct synthetic matrices purely on the basis of measures of economic activity within specific regions, the probability of error is severe. It is therefore critical to be able to analyse trip end totals at a regional level. This provides the necessary input for understanding which industries are located where, and their relative importance. For all three countries within the MDSTransmodal remit, regional data has been successfully obtained. · France The French source is the DNSCE (Customs and Excise) database of external trade. This conveniently classifies trade movements by country of origin/destination, commodity (NST), French Department (NUTS3), and volume (weight and value). The data used within this study is for 1997 full year, and is essentially a complete record of regional imports and exports. The data was processed to remove superfluous data fields, and to compress the commodity definition from NST4 Digit to SITC2Digit, using a standard correlation table. The country codes were the EC standard Comext codes. The main addition was therefore to convert the total tonnes (as given) into unitised and nonunitised tonnes, using lookup tables detailed for each partner country and commodity, derived from MDSTransmodal's trade data archive. The main problem was to deal with country and 136 Document2 27 May 2004
D5 Annex WP 3: DATABASE METHODOLOGY AND DATABASE USER MANUAL – FREIGHT TRANSPORT DEMAND commodity combinations that did not match with any records in the MDSTransmodal lookup tables. For these, an iterative process was developed so that mode factors could be obtained from similar countries or similar commodities or both. Problems also arise from the inclusion of "Departements d'outremer" or "DOM", i.e. the West Indies as regions of France. Users of the database need to be aware that flows into these departements do not represent short sea shipping. The NUTS3 Departements were aggregated to NUTS2 Regions, reducing the total number of subnational zones from 100 (96 excluding DOM) to 21 mainland regions plus Corse, Guadeloupe, Martinique, Guyane, and Reunion. · Spain The situation regarding Spain is somewhat similar to France. Again, the source was a Customs & Excise database, containing regional detail for 50 zones in Spain ("Provincias"). This is equivalent to NUTS3. The database was dispatched on seven magnetic tapes, and amounted to over 700 megabytes of data. A database program was developed by MDSTransmodal to read the files extracted from the tapes, and to compress the data by lifting out the key fields of data. The commodity classification system used was the standard 8 digit Harmonised System, as used within Comext as well as the majority of countries worldwide. Again, correlation tables were used to convert this to 2 digit SITC. Country codes were again based on the standard Eurostat practice. As before, the estimated unitised/nonunitised split was introduced, using the factors already calculated by MDSTransmodal at the national level. The main problem has been the need to compress vast quantities of data to a few megabytes, and the relative unreliabity of using tapes as a storage media. As with the French database, offshore regions such as the Canarias, Baleares, Ceuta and Melilla have required special treatment. The 52 NUTS3 Provincias (including Ceuta and Melilla) have been aggregated to 15 mainland NUTS2 Communidades Autonomas plus Baleares, Canarias, and CeutayMelilla. · The UK The UK experience is somewhat different to Spain and France. UK trade statistics have never recorded regional data such as UK country of origin or destination. The main source of regional data has been the Origin and Destination of International Transport (ODIT) survey, carried out by the UK's Department of the Environment, Transport and the Regions (DETR). This is based upon a sampling technique, and is only carried out every five years (1986, 1991, 1996). Document2 27 May 2004 137
- Page 85 and 86: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 87 and 88: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 89 and 90: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 91 and 92: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 93 and 94: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 95 and 96: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 97 and 98: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 99 and 100: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 101 and 102: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 103 and 104: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 105 and 106: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 107 and 108: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 109 and 110: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 111 and 112: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 113 and 114: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 115 and 116: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 117 and 118: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 119 and 120: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 121 and 122: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 123 and 124: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 125 and 126: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 127 and 128: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 129 and 130: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 131 and 132: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 133: ANNEX C: EXPERIENCE FROM CONCERTED
- Page 138 and 139: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 140 and 141: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 142 and 143: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 144 and 145: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 146 and 147: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 148 and 149: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 151 and 152: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 153 and 154: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 155 and 156: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 157 and 158: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 159 and 160: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 161 and 162: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 163: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 167 and 168: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 169 and 170: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 171 and 172: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 173 and 174: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 175: D5 Annex WP 3: DATABASE METHODOLOGY
- Page 179 and 180: D5 Annex WP 3: DATABASE METHODOLOGY
<strong>D5</strong> <strong>Annex</strong> <strong>WP</strong> 3: DATABASE METHODOLOGY AND DATABASE USER MANUAL –<br />
FREIGHT TRANSPORT DEMAND<br />
To take advantage of the different areas of specialisation between the team members, the work<br />
has been subdivided. MDSTransmodal were responsible for obtaining and processing data<br />
from:<br />
· France<br />
· Spain, and<br />
· The United Kingdom<br />
In addition, MDSTransmodal was required to produce a database of countrycountrycommodity<br />
totals based on the Eurostat Comext (Trade Statistics) database. The database was<br />
enhanced by the estimation of the unitised/nonunitised split for each trade flow. This is<br />
fundamental for understanding the demand for specific types of transport e.g. trailers,<br />
containers, general cargo, liquid bulk, dry bulk etc.<br />
Finally, MDSTransmodal was supplied with a German regional database, which was combined<br />
with the regional data from the other listed countries to produce a regionregion matrix covering<br />
France, Spain, the UK and Germany.<br />
Data Collection<br />
The success of this project depends to large extent on the type of data readily available from the<br />
member states. Although it is technically possible to construct synthetic matrices purely on the<br />
basis of measures of economic activity within specific regions, the probability of error is severe.<br />
It is therefore critical to be able to analyse trip end totals at a regional level. This provides the<br />
necessary input for understanding which industries are located where, and their relative<br />
importance.<br />
For all three countries within the MDSTransmodal remit, regional data has been successfully<br />
obtained.<br />
· France<br />
The French source is the DNSCE (Customs and Excise) database of external trade. This<br />
conveniently classifies trade movements by country of origin/destination, commodity (NST),<br />
French Department (NUTS3), and volume (weight and value). The data used within this study<br />
is for 1997 full year, and is essentially a complete record of regional imports and exports.<br />
The data was processed to remove superfluous data fields, and to compress the commodity<br />
definition from NST4 Digit to SITC2Digit, using a standard correlation table. The country<br />
codes were the EC standard Comext codes.<br />
The main addition was therefore to convert the total tonnes (as given) into unitised and nonunitised<br />
tonnes, using lookup tables detailed for each partner country and commodity, derived<br />
from MDSTransmodal's trade data archive. The main problem was to deal with country and<br />
136<br />
Document2<br />
27 May 2004