IGGI member case studies
IGGI members can post information about specific projects to the website as case studies. The subject of case studies can range from major geographical information projects to technical tips associated with software upgrades. If you have a project that you'd like to let others know about, especially if it will inspire other site users or save them time, please contact IGGI staff for more information.
Dept for Communities & Local Government - Regional Resilience Teams, Planning for and Response to Emergencies (Communities and Local Government)
GI Project
Aim
Regional Resilience Team
Regional Resilience Teams
The aim of this project is to provide a GIS capability to the Regional Resilience Teams in each Government Office to assist with the planning for and response to major emergencies.
Background
The Regional Resilience Teams (RRTs) have been operational in each of the Government Offices in England since April 2003. They play an integral part in both planning for and responding to major incidents. Also, during emergencies the RRTs act as an interface between Central Government and the local response.
Therefore, it was envisaged that the provision of a dedicated GIS capability to the RRTs would enhance the sharing of relevant information between the Centre and the Regions, especially during emergencies and crises situations. A GIS would also provide the RRTs with the capability to capture and maintain relevant information, to develop a clear picture of what has happened during an emergency, and also allow them to predict whether further disruption may be expected.
Therefore, it was envisaged that the provision of a dedicated GIS capability to the RRTs would enhance the sharing of relevant information between the Centre and the Regions, especially during emergencies and crises situations. A GIS would also provide the RRTs with the capability to capture and maintain relevant information, to develop a clear picture of what has happened during an emergency, and also allow them to predict whether further disruption may be expected.
Technical commentary
The Resilience Research Branch of the Fire and Resilience Directorate, Communities and Local Government (CLG) has been developing GIS based contingency planning tools for use in support of resilience policies of the CLG, and as decision support in crisis and consequence management. The GIS based tool developed for the RRTs is based on these other tools which have been developed by the Resilience Research Branch. Each RRT has been provided with a high specification standalone laptop loaded with ESRI’s ArcView software along with the Spatial Analyst Extension. A number of customised tools have been developed by ESRI (UK) for use by the RRTs. These tools enable the user to draw certain shapes, such as a cordon or a threat area, and query the data within those areas with ease.
Solutions
In 2004 a GIS capability on standalone dedicated laptops was rolled out to the RRTs in each Government Office to improve the sharing of relevant information between the Centre and the Regions, especially during emergencies. The tool was delivered on standalone laptops due to the nature of the data that is stored and also to enable portability so that the tool could be taken out of the office and used during emergencies and crises situations.
Initially, a six month pilot was held to investigate how the RRTs would use such a capability. During the pilot users were encouraged to use the system for any situation they deemed suitable and also to think about what data would be required to enable the system to be more suitable and tailored to their work. On completion of the pilot a workshop was held so that all users of the tool could share experiences of their use of the system. It was envisaged that by sharing experiences, those users that had not fully used the GIS capability would be able to see the value of such a tool in their day-to-day work.
A post pilot GIS is now in use by the RRTs. The datasets used by these teams varies depending on the event they are planning for or responding to. For example, during severe weather datasets such as the Environment Agency’s Flood Map and the location of response organisations could be used. However, when planning for a flu pandemic datasets such as the locations of hospitals and General Practitioners would be used.
The provision of a GIS capability to the RRTs has altered the way these teams can plan for and respond to major emergencies. One of the main advantages of such a system is that it enables relevant information to be interrogated with ease. This in turn ensures an efficient and effective response in an emergency and allows information to be shared and briefing produced with relative ease.
Lessons Learned
During the pilot stage of this project two versions of ArcView (v3.3. and v8.3) were rolled out in tandem because the customised tools for the Regional Resilience Teams were available in ArcView v3.3 but were still under development in v8.3. Since these tools were seen as very useful for the Regional Resilience Teams’ use of GIS it was decided to roll out version 3.3. However, these customised tools would eventually be available in ArcView v8.3 and because there was a big difference between versions 3.3 and 8.3 it was decided to roll ArcView v8.3 alongside v3.3 so that the Regional Resilience Teams could become acquainted with the latest version of ArcView. Although this was viewed as an ideal way to enable the users of the GIS capability to gradually transfer between versions of ArcView it did lead to some confusion. Ideally, we would have rolled out a complete package in the latest version of ArcView so that the users would not have to switch between two very different versions of the software.
As stated earlier the GIS capability provided to the Regional Resilience Teams is on standalone laptops. This presents a problem when updating the data. Instead of updating one central data source you have to update nine laptops. To overcome this we send out a CD to each of the Regional Resilience Teams with simple step-by-step instructions on how to load the updated datasets. During this project we have learnt that instructions on how to update data must be simple and easy to read as some of the users are not as IT literate as others.
The users of the RRT GIS tools do not necessarily use the system everyday and so skills can fade. Therefore, we have found that the production of simple summary guides of more common tasks, for example how to produce a layout for inclusion in a presentation or report, are very helpful to users when they start to use the GIS tools after a period of inactivity. Refresher exercises and tutorials are also sent out on a regular basis to encourage the GIS users to maintain a certain skill level. The provision of a set of tailored layout templates also enables those users who do not use the GIS tools often to produce effective and professional layouts.
Another lesson that has been learned is the important of having available relevant up to date and accurate datasets, especially an appreciation of those which are deemed to be essential and that these are likely to change as priorities change.
Solutions
In 2004 a GIS capability on standalone dedicated laptops was rolled out to the RRTs in each Government Office to improve the sharing of relevant information between the Centre and the Regions, especially during emergencies. The tool was delivered on standalone laptops due to the nature of the data that is stored and also to enable portability so that the tool could be taken out of the office and used during emergencies and crises situations.
Initially, a six month pilot was held to investigate how the RRTs would use such a capability. During the pilot users were encouraged to use the system for any situation they deemed suitable and also to think about what data would be required to enable the system to be more suitable and tailored to their work. On completion of the pilot a workshop was held so that all users of the tool could share experiences of their use of the system. It was envisaged that by sharing experiences, those users that had not fully used the GIS capability would be able to see the value of such a tool in their day-to-day work.
A post pilot GIS is now in use by the RRTs. The datasets used by these teams varies depending on the event they are planning for or responding to. For example, during severe weather datasets such as the Environment Agency’s Flood Map and the location of response organisations could be used. However, when planning for a flu pandemic datasets such as the locations of hospitals and General Practitioners would be used.
The provision of a GIS capability to the RRTs has altered the way these teams can plan for and respond to major emergencies. One of the main advantages of such a system is that it enables relevant information to be interrogated with ease. This in turn ensures an efficient and effective response in an emergency and allows information to be shared and briefing produced with relative ease.
Lessons Learned
During the pilot stage of this project two versions of ArcView (v3.3. and v8.3) were rolled out in tandem because the customised tools for the Regional Resilience Teams were available in ArcView v3.3 but were still under development in v8.3. Since these tools were seen as very useful for the Regional Resilience Teams’ use of GIS it was decided to roll out version 3.3. However, these customised tools would eventually be available in ArcView v8.3 and because there was a big difference between versions 3.3 and 8.3 it was decided to roll ArcView v8.3 alongside v3.3 so that the Regional Resilience Teams could become acquainted with the latest version of ArcView. Although this was viewed as an ideal way to enable the users of the GIS capability to gradually transfer between versions of ArcView it did lead to some confusion. Ideally, we would have rolled out a complete package in the latest version of ArcView so that the users would not have to switch between two very different versions of the software.
As stated earlier the GIS capability provided to the Regional Resilience Teams is on standalone laptops. This presents a problem when updating the data. Instead of updating one central data source you have to update nine laptops. To overcome this we send out a CD to each of the Regional Resilience Teams with simple step-by-step instructions on how to load the updated datasets. During this project we have learnt that instructions on how to update data must be simple and easy to read as some of the users are not as IT literate as others.
The users of the RRT GIS tools do not necessarily use the system everyday and so skills can fade. Therefore, we have found that the production of simple summary guides of more common tasks, for example how to produce a layout for inclusion in a presentation or report, are very helpful to users when they start to use the GIS tools after a period of inactivity. Refresher exercises and tutorials are also sent out on a regular basis to encourage the GIS users to maintain a certain skill level. The provision of a set of tailored layout templates also enables those users who do not use the GIS tools often to produce effective and professional layouts.
Another lesson that has been learned is the important of having available relevant up to date and accurate datasets, especially an appreciation of those which are deemed to be essential and that these are likely to change as priorities change.
Other GI resources used
The full list of datasets used by the RRTs has a security classification of RESTRICTED and so cannot be published. However, the RRT GIS tool makes use of a number of OS datasets provided through the PGA:
Other datasets include boundary data, population data, and various datasets of the UK national infrastructure and response organisations. The population data used has been produced by a third party, CACI. CACI have modified the 2001 census data by projecting it to 2005 using Government projections and adjusted it to take into account work place and school age populations. CACI have then modelled this data to 100 metre grid squares covering the UK. In doing this, CACI have produced a 2005 day time population dataset and a 2005 night time population dataset. The 100 metre grid resolution enables the RRTs to predict the number of people within cordons and threat areas more effectively than would have been possible with the 2001 census data.
Other datasets include boundary data, population data, and various datasets of the UK national infrastructure and response organisations. The population data used has been produced by a third party, CACI. CACI have modified the 2001 census data by projecting it to 2005 using Government projections and adjusted it to take into account work place and school age populations. CACI have then modelled this data to 100 metre grid squares covering the UK. In doing this, CACI have produced a 2005 day time population dataset and a 2005 night time population dataset. The 100 metre grid resolution enables the RRTs to predict the number of people within cordons and threat areas more effectively than would have been possible with the 2001 census data.
Future
The pilot stage of this project highlighted a number of options for further enhancement of the Regional Resilience Team GIS capability. The main option being the development of a networked GIS for the Regional Resilience Teams. The current GIS capability is on standalone laptops and the main advantage of this is that it is portable and can therefore be taken out of the office and used during incidents. However, it has its limitations in that only one person per team can use the laptop at any one time and because it cannot be connected to a network it is not easy to share documents with others. A networked GIS for the Regional Resilience Teams will therefore overcome these issues. Other options for further development include the provision of portable colour printers and digital projectors to enable the standalone GIS tool to be of greater use during incidents.
An ongoing requirement of this project is to ensure that the data used is up-to-date, accurate and relevant. As priorities change within the Regional Resilience Teams the requirement for certain datasets also change. For example, if a priority is to plan for a flu pandemic, datasets such as the locations of hospitals and GP surgeries as well as primary care trust and strategic health authority boundaries would become a requirement.
An ongoing requirement of this project is to ensure that the data used is up-to-date, accurate and relevant. As priorities change within the Regional Resilience Teams the requirement for certain datasets also change. For example, if a priority is to plan for a flu pandemic, datasets such as the locations of hospitals and GP surgeries as well as primary care trust and strategic health authority boundaries would become a requirement.
References
Metadata - Typical example of a Discovery Metadata Record on the BGS web site (British Geological Survey (BGS))
GI Project
Aim
BGS Discovery Metadata Dataset
BGS Discovery Metadata Records
Since its foundation in 1835 the BGS has been collecting and managing data and information, creating millions of records and hundreds of datasets.
This represented a rich and re-usable information source but, paradoxically, the nation as a whole was largely unaware of its existence and availability. It is important that all organizations whose activities generate or otherwise assemble substantial datasets must create and maintain accessible metadata records.
Since its foundation in 1835 the BGS has been collecting and managing data and information, creating millions of records and hundreds of datasets.
This represented a rich and re-usable information source but, paradoxically, the nation as a whole was largely unaware of its existence and availability. It is important that all organizations whose activities generate or otherwise assemble substantial datasets must create and maintain accessible metadata records.
Background
By definition a collection of Discovery Metadata is designed to be made available to the public and shared with them, so that it can be accessed and searched by as wide a group of potential users as possible.
Technical commentary
Standards/Technology
The BGS has implemented BS ISO 19115:2003. Metadata records are held and managed within an Oracle® RDBMS, which provides security, sustainability and ease of searching.
The Challenge
It is part of the BGS mission to disseminate information in the community, to promote the public understanding of science, and to demonstrate the importance of the geosciences to resource and environmental issues. The importance of metadata is recognised within the e-Government Interoperability Framework (e-GIF) by the UK government, which has mandated that all government-related information systems should create metadata.
Standards for geographic metadata have changed since our initial records were collated; we needed to gather up to date information compliant with current standards on more than 400 datasets and develop the systems needed to hold and distribute them effectively.
Solution
Collated information regarding significant BGS datasets has been entered into a database within the corporate Oracle® RDBMS (Relational Database Management System) that has been specifically designed to comply with ISO 19115 2003, Geographic information – Metadata. For each dataset the information collected complies with the minimum requirements for the standard together with some additional elements relevant to BGS.
The metadata records are available internally via the BGS Intranet and copies are accessible to the general public via the BGS website ( http://www.bgs.ac.uk ). The static copies displayed on the website are updated periodically from the database as new records are added and existing records amended.
Lessons Learned
To ensure that the best possible information is provided the metadata compiler needs a clear understanding of the metadata field definitions and a detailed perception of the types and levels of information that are needed. In most instances it is more efficient, and a more satisfactory record is obtained, if an experienced metadata professional works with the dataset manager to compile the metadata record.
The BGS has implemented BS ISO 19115:2003. Metadata records are held and managed within an Oracle® RDBMS, which provides security, sustainability and ease of searching.
The Challenge
It is part of the BGS mission to disseminate information in the community, to promote the public understanding of science, and to demonstrate the importance of the geosciences to resource and environmental issues. The importance of metadata is recognised within the e-Government Interoperability Framework (e-GIF) by the UK government, which has mandated that all government-related information systems should create metadata.
Standards for geographic metadata have changed since our initial records were collated; we needed to gather up to date information compliant with current standards on more than 400 datasets and develop the systems needed to hold and distribute them effectively.
Solution
Collated information regarding significant BGS datasets has been entered into a database within the corporate Oracle® RDBMS (Relational Database Management System) that has been specifically designed to comply with ISO 19115 2003, Geographic information – Metadata. For each dataset the information collected complies with the minimum requirements for the standard together with some additional elements relevant to BGS.
The metadata records are available internally via the BGS Intranet and copies are accessible to the general public via the BGS website ( http://www.bgs.ac.uk ). The static copies displayed on the website are updated periodically from the database as new records are added and existing records amended.
Lessons Learned
To ensure that the best possible information is provided the metadata compiler needs a clear understanding of the metadata field definitions and a detailed perception of the types and levels of information that are needed. In most instances it is more efficient, and a more satisfactory record is obtained, if an experienced metadata professional works with the dataset manager to compile the metadata record.
Future
Currently the metadata system holds Discovery Metadata details alongside other datasets that use the same core tables together with extra tables that cover fields specific to particular collections, e.g. 3D modelling or maps. An increase in the number of metadata collections is planned and work has started on designing the database tables required to store metadata relevant to GIS shape files.
References
Department for Transport - Annual Average Daily Traffic Flow - Website Homepage (Department for Transport (DfT))
GI Project
Aim
Annual Average Daily Traffic Flow - homepage
Annual Average Daily Traffic Flow - Website
GB Traffic Estimates are an important dataset for Government and commercial work. There is an increasing demand for traffic flow data for individual links of the major road network, which it has been decided to facilitate by employing a GIS-based website to provide users with continual access to this data.
DfT Annual Average Daily Traffic Flow - Website
Background
Annual Average Daily Traffic Flow website www.dft.gov.uk/matrix/ - is an innovative use of GIS to illustrate DfT's traffic data using the latest Ordnance Survey digitised maps. Users gain access to Annual Average Daily Flows (vehicle numbers), and traffic (million vehicle-kms) for each major road link in GB. Data are viewable on-screen in a GIS map, or downloadable via a 'search' facility, for years 1999-2006 (all of which are updated annually). Searches can be filtered by geographic area, road number, and vehicle type. The GIS layers can be manipulated to display traffic data by vehicle type, and allow the user to switch on/off various GIS layers. The web site provides ready access, free of charge, to data currently held internally within DfT, previously only available by email request (for which commercial organisations were charged) at a far greater level of detail than previously available. It has substantially reduced the 1,000 p/a enquiries, by handling 3,000 visits per month.
Technical commentary
The application uses MapInfo's MapXtreme 2005, Spatialware and is integrated with an SQL Server database.
Standards
1. Government Guidelines for websites (May 2002)
2. WAI Accessibility double AA standard - Version 1
3. Government Interoperability Framework (e-GIF) - Version 6
4. e-Government Metadata Standard (e-GMS)
5. Integrated Public Sector Vocabulary (IPSV)
6. e-GMS v3.1 for Web Sites
In terms of W3C compliance, this relates to the non-GIS mapping areas, and an 'A' rating was sought where possible.
Lessons Learned
Standards
1. Government Guidelines for websites (May 2002)
2. WAI Accessibility double AA standard - Version 1
3. Government Interoperability Framework (e-GIF) - Version 6
4. e-Government Metadata Standard (e-GMS)
5. Integrated Public Sector Vocabulary (IPSV)
6. e-GMS v3.1 for Web Sites
In terms of W3C compliance, this relates to the non-GIS mapping areas, and an 'A' rating was sought where possible.
Lessons Learned
- Use a generic name for the website to avoid conflict when adding datasets with different names to the original dataset.
- Data quality and standards are critical, requiring data cleaning before making data available to the public or contractors. Internal use of a password-protected Extranet (using the same mapping solution) for data cleaning purposes is invaluable.
- On-line demonstrations of web site for receipt of feedback, thus enabling improvements to be captured before public launch.
- Use of a staging and development web-server prior to deploying the public and extranet websites has proved invaluable for proof-checking functionality and content.
- Great potential to expand contents with other datasets, providing excellent method to combine disparate dataset layers.
Other GI resources used
Parliamentary Constituent Boundaries
London Congestion Zone (incl. western extension)
DfT major road network schema
DfT Annual Average Daily Flows
London Congestion Zone (incl. western extension)
DfT major road network schema
DfT Annual Average Daily Flows
Future
1. Extranet site: using the same mapping solution, with password-protected access, allowing:
2. On-line data-inputting tool, with (i) graphical interface for validation of traffic data submitted by contractors, (ii) automated invoice generation (anticipated demo launch Nov07).
Construction of OGC server to 'stream' mapping solution to DfT contractors' desktop GIS applications. WMS server successfully used (Sept07), and WFS server available when MapInfo can resolve their source code errors.
3. The following datasets have been identified for possible future inclusion on the website for GB's major road network. However, a considerable amount of work needs to be undertaken first before they are added:
Highways Agency traffic flows for English trunk roads, and possible equivalents for Scotland and Wales.
Road Accident casualties
Speed Limits
Congestion data
Traffic data relating to minor roads
- On-line amendments to details about Count Sites (demo launched Sep07, enhanced version 16Oct07).
2. On-line data-inputting tool, with (i) graphical interface for validation of traffic data submitted by contractors, (ii) automated invoice generation (anticipated demo launch Nov07).
Construction of OGC server to 'stream' mapping solution to DfT contractors' desktop GIS applications. WMS server successfully used (Sept07), and WFS server available when MapInfo can resolve their source code errors.
3. The following datasets have been identified for possible future inclusion on the website for GB's major road network. However, a considerable amount of work needs to be undertaken first before they are added:
References
The same mapping solution is also employed in another DfT website for the Origin and Destination Survey found here
For access to the above mentioned Extranet, please contact Andrew Smith
For access to the above mentioned Extranet, please contact Andrew Smith
BBC - Digital Switchover (British Broadcasting Corporation (BBC))
GI Project
Aim
Crystal Palace transmitter coverage
Digital UK Postcode checker (consumer view)
Digital Switchover started on October 17th 2007 and involves converting every UK TV transmitter from analogue to digital. The BBC uses GIS data to predict the coverage areas of these transmitters across the UK and so to provide advice to consumers who might need to change their receiving aerials.
Digital UK Postcode checker (trade view)
Path profile plot
Populated Pixels
Spaghetti coverage review tool
Background
Digital Switchover is not just one event. 1,160 transmitters have to be converted on a region-by-region basis commencing in October 2007 and running until the end of 2012. There are about 50 separate switching dates, and at every step the coverage of TV services in the UK changes as new frequencies come on, old ones go off, and the pattern of interference between sites varies. The BBC needs to calculate the transmitter coverage at every step to ensure that viewers will continue to receive TV services throughout the process, and to communicate the various digital reception options to them and to the aerial installation trade.
Technical commentary
The starting point of the calculation engine is a database of every transmitter location, aerial height, frequency, power output, antenna radiation pattern, and polarisation for each of the 50 switching steps.
We then split the whole UK into a grid of 100 metre squares, and for each switching step, and for each transmitter and for each 100m grid square, we use terrain height data to produce a path profile plot from that grid square to the transmitter site. Knowing the height of the transmitter mast and assuming a nominal receiving aerial height of 10m above ground level, we calculate the path loss across this terrain using a physical model of radio wave propagation known as the UK Planning Model (UKPM). The UKPM takes into account the shape of the landscape, diffraction of signals over obstructions, ground clutter (trees, buildings), propagation characteristics over water and typical UK weather conditions. For every grid square we then consider the path loss for each transmitter then in service, and the directions of those transmitters along with the directional characteristics of a typical receiving aerial, to calculate the amount of signal received from the best transmitter and the amount of interference received from other transmitters, to decide if that grid square can receive TV or not.
The calculation engine runs across seven Unix servers, each having 6 microprocessors and 32GB of RAM, and takes approximately one week to produce an answer.
The resulting database is passed to Digital UK, the independent body tasked with communicating Digital Switchover, who run a website where viewers enter their address and receive personalised advice on how and when switchover will affect them.
Lesson Learned
In order to reduce the amount of calculation required, three main techniques are used. Firstly, we only calculate coverage to a 100m grid square if it is known that it is inhabited. We use the OS Addresspoint product to calculate the Populated Pixels, and only calculate to these points. Secondly, we use a simple propagation rule to calculate the maximum possible extent over which a transmitter might have an effect. For example, a large site like Crystal Palace in London has a useable range of about 50 miles but can cause interference up to 300 miles away or more, whereas a small site may only have a maximum influence of 30 miles and so its effect need not be calculated beyond that point. By generating a Bounding-box for each site based on a simple distance rule, the number of calculations required is significantly reduced. Thirdly, many of the transmission parameters at many of the sites do not change from one switching step to the next, and so as much data as possible is cached for reuse.
We then split the whole UK into a grid of 100 metre squares, and for each switching step, and for each transmitter and for each 100m grid square, we use terrain height data to produce a path profile plot from that grid square to the transmitter site. Knowing the height of the transmitter mast and assuming a nominal receiving aerial height of 10m above ground level, we calculate the path loss across this terrain using a physical model of radio wave propagation known as the UK Planning Model (UKPM). The UKPM takes into account the shape of the landscape, diffraction of signals over obstructions, ground clutter (trees, buildings), propagation characteristics over water and typical UK weather conditions. For every grid square we then consider the path loss for each transmitter then in service, and the directions of those transmitters along with the directional characteristics of a typical receiving aerial, to calculate the amount of signal received from the best transmitter and the amount of interference received from other transmitters, to decide if that grid square can receive TV or not.
The calculation engine runs across seven Unix servers, each having 6 microprocessors and 32GB of RAM, and takes approximately one week to produce an answer.
The resulting database is passed to Digital UK, the independent body tasked with communicating Digital Switchover, who run a website where viewers enter their address and receive personalised advice on how and when switchover will affect them.
Lesson Learned
In order to reduce the amount of calculation required, three main techniques are used. Firstly, we only calculate coverage to a 100m grid square if it is known that it is inhabited. We use the OS Addresspoint product to calculate the Populated Pixels, and only calculate to these points. Secondly, we use a simple propagation rule to calculate the maximum possible extent over which a transmitter might have an effect. For example, a large site like Crystal Palace in London has a useable range of about 50 miles but can cause interference up to 300 miles away or more, whereas a small site may only have a maximum influence of 30 miles and so its effect need not be calculated beyond that point. By generating a Bounding-box for each site based on a simple distance rule, the number of calculations required is significantly reduced. Thirdly, many of the transmission parameters at many of the sites do not change from one switching step to the next, and so as much data as possible is cached for reuse.
Other GI resources used
• OS AddressPoint is used to calculate the populated 100 metre pixels.
• OS Landform Panorama data is used to calculate the terrain profile between each receiving point and each transmitter (noting that earth curvature is significant over these distances and is also calculated). The BBC did use OS Landform Profile instead, which was included in the PGA, although the resolution of this data set was too high and had to be sub-sampled to a more manageable size. However, when the new funding model for PGA2 was introduced, Ofcom left the PGA and, as it is essential that all spectrum planners across the industry use the same data sets and physical models, the BBC downgraded to Landform Profile as being the cheapest terrain option available to all.
• A basic clutter database from InfoTerra is used within the physical propagation model.
• OS AddressPoint is used by Digital UK to map a viewer’s address on to the 100m square of the calculated coverage database.
• Mapinfo software, embedded within our own bespoke spectrum planning tool (known as Spaghetti), is used by our spectrum planners to visualise and analyse the coverage results, in conjunction with OS raster maps.
(note: similar data is also sourced from other providers for Northern Ireland, Isle of Man and Channel Isles)
• OS Landform Panorama data is used to calculate the terrain profile between each receiving point and each transmitter (noting that earth curvature is significant over these distances and is also calculated). The BBC did use OS Landform Profile instead, which was included in the PGA, although the resolution of this data set was too high and had to be sub-sampled to a more manageable size. However, when the new funding model for PGA2 was introduced, Ofcom left the PGA and, as it is essential that all spectrum planners across the industry use the same data sets and physical models, the BBC downgraded to Landform Profile as being the cheapest terrain option available to all.
• A basic clutter database from InfoTerra is used within the physical propagation model.
• OS AddressPoint is used by Digital UK to map a viewer’s address on to the 100m square of the calculated coverage database.
• Mapinfo software, embedded within our own bespoke spectrum planning tool (known as Spaghetti), is used by our spectrum planners to visualise and analyse the coverage results, in conjunction with OS raster maps.
(note: similar data is also sourced from other providers for Northern Ireland, Isle of Man and Channel Isles)
Future
The Digital UK address checker has just launched on its public website, and will soon be promoted heavily as being the main source of technical data about digital switchover.
The BBC continues to adjust the switching orders, power levels and antenna patterns within the switchover plan in an attempt to minimise any disruption caused to viewers during switchover.
Our bespoke planning tool is soon to be expanded to include FM radio and DAB radio planning, which is currently undertaken on less sophisticated systems.
The BBC continues to adjust the switching orders, power levels and antenna patterns within the switchover plan in an attempt to minimise any disruption caused to viewers during switchover.
Our bespoke planning tool is soon to be expanded to include FM radio and DAB radio planning, which is currently undertaken on less sophisticated systems.
References
Digital UK Postcode checker.
British Geological Survey - System for Integrated GeoSpatial Mapping (SIGMA) (British Geological Survey (BGS))
GI Project
Aim
Ardnamurchan
Tablet
Collection and publication of geological map data are central to the British Geological Survey’s Mission. This project set out to integrate discrete Survey workflows covering initial planning, field data collection, data interpretation, map compilation and final cartographic output into a single digital workflow. The flowchart illustrates the full workflow.
Background
Parts of the pre-existing map-related workflows exploited digital technology, but others still relied upon analogue methods. Constant switching between analogue and digital elements led to significant inefficiencies. Creation of a single, integrated digital workflow was recognized as a potential means of removing these inefficiencies. Equally it was recognized that standardisation on the use of ArcGIS as the main software platform throughout the proposed integrated workflow was desirable, to reduce the cost of training staff to use multiple software environments. Adoption of a single software platform also facilitates movement of data along the workflow, as the same data formats are used throughout. Communication and mutual mentoring among team members with different skills, backgrounds and roles is also facilitated by shared use of the same tools.
Technical commentary
ESRI’s ArcGIS underpins the entire workflow. NERC has a framework agreement with ESRI, a GIS market leader.
Data preparation: ArcMap is used to review existing geological data and to clip and download selected items along with portions of National datasets, including Ordnance Survey basemaps, NEXTMap, etc. These data can be referenced in the field, via Tablet PCs and Laptops.
Virtual Field Reconnaissance is based around ArcGlobe, which allows users to “visit” anywhere in Great Britain and view all BGS National datasets in 3D (data served from Oracle via ArcSDE). Users can add local datasets as required.
Fieldwork Technology: Tablet PC, Microsoft XP for Tablet Edition with customised ArcMap, plus Microsoft Access and InfiNotes.
Map compilation, geoprocessing and analysis use a combination of ArcMap, ArcCatalog, ArcGlobe and ArcScene. Approved data are loaded to corporate servers as shapefiles, grids, SDE feature classes and SDE raster datasets and catalogs, depending upon dataset type.
Lesson Learned
Very large datasets such as aerial photograph are slow to display in ArcGIS when using Image catalogs. The use of Spatial Database Engine (SDE) can significantly improve the performance of large raster and vector datasets. Other options for large image layer are compressed formats such as ECW. The use of this latter format for the BGS aerial photography layer has improved the access performance in ArcMap dramatically. These solutions also reduce network traffic.
Data preparation: ArcMap is used to review existing geological data and to clip and download selected items along with portions of National datasets, including Ordnance Survey basemaps, NEXTMap, etc. These data can be referenced in the field, via Tablet PCs and Laptops.
Virtual Field Reconnaissance is based around ArcGlobe, which allows users to “visit” anywhere in Great Britain and view all BGS National datasets in 3D (data served from Oracle via ArcSDE). Users can add local datasets as required.
Fieldwork Technology: Tablet PC, Microsoft XP for Tablet Edition with customised ArcMap, plus Microsoft Access and InfiNotes.
Map compilation, geoprocessing and analysis use a combination of ArcMap, ArcCatalog, ArcGlobe and ArcScene. Approved data are loaded to corporate servers as shapefiles, grids, SDE feature classes and SDE raster datasets and catalogs, depending upon dataset type.
Lesson Learned
Very large datasets such as aerial photograph are slow to display in ArcGIS when using Image catalogs. The use of Spatial Database Engine (SDE) can significantly improve the performance of large raster and vector datasets. Other options for large image layer are compressed formats such as ECW. The use of this latter format for the BGS aerial photography layer has improved the access performance in ArcMap dramatically. These solutions also reduce network traffic.
Other GI resources used
NEXTMap Britain Digital Elevation Model and Digital Surface Model (InterMap)
Aerial Photography (getmapping and Infoterra)
DiGMap (BGS geology layers)
Local and other National datasets are brought in as required to aid interpretation; some examples are:
Landsat imagery
Gravity data
Aeromagnetic data
Geochemical data
Other Datasets
NEXTMap Britain Digital Elevation Model NEXTMap Britain Digital Surface Model
Aerial Photography
DiGMap (BGS geology layers)
Other
Landsat imagery
Gravity data
Aeromagnetic data
Geochemical data
Software
ESRI
ArcGIS
ArcInfo
ArcView
ArcEditor
ArcGIS 3D Analyst
ArcGIS Spatial Analyst
Aerial Photography (getmapping and Infoterra)
DiGMap (BGS geology layers)
Local and other National datasets are brought in as required to aid interpretation; some examples are:
Landsat imagery
Gravity data
Aeromagnetic data
Geochemical data
Other Datasets
NEXTMap Britain Digital Elevation Model NEXTMap Britain Digital Surface Model
Aerial Photography
DiGMap (BGS geology layers)
Other
Landsat imagery
Gravity data
Aeromagnetic data
Geochemical data
Software
ESRI
ArcGIS
ArcInfo
ArcView
ArcEditor
ArcGIS 3D Analyst
ArcGIS Spatial Analyst
Future
In the future BGS will serve Globe and map data over its Intranet using ArcGIS Server, providing access via both ArcGIS Explorer and ArcGlobe. ArcGIS Explorer will support access to large BGS National datasets using only a thin client, promoting easier handling of terabyte-sized datasets, without the need for powerful desktop computers. Ongoing development of the virtual fieldwork element of the workflow will enable preliminary capture of potential geological boundary positions before fieldwork commences. As geologists will then be able to target critical areas that need to be visited during fieldwork this will increase both the speed and effectiveness of geological interpretation. A longer term aspiration involves planning and achievement of more efficient digital communications between field and office to streamline the already integrated workflow even more.
References
Further information about SIGMA can be found at SIGMA
British Potato Council - Implementing Map Based Planting Returns (British Potato Council)
GI Project
Aim
A Map Return
Data Entry from Map Returns
Growers are required to complete a detailed return of all their potato plantings. In the past, they did so using Ordnance Survey Map References to identify the location of fields. When it became clear that there was a high degree of geographical error in this data, we decided accuracy could only be significantly increased by allowing growers to use maps.
Background
Planting returns data is vitally important to us. We raise bills based on that information, so we need to be able to validate that data (area checking) by visiting and/or flying over a proportion of fields each year. If a grower provides an inaccurate map reference (often unintentionally!), a lot of time and money was being wasted trying to locate this field.
Inaccurate data causes problems in other areas of activity: for example, we gather market information by selecting fields and analysing liftings from them; equally, accurate knowledge of where fields are may be vital in the case of tracking disease.
The aim of the project was (1) to print out plantings returns with integral maps, and then (2) to develop a GIS data entry system for processing this map-based data when it was returned.
Inaccurate data causes problems in other areas of activity: for example, we gather market information by selecting fields and analysing liftings from them; equally, accurate knowledge of where fields are may be vital in the case of tracking disease.
The aim of the project was (1) to print out plantings returns with integral maps, and then (2) to develop a GIS data entry system for processing this map-based data when it was returned.
Technical commentary
Our existing grower systems are all built in Delphi (with SQL Server Database). We were already using ESRI’s ArcIMS software for a browser based GIS and their ArcGIS suite, so I chose ESRI’s MapObjects components as they seemed to integrate well with Delphi.
Lesson Learned
I feel our choice of software has generally been very successful. Using ESRI’s MapObjects and (more recently) TatukGIS’s Developer Kernel Toolkit has enabled us to leverage our existing Delphi skills to develop systems that work very well for us.
If I have a regret, it is perhaps in not trying out TatukGIS’s Developer Kernel Toolkit (DKT) sooner. However both sets of components have fitted in very well with Delphi, and have caused no significant problems. They have enabled me to develop systems quickly, and their speed in handling maps and creating shape files on the fly is impressive. This latter ability is very important, and I have already used the DKT to develop for remote staff an intranet GIS which operates off live data – as soon as the data is entered at head office, home-based staff can see it on maps. This is what users expect now-a-days.
The ArcGIS suite has proved invaluable for creating and printing one-off maps.
Lesson Learned
I feel our choice of software has generally been very successful. Using ESRI’s MapObjects and (more recently) TatukGIS’s Developer Kernel Toolkit has enabled us to leverage our existing Delphi skills to develop systems that work very well for us.
If I have a regret, it is perhaps in not trying out TatukGIS’s Developer Kernel Toolkit (DKT) sooner. However both sets of components have fitted in very well with Delphi, and have caused no significant problems. They have enabled me to develop systems quickly, and their speed in handling maps and creating shape files on the fly is impressive. This latter ability is very important, and I have already used the DKT to develop for remote staff an intranet GIS which operates off live data – as soon as the data is entered at head office, home-based staff can see it on maps. This is what users expect now-a-days.
The ArcGIS suite has proved invaluable for creating and printing one-off maps.
Other GI resources used
Software
ESRI
MapObjects
ArcGIS
TatukGIS
Developer Kernel Toolkit
ESRI
MapObjects
ArcGIS
TatukGIS
Developer Kernel Toolkit
Future
The consequence of these systems has been a huge increase in the geographical accuracy of the data we have been collecting from growers.
But we are keen to take the next step, which is to offer to growers a means of entering their data on-line, using a secure GIS website. I am currently developing this, but using TatukGIS’s Develop Kernel Toolkit instead of MapObjects, as TatukGIS’s components can be integrated with Delphi to build Internet systems. Also TatukGIS’s products have been praised for their speed. We expect to roll out this new system to some of our growers in April 2008.
Apart from offering our customers a means of completing returns on-line, we expect it to save us time (and so money) both in reducing the number of returns that need printing, and preventing many errors made by growers when completing their returns on paper.
But we are keen to take the next step, which is to offer to growers a means of entering their data on-line, using a secure GIS website. I am currently developing this, but using TatukGIS’s Develop Kernel Toolkit instead of MapObjects, as TatukGIS’s components can be integrated with Delphi to build Internet systems. Also TatukGIS’s products have been praised for their speed. We expect to roll out this new system to some of our growers in April 2008.
Apart from offering our customers a means of completing returns on-line, we expect it to save us time (and so money) both in reducing the number of returns that need printing, and preventing many errors made by growers when completing their returns on paper.
Defence Estates - e-Terrier (Defence Estates (DE))
GI Project
Aim
e-Terrier
The implementation of the Electronic Terrier was primarily to replace the paper based system that had been traditionally used to record the MoD land holdings. The business requirement was to offer a central location from which Defences Estates land agents could easily access any deed from a GIS interface.
Background
The paper system was becoming unreliable as many of the documents were old and increasingly difficult to handle and interpret. They were also disseminated around the country at various offices and were getting lost or were unavailable as they were in use. Additional to this, the Terrier is maintained as two components: a textual record and a map based record. The old system associated the components through a manual cross referencing system making it possible for them to become out of sync. These were the main issues with the paper system and thus the drivers behind the implementation of the E-Terrier.
The aim was to replicate the Terrier system in everyway within a bespoke desktop IT solution and place dependencies between the two components so that they are presented within a work flow. All of the data and information from the map sheets to the deeds would be presented in the appropriate digital format.
The aim was to replicate the Terrier system in everyway within a bespoke desktop IT solution and place dependencies between the two components so that they are presented within a work flow. All of the data and information from the map sheets to the deeds would be presented in the appropriate digital format.
Technical commentary
The standards employed were:
No official national or international standards were adhered to with the roll out of the application, though all data now captured by DE and presented on the system, is captured to OSLandline in all instances.
Lesson Larned
Data
The major difference between the old Terrier and the E-Terrier is the data management. For the old Terrier the data was managed locally with a local system in place, however for the E-Terrier the local systems were all merged into a national system.
It was found in a number of cases that there were duplicate numbers across offices as the numbering system up until E-Terrier had been local and no consideration was given to the fact that duplicate numbers may be a possibility. Impacting the problem further was the geographic changes to the County boundaries that took place across England and Wales in 1974 as a result of the Local Government Act 1972.
It was identified early that such a problem may exist, however early attempts to fix this problem failed as the full scale of the problem was not apparent at the time. Subsequent investigation and work has now corrected a majority of these problems. However a fuller investigation prior to roll out may have saved the extra work that was needed further down the line.
Functionality
As mentioned, the idea with the E-Terrier was to fully replicate the existing Terrier system albeit within a tighter and controlled environment. However now that we are using the system, it has been realised that some effort should have been made in investigating some areas of the system which could have been streamlined, automated or even removed, so as to take advantage of the technology and increase user experience.
No official national or international standards were adhered to with the roll out of the application, though all data now captured by DE and presented on the system, is captured to OSLandline in all instances.
Lesson Larned
Data
The major difference between the old Terrier and the E-Terrier is the data management. For the old Terrier the data was managed locally with a local system in place, however for the E-Terrier the local systems were all merged into a national system.
It was found in a number of cases that there were duplicate numbers across offices as the numbering system up until E-Terrier had been local and no consideration was given to the fact that duplicate numbers may be a possibility. Impacting the problem further was the geographic changes to the County boundaries that took place across England and Wales in 1974 as a result of the Local Government Act 1972.
It was identified early that such a problem may exist, however early attempts to fix this problem failed as the full scale of the problem was not apparent at the time. Subsequent investigation and work has now corrected a majority of these problems. However a fuller investigation prior to roll out may have saved the extra work that was needed further down the line.
Functionality
As mentioned, the idea with the E-Terrier was to fully replicate the existing Terrier system albeit within a tighter and controlled environment. However now that we are using the system, it has been realised that some effort should have been made in investigating some areas of the system which could have been streamlined, automated or even removed, so as to take advantage of the technology and increase user experience.
Other GI resources used
The software used to implement and manage the E-Terrier as it exists on our systems today are:
OSNI Raster 50K
OSNI Landline
OSNI Boundary Datasets
OSNI Transport Datasets
OSNI Raster 250k
ESRI ArcSDE
ESRI ArcIMS
ESRI ArcGIS
Oracle 9i
Microsoft Internet Explorer v6
Lizardtech GeoExpress and Document Express free plugins
Lizardtech GeoExpress encoder software
Lizardtech Document Express encoder software
OSNI Raster 50K
OSNI Landline
OSNI Boundary Datasets
OSNI Transport Datasets
OSNI Raster 250k
ESRI ArcSDE
ESRI ArcIMS
ESRI ArcGIS
Oracle 9i
Microsoft Internet Explorer v6
Lizardtech GeoExpress and Document Express free plugins
Lizardtech GeoExpress encoder software
Lizardtech Document Express encoder software
Future
Since the initial launch of the E-Terrier, two projects have been run in order to enhance performance and fix data issues, and to add user defined functional enhancements.
One key enhancement that we have installed is the ability to change the layers displayed within the browser environment. This is an out of the box function, however the E-terrier is bespoke and this functionality was lost. Prior to this enhancement, we required ESRI to perform such requests. We now request this functionality in all browser applications we have developed.
DE is currently working to upgrade the E-Terrier to version 9.1 of the ESRI software which will be rolled out in July 2007.
From user group meetings key functional requirements and improvements have been identified that DE will look to install soon.
We are also looking at modifying some aspects of the functionality and changing existing processes by utilising new technology; specifically ESRI GIS Server 9.2. To investigate the possibilities of this further we are developing a prototype later this year.
One key enhancement that we have installed is the ability to change the layers displayed within the browser environment. This is an out of the box function, however the E-terrier is bespoke and this functionality was lost. Prior to this enhancement, we required ESRI to perform such requests. We now request this functionality in all browser applications we have developed.
DE is currently working to upgrade the E-Terrier to version 9.1 of the ESRI software which will be rolled out in July 2007.
From user group meetings key functional requirements and improvements have been identified that DE will look to install soon.
We are also looking at modifying some aspects of the functionality and changing existing processes by utilising new technology; specifically ESRI GIS Server 9.2. To investigate the possibilities of this further we are developing a prototype later this year.
References
It was known that the E-Terrier should be presented as an internet GIS browser based solution. This technology obviously has the advantages of reduced overall cost of software when compared to a desktop solution and also in the management and dissemination of data.
The E-Terrier is presented with a normal browser window with tools which enable the user to navigate the map. To aid navigation the two OS raster datasets are used and have associated with them appropriate scale cut-offs. Alongside the OS mapping we also decided to scan our large scale Terrier map sheets, geo-reference them and present them in a raster catalogue as selectable layers. This ensured that all historical data captured on these maps was presented along side the new data that would be captured using modern techniques. The scanned deeds are available to the users upon clicking on a polygon. This would then trigger the scanned documents corresponding to the geographic area to open in a separate window so they can be viewed. Obviously this presented a problem with historic data and would need all of the polygons to be captured to present this data in a similar fashion. This was solved by having only the circular reference points on the Terrier sheet, which traditionally displayed the reference number, captured as polygons. These were then added as an invisible layer, and operate as such that when a user clicks on one of the circular references which are on the scanned map sheet; they are clicking on a polygon which links through to the appropriate document.
As a result of having the E-Terrier in place, the important maps and deeds can now be moved to secure locations. Defence Estates is now more geared up for a more corporate approach to the management and dissemination of data. We also now have completely moved away from maintaining paper based maps and now keep only digital records on the estate holdings of the MoD.
In implementing the E-Terrier, Defence Estates have saved in the following areas:
• Redrawing old terrier map sheets
• Storing maps sheets and deeds securely
• Training staff on antiquated Terrier technique
• Employing extra staff to bring the Terrier processes in line.
The E-Terrier is presented with a normal browser window with tools which enable the user to navigate the map. To aid navigation the two OS raster datasets are used and have associated with them appropriate scale cut-offs. Alongside the OS mapping we also decided to scan our large scale Terrier map sheets, geo-reference them and present them in a raster catalogue as selectable layers. This ensured that all historical data captured on these maps was presented along side the new data that would be captured using modern techniques. The scanned deeds are available to the users upon clicking on a polygon. This would then trigger the scanned documents corresponding to the geographic area to open in a separate window so they can be viewed. Obviously this presented a problem with historic data and would need all of the polygons to be captured to present this data in a similar fashion. This was solved by having only the circular reference points on the Terrier sheet, which traditionally displayed the reference number, captured as polygons. These were then added as an invisible layer, and operate as such that when a user clicks on one of the circular references which are on the scanned map sheet; they are clicking on a polygon which links through to the appropriate document.
As a result of having the E-Terrier in place, the important maps and deeds can now be moved to secure locations. Defence Estates is now more geared up for a more corporate approach to the management and dissemination of data. We also now have completely moved away from maintaining paper based maps and now keep only digital records on the estate holdings of the MoD.
In implementing the E-Terrier, Defence Estates have saved in the following areas:
• Redrawing old terrier map sheets
• Storing maps sheets and deeds securely
• Training staff on antiquated Terrier technique
• Employing extra staff to bring the Terrier processes in line.
Defence Estates - GEographic Online Data for Estates (GEODE) (Defence Estates (DE))
GI Project
Aim
GEODE Screenshot
GEODE provides Defence users access to an increased variety of up-to-date Estate related data on demand, through a web browser interface. GEODE also provides users with the capability to create and disseminate custom maps to communicate change and reduce the misinterpretation of data as well as improving data quality through user feedback.
Background
In 1999 DE launched its first web-based map browser which provided access to a limited range of estate information and some large scale mapping, together with some basic geographic analysis tools. In late 2003 DE embarked on a project to build upon its existing web-browser capabilities to improve the delivery of corporate estate-related information to its staff and customers, so as to support DE’s strategic objective to ‘manage and use information, knowledge and supporting systems available to provide effective solutions and deliver agreed business benefits’.
GEODE was developed as part of an ‘Estate Information Portal’ which provides users on the MOD corporate network with the ability to search and retrieve a range of corporate estate related information through a common access point.
GEODE was developed as part of an ‘Estate Information Portal’ which provides users on the MOD corporate network with the ability to search and retrieve a range of corporate estate related information through a common access point.
Technical commentary
The standards employed were:
The project management methodology used to deliver the GEODE Project was PRINCE 2 (PRojects In A Controlled Environment). The main PRINCE2 products used during the delivery were project initiation document (PID), business case, monthly highlight reports, risk and issue logs, request for change, project plans, work packages, and quality logs.
Metadata is stored and delivered to a FGDC/ISO combination using tools available from ESRI. Clearly the availability to store and deliver to the UK Gemini standard is a longer term aspiration.
For consistency, GEODE whenever possible uses display standards from other leading web mapping applications such as MAGIC and Nature on the Map as the standard for the visualisation of the Third Party spatial data (e.g. SSSI’s).
Solution
The majority of the requirements concentrated on developing a new mechanism for delivering both tabular and spatial information to the desktop. The delivered solution uses data stored in Oracle and ESRI ArcSDE/Oracle with a customised ESRI ArcIMS web front end. The resulting mapping application is known as GEographic On-line Data for Estates (GEODE).
Early in the design phase DE established a GOLD+ Enhancement Product Review Team (PRT) comprised of DE Subject Matter Experts (SME) and representatives from DE’s Customer Estate Organisations (CEstOs), Army, Navy and Defence Logistic Organisation. The PRT provided oversight and review of the design, development and testing of GEODE. The development of GEODE followed a Rapid Application Development type methodology whereby development modules were installed on the DE network, tested and returned to the developers for update. Improvements put forward by the PRT were therefore incorporated throughout the development encouraging customer buy-in and sense of ownership.
GEODE is dependent on the supply of corporate estate information from a number of disparate data sources, the integration of the data presented a significant challenge during the development. Throughout the development, changes were made to the scope of information shown, the way it was displayed as well as developing the unique identifiers used to join the data. The data issues encountered were the primary source of delay in the implementation of the development. GEODE displays an integrated view of spatial data supplied from GIS and non-GIS data sources. Within GEODE there are mechanisms for users to provide feedback on data quality which have directly led to improvements.
For consistency, GEODE whenever possible uses display standards from other leading web mapping applications such as MAGIC and Nature on the Map as the standard for the visualisation of the Third Party spatial data (e.g. SSSI’s).
As with many systems of this type it is often difficult to quantify the real benefits obtained from the introduction of the application particularly where this results in more informed decisions. However indications of the level of use of the system have shown that the system users are predominately non-DE staff, some 60%.
Lesson Learn
Data
It is probably not a surprise that data has proved to be one of the most problematical areas. DE as an organisation is responsible for the MOD estate across the UK. We therefore need to take data, such as SSSI boundaries, from the various national bodies and merge to create a true UK picture. Often this data will not have the same attributes or will have a mixture of numeric and alphanumeric key fields. This requires additional processing before the data can be presented corporately.
Even with DE derived data sets there have been issues with ensuring that data which is managed on one server is successfully replicated on the GEODE server. To maximize server performance the ideal is to have a database tuned for read only access, which is not therefore available for the type of read/write access that a regularly updated dataset requires.
There have also been issues with the presence of restricted characters within datasets which have impacted on the functionality which can be delivered within the application.
Placing all data into ArcSDE has considerably enhanced the speed of the application which had previously been reading data in flat files or from raster catalogues.
The project management methodology used to deliver the GEODE Project was PRINCE 2 (PRojects In A Controlled Environment). The main PRINCE2 products used during the delivery were project initiation document (PID), business case, monthly highlight reports, risk and issue logs, request for change, project plans, work packages, and quality logs.
Metadata is stored and delivered to a FGDC/ISO combination using tools available from ESRI. Clearly the availability to store and deliver to the UK Gemini standard is a longer term aspiration.
For consistency, GEODE whenever possible uses display standards from other leading web mapping applications such as MAGIC and Nature on the Map as the standard for the visualisation of the Third Party spatial data (e.g. SSSI’s).
Solution
The majority of the requirements concentrated on developing a new mechanism for delivering both tabular and spatial information to the desktop. The delivered solution uses data stored in Oracle and ESRI ArcSDE/Oracle with a customised ESRI ArcIMS web front end. The resulting mapping application is known as GEographic On-line Data for Estates (GEODE).
Early in the design phase DE established a GOLD+ Enhancement Product Review Team (PRT) comprised of DE Subject Matter Experts (SME) and representatives from DE’s Customer Estate Organisations (CEstOs), Army, Navy and Defence Logistic Organisation. The PRT provided oversight and review of the design, development and testing of GEODE. The development of GEODE followed a Rapid Application Development type methodology whereby development modules were installed on the DE network, tested and returned to the developers for update. Improvements put forward by the PRT were therefore incorporated throughout the development encouraging customer buy-in and sense of ownership.
GEODE is dependent on the supply of corporate estate information from a number of disparate data sources, the integration of the data presented a significant challenge during the development. Throughout the development, changes were made to the scope of information shown, the way it was displayed as well as developing the unique identifiers used to join the data. The data issues encountered were the primary source of delay in the implementation of the development. GEODE displays an integrated view of spatial data supplied from GIS and non-GIS data sources. Within GEODE there are mechanisms for users to provide feedback on data quality which have directly led to improvements.
For consistency, GEODE whenever possible uses display standards from other leading web mapping applications such as MAGIC and Nature on the Map as the standard for the visualisation of the Third Party spatial data (e.g. SSSI’s).
As with many systems of this type it is often difficult to quantify the real benefits obtained from the introduction of the application particularly where this results in more informed decisions. However indications of the level of use of the system have shown that the system users are predominately non-DE staff, some 60%.
Lesson Learn
Data
It is probably not a surprise that data has proved to be one of the most problematical areas. DE as an organisation is responsible for the MOD estate across the UK. We therefore need to take data, such as SSSI boundaries, from the various national bodies and merge to create a true UK picture. Often this data will not have the same attributes or will have a mixture of numeric and alphanumeric key fields. This requires additional processing before the data can be presented corporately.
Even with DE derived data sets there have been issues with ensuring that data which is managed on one server is successfully replicated on the GEODE server. To maximize server performance the ideal is to have a database tuned for read only access, which is not therefore available for the type of read/write access that a regularly updated dataset requires.
There have also been issues with the presence of restricted characters within datasets which have impacted on the functionality which can be delivered within the application.
Placing all data into ArcSDE has considerably enhanced the speed of the application which had previously been reading data in flat files or from raster catalogues.
Other GI resources used
OS Derived Data from various 3rd Parties including:
CADW
Countryside Commission for Wales
DEFRA
English Heritage
Environment Agency
Historic Scotland
Natural England
Scottish Natural Heritage
Defence Estates Derived Datasets including:
MOD Boundary
MOD Hirings & Lettings
MOD Byelaws
The software used to implement and manage the E-Terrier as it exists on our systems today are:
ESRI ArcSDE
ESRI ArcIMS
ESRI ArcGIS
Oracle 9i
Microsoft Internet Explorer v6
Background Mapping Data:
Defence Geographic Centre (Raster & Vector Datasets)
OSGB Miniscale
OSGB Raster 250K
OSGB Raster 50K
OSGB Landline
OSGB Boundary Line
OSNI Raster 210K
OSNI Raster 50K
OSNI Landline
OSNI Boundary Datasets
OSNI Transport Datasets
CADW
Countryside Commission for Wales
DEFRA
English Heritage
Environment Agency
Historic Scotland
Natural England
Scottish Natural Heritage
Defence Estates Derived Datasets including:
MOD Boundary
MOD Hirings & Lettings
MOD Byelaws
The software used to implement and manage the E-Terrier as it exists on our systems today are:
ESRI ArcSDE
ESRI ArcIMS
ESRI ArcGIS
Oracle 9i
Microsoft Internet Explorer v6
Background Mapping Data:
Defence Geographic Centre (Raster & Vector Datasets)
OSGB Miniscale
OSGB Raster 250K
OSGB Raster 50K
OSGB Landline
OSGB Boundary Line
OSNI Raster 210K
OSNI Raster 50K
OSNI Landline
OSNI Boundary Datasets
OSNI Transport Datasets
Future
Since the initial launch of GEODE in 2005 two phases of improvements have been initiated to provide additional data sets and to add user defined functional enhancements.
Key to this has been the support of an active and vocal user steering group who authorise enhancements and changes to the application.
Originally viewed as a tool to support land management activities with a strong environmental bias the application is now seeking to support other areas of the business, including facilities management and the training estate.
We are also looking at modifying some aspects of the functionality and changing existing processes by utilising new technology; specifically ESRI GIS Server 9.2. To investigate the possibilities of this further we are developing a prototype later this year.
Key to this has been the support of an active and vocal user steering group who authorise enhancements and changes to the application.
Originally viewed as a tool to support land management activities with a strong environmental bias the application is now seeking to support other areas of the business, including facilities management and the training estate.
We are also looking at modifying some aspects of the functionality and changing existing processes by utilising new technology; specifically ESRI GIS Server 9.2. To investigate the possibilities of this further we are developing a prototype later this year.
Dept for Communities & Local Government - Area of Town Centre Activity (ACTA's) (Communities and Local Government)
GI Project
Aim
Area of Town Centre Activity - Figure 1
Area of Town Centre Activity - Figure 1
The overall aim of the project is to develop a nationally consistent method for defining boundaries and statistics around concentrations of activities typically associated with town centres. The boundaries defined in this project are known as 'Areas of Town Centre Activity' (ATCAs) to differentiate them from policy-defined town centre boundaries.
Area of Town Centre Activity - Figure 2
Area of Town Centre Activity - Figure 3
Background
There is widespread interest in monitoring the vitality of town centres, in being able to make comparisons between centres, and to support planning policy which favours the direction of retail development towards town centre locations.
The consistency of the boundaries generated by the project allows for easy comparison of the statistics within the ATCA boundaries.
Users should note that the project defines areas containing town centre activity for statistical monitoring and comparisons. These areas have no policy status and are not town centres for policy purposes.
Although most ATCAs will be designated town centres, some are not. Their appearance in the project does not imply they are recognised as town centres in local plans.
Also, some centres designated in development plans may not appear here. The exclusion of a centre does not mean that it is not a town centre. It simply means that within the model the density of town centre activity is not enough for it appear.
The consistency of the boundaries generated by the project allows for easy comparison of the statistics within the ATCA boundaries.
Users should note that the project defines areas containing town centre activity for statistical monitoring and comparisons. These areas have no policy status and are not town centres for policy purposes.
Although most ATCAs will be designated town centres, some are not. Their appearance in the project does not imply they are recognised as town centres in local plans.
Also, some centres designated in development plans may not appear here. The exclusion of a centre does not mean that it is not a town centre. It simply means that within the model the density of town centre activity is not enough for it appear.
Technical commentary
The model used is based on SQL2000, administered through ArcSDE, and with the front-end embedded in an ArcGIS desktop. The Spatial Analyst extension is required for the model to run. MS Visual FoxPro 9 is also used to view the data.
Other GI resources used
Annual Business Inquiry (ABI) employee data at unit postcode level from the Office for National Statistics;
Floorspace and rateable value statistics at property level from the Valuation Office Agency;
All Fields Postcode Directory;
1:10,000 scale colour raster for identification of town centres; and
1:50,000 scale colour raster for identification of town centres.
Floorspace and rateable value statistics at property level from the Valuation Office Agency;
All Fields Postcode Directory;
1:10,000 scale colour raster for identification of town centres; and
1:50,000 scale colour raster for identification of town centres.
Future
Boundaries and statistics for ATCAs have been published for 2000 and 2002 and are available here
Statistics and boundaries for 1998-2004 (including a revision of previously published 2000 and 2002 statistics and boundaries) will be released via the Communities and Local Government's State of the Cities Database in spring 2007.
Updates are planned on an annual basis.
Statistics and boundaries for 1998-2004 (including a revision of previously published 2000 and 2002 statistics and boundaries) will be released via the Communities and Local Government's State of the Cities Database in spring 2007.
Updates are planned on an annual basis.
References
Information on Areas of Town Centre Activity
Information on the Annual Business Inquiry
Information on commercial and industrial property statistics
Valuation Office Agencywebsite
Information on the Annual Business Inquiry
Information on commercial and industrial property statistics
Valuation Office Agencywebsite
Dept for Communities & Local Government - Generalised Land Use Database (GLUD) (Communities and Local Government)
GI Project
Aim
GLUD: Image 1
GLUD: Image 2
The Generalised Land Use Database (GLUD) has been developed to support Communities and Local Government's key public service agreements. These include Neighbourhood renewal; balancing housing supply and demand as well as green space data to support PSA on Liveability. GLUD provides a range of statistical information using OS MasterMap to inform Government policy.
GLUD: Image 3
Background
GLUD provides statistics showing land type for all of England. These are illustrated across nine simplified categories plus 'unclassified' and provide a basis for comparing, for example the availability of green space between similarly defined administrative areas.
Technical commentary
GLUD statistics show the area of different land types for Census Output Areas (OAs), Lower Layer Super Output Areas (LSOAs), Middle Layer Super Output Areas (MSOAs), Local Authorities (Las) and Government Office Regions (GORs) in England.
Other GI resources used
2003 CAS ward
References
NeSS - Comprehensive metadata about data described in GLUD
Communities and Local Government - statistics also available for CAS wards
Communities and Local Government - statistics also available for CAS wards
Dept for Communities & Local Government - Housing Affordability (Department for Transport (DfT))
GI Project
Aim
Housing Affordability
Housing Affordability: Image 2
Housing affordability is an ever-increasing problem in Britain (and in England particularly). Most of the work carried out by the Department has been on a regional basis and relatively little has been done at a lower level.
This work was conceived to help provide guidance to how spatially diverse housing affordability is throughout the country and how this pattern has changed over time.
This work was conceived to help provide guidance to how spatially diverse housing affordability is throughout the country and how this pattern has changed over time.
Housing Affordability: Image 3
Background
The work started under the auspices of the Government Response to the Barker Review of Housing Supply. A set of maps running from 1996 to 2005 were regarded as being a useful tool to demonstrate to the Housing and Planning Cabinet Committee how significant an issue housing affordability is.
Whilst house prices have continued to increase throughout the country there has been different impacts on different areas, and it is this that means that no single solution will help deal with the problem. For instance, the increase in the south-west of England is mainly due to second homes, whilst in the south-east it is more related to pressure for commuting homes. Only by looking at the whole spatial picture can these patterns be fully understood.
In addition, the differences between workplace earnings and residential earnings is an interesting factor to look at as it can start to open up patterns around locations where it is cheaper to work and live against those where it is cheaper to commute to.
Whilst house prices have continued to increase throughout the country there has been different impacts on different areas, and it is this that means that no single solution will help deal with the problem. For instance, the increase in the south-west of England is mainly due to second homes, whilst in the south-east it is more related to pressure for commuting homes. Only by looking at the whole spatial picture can these patterns be fully understood.
In addition, the differences between workplace earnings and residential earnings is an interesting factor to look at as it can start to open up patterns around locations where it is cheaper to work and live against those where it is cheaper to commute to.
Technical commentary
All this work was carried out in ArcGIS, Excel and Access.
The combination of earnings data with house prices was done in Access and Excel along with calculations of affordability and the differences between workplace and residential patterns.
ArcGIS was used to produce the final map output.
Solution
All data processing was carried out in Access and Excel to produce a lower quartile housing affordability score – namely lower quartile house prices / lower quartile earnings at the local authority level. This produces a ratio of how many times a yearly salary would be needed to pay for a dwelling. The lower quartile is used as this is the best proxy for first time buyers.
As well as simply affordability ratios, statistics such as the change over time (e.g. difference between 1996 and 2000, or the average yearly change between two years) and the difference between using residential earnings and workplace earnings can be calculated.
ArcGIS was then used as a data dissemination tool and as an easy way to communicate the results. The maps were created through the usual steps of joining statistical data to shapefiles (using the common ONS LA code) and used a static legend for the whole series from 1996 – 2005 to instantly convey how affordability changes over time.
This application is relatively low on the technology and technique side. Instead, its strengths lie in the visualisation of output from statistical analysis. Such visualisations of statistical data can help to stress to policymakers what has happened in the past and how much impact their policies are having on the country.
It is only as one tracks the growing red patches of high unaffordability that the true speed of change becomes apparent. Equally maps demonstrating change between periods help show how increases initially started in London before spreading through the south-east and south-west, before the rate in the Midlands and north increased in an attempt to “catch-up” with changes further south.
The combination of earnings data with house prices was done in Access and Excel along with calculations of affordability and the differences between workplace and residential patterns.
ArcGIS was used to produce the final map output.
Solution
All data processing was carried out in Access and Excel to produce a lower quartile housing affordability score – namely lower quartile house prices / lower quartile earnings at the local authority level. This produces a ratio of how many times a yearly salary would be needed to pay for a dwelling. The lower quartile is used as this is the best proxy for first time buyers.
As well as simply affordability ratios, statistics such as the change over time (e.g. difference between 1996 and 2000, or the average yearly change between two years) and the difference between using residential earnings and workplace earnings can be calculated.
ArcGIS was then used as a data dissemination tool and as an easy way to communicate the results. The maps were created through the usual steps of joining statistical data to shapefiles (using the common ONS LA code) and used a static legend for the whole series from 1996 – 2005 to instantly convey how affordability changes over time.
This application is relatively low on the technology and technique side. Instead, its strengths lie in the visualisation of output from statistical analysis. Such visualisations of statistical data can help to stress to policymakers what has happened in the past and how much impact their policies are having on the country.
It is only as one tracks the growing red patches of high unaffordability that the true speed of change becomes apparent. Equally maps demonstrating change between periods help show how increases initially started in London before spreading through the south-east and south-west, before the rate in the Midlands and north increased in an attempt to “catch-up” with changes further south.
Other GI resources used
Land Registry Lower Quartile House Prices by LA (published by Communities and Local Government)
Annual Survey of Hours and Earnings – Lower Quartile earnings by LA (ONS)
OS BoundaryLine – Government Office Regions and Local Authority boundaries, Scotland and Wales outline
OS Meridian 2 – mean high water coastline for clipping BoundaryLine
Annual Survey of Hours and Earnings – Lower Quartile earnings by LA (ONS)
OS BoundaryLine – Government Office Regions and Local Authority boundaries, Scotland and Wales outline
OS Meridian 2 – mean high water coastline for clipping BoundaryLine
Future
A number of issue areas have been thrown up for further investigation. In particular, the Department’s current monitoring under its PSAs focuses entirely on affordability based on workplace earnings. This has advantages in that the earnings data has a longer history of supply over the residential data and it fits in with the ideals of everyone living and working in the same local authority.
On the other hand, however, being realistic it is not possible for everyone to live local to work and is certainly not the case for a significant proportion of the population. Therefore further work on looking at the differences in the pattern between the two sets of earnings data is warranted – such analysis can help to highlight the areas in which the residents seem to have better affordability ratios than the people who actually work there.
In addition, this work has only looked at lower quartile levels at the moment – a very different pattern could well appear at median or mean levels.
On the other hand, however, being realistic it is not possible for everyone to live local to work and is certainly not the case for a significant proportion of the population. Therefore further work on looking at the differences in the pattern between the two sets of earnings data is warranted – such analysis can help to highlight the areas in which the residents seem to have better affordability ratios than the people who actually work there.
In addition, this work has only looked at lower quartile levels at the moment – a very different pattern could well appear at median or mean levels.
Dept for Communities & Local Government - The State of the Gateway: A Baseline for Evaluating the Thames Gateway Programme (Communities and Local Government)
GI Project
Aim
Thames Gateway
Thames Gateway
This baseline report aims to provide a comprehensive picture of the Gateway, inform the development of the Policy Framework and provide a base against which we can measure and understand change in the future.
Background
The Department launched a cross-Departmental policy programme for the Thames Gateway in July 2003. The Department is proposing to improve understanding of policy impacts and inform future strategy development in the Thames Gateway by understanding the context for policy and broader changes relevant to the aspirations for sustainable communities. This analysis will help us to understand how the area is functioning and the drivers of change.
The report presents baseline information to help us understand the broader context in the Thames Gateway and how the area is functioning. In the future, this information can be updated to assess whether we are achieving sustainable growth. A broad range of indicators have been included to provide evidence in relation to policy interests across the department (including social exclusion, housing delivery, etc.) and other Government Departments (e.g., skills, health, employment).
The report presents baseline information to help us understand the broader context in the Thames Gateway and how the area is functioning. In the future, this information can be updated to assess whether we are achieving sustainable growth. A broad range of indicators have been included to provide evidence in relation to policy interests across the department (including social exclusion, housing delivery, etc.) and other Government Departments (e.g., skills, health, employment).
Technical commentary
Solution
The report had to paint a picture of the Thames Gateway, its sub-regions, local areas and features at the start point of the Thames Gateway programme. With particular reference to the following themes:
A number of these themes can be readily presented in tables and charts which will illustrate change over time. However, a number also benefit from being graphically represented in order to add context. A particular problem of the Thames Gateway is that it suffers a bit from a lack of a distinctive identity because its borders do not follow those of either government office regions, local authorities or wards. As such, it was invaluable to present the reader with a series of maps to show exactly where the Thames Gateway area is, what is contained within it and where the key loctions are.
Other aspects of the Thames Gateway which needed to be communicated graphically included:
The report had to paint a picture of the Thames Gateway, its sub-regions, local areas and features at the start point of the Thames Gateway programme. With particular reference to the following themes:
- Geography & environment
- Community and social inclusion
- Education and skills
- Transport and connectivity
- Decent Places to live
A number of these themes can be readily presented in tables and charts which will illustrate change over time. However, a number also benefit from being graphically represented in order to add context. A particular problem of the Thames Gateway is that it suffers a bit from a lack of a distinctive identity because its borders do not follow those of either government office regions, local authorities or wards. As such, it was invaluable to present the reader with a series of maps to show exactly where the Thames Gateway area is, what is contained within it and where the key loctions are.
Other aspects of the Thames Gateway which needed to be communicated graphically included:
- Flood risk, which is important in relation to the proposed new developments
- Brownfield sites, illustrating how many areas in the Gateway are ripe for regeneration
- Transport links and travel to work areas – to illustrate the improving connectivity in the Thames Gateway
- Deprivation
- Air quality
- Public attractions
- Environmental quality and sites of special scientific interest
- Population density
A number of the datasets were created by using a suite of indicators based on the state of the Cities indicators, supplemented by data from the Census, LFS, Annual Business Inquiry and several other datasets. The indicators were aggregated to the relevant Thames Gateway geographies and presented in the form of either charts, tables or maps.
The report also made use of a number of different shapefiles/maps held by Data Statistics and Infrastructure Division.
The benefits of our approach is that it provides policy colleagues with a handy reference guide to the characteristics of the gateway and a basis from which future monitoring and evaluation can be developed. The report has also assisted with the development of the evidence base, thereby contributing to better policymaking.
As it is a baseline report, it is hard to definitively identify the totality of benefits and cost savings, and changes prompted by the report.
Other GI resources used
1981, 1991, 2001 Census ward boundaries for TG geographies
2003 Casward boundaries for TG geographies
Local Authority Boundaries for TG geographies
Numerous indicators from the State of the Cities database (including IMD and air quality indicators)
Points of interest (public attractions in the Thames Gateway)
Key stations and transport links in the Thames Gateway
Travel to Work Areas in the Thames Gateway
Population density in the Thames Gateway
Flood risk areas in the Thames Gateway (Environment Agency)
Protected environmental areas in the Thames Gateway (English Nature)
Previously developed Land in the Thames Gateway (NLUD)
RPG 9 geographical boundaries
2003 Casward boundaries for TG geographies
Local Authority Boundaries for TG geographies
Numerous indicators from the State of the Cities database (including IMD and air quality indicators)
Points of interest (public attractions in the Thames Gateway)
Key stations and transport links in the Thames Gateway
Travel to Work Areas in the Thames Gateway
Population density in the Thames Gateway
Flood risk areas in the Thames Gateway (Environment Agency)
Protected environmental areas in the Thames Gateway (English Nature)
Previously developed Land in the Thames Gateway (NLUD)
RPG 9 geographical boundaries
Future
We are currently working on a follow on project to improve the accessibility of information about the Gateway by loading the Thames Gateway geographies onto the department’s Places database and establishing links between Places and Thames Gateway London partnership’s Knowledge Platform system.
References
English Heritage - Corporate GIS Implementation: webGIS and deskGIS (English Heritage)
GI Project
Aim
English Heritage WebGIS
English Heritage WebGIS
Enable staff to quickly and easily obtain and combine a range of accurate and definitive casework, planning and research information about the historic environment.
Provide staff with national seamless coverage of OS maps and the ability to regressively compare modern and historic mapping dating back to the Victorian era.
Provide staff with national seamless coverage of OS maps and the ability to regressively compare modern and historic mapping dating back to the Victorian era.
English Heritage WebGIS
Environmental Designations.
Background
The project formed a key element of the Chief Executive’s 2002 “Coming of Age” modernizing agenda by-lined: “giving staff the right tools for the right job”. In addition to the 2 aims there was a requirement to:
- Migrate over 1,000,000 spatial records from 2 legacy GIS databases and dynamically link them with textual records held in 6 legacy Oracle databases.
- Implement an architecture to support EH’s longer term strategic objectives which includes the addition of an even greater range of internal and third party data, field based data capture and public-facing web GIS access to all EH’s heritage data
Technical commentary
ArcIMS is used to power webGIS. webGIS provides all 1900 staff with user-friendly access to definitive data. It enables powerful spatial and thematic queries to be combined across multiple datasets, the production of simple reports and high quality maps using pre-defined templates.
The solution devised a method to validate, clean and migrate 1,000,000 spatial records. The data is loaded, maintained and managed in two Oracle Databases with ArcSDE. The records have been linked with the six legacy databases using a combination of web services and PL/SQL technology. This data is held alongside 700GB of modern and historical mapping.
ArcGIS is installed on two CITRIX boxes for deskGIS and deployed to users through CITRIX clients. deskGIS is used to enhance the data and perform more advanced analysis, it can be deployed throughout EH including historic properties and is customised to enable fast and efficient data capture.
Lesson Learned
• Having a dedicated support database set up so that you can easily retrieve old enquiries and the solutions, also useful to track trends.
• Having a method for reporting and recording data errors saves time and ensures issues are followed up
• Having a method of prioritising requests for change etc established is very useful
• Senior director buy in is key to success – particularly to obtain resource for testing etc.
• Testing takes much longer than you think!
• Good working relationship with the supplier is vital
• Dedicated Project Manager with experience of running IT projects (not necessarily GIS) gives you a much chance of success
• Clear and concise communication strategy is key to engaging with users (as well as a free lunch to entice people to come to meetings)
• Producing a national seamless coverage of Historical Mapping is not a simple task!
• Rapid Application Development approach worked well to help people who didn’t understand GIS – and we’ve continued to use it for other projects
• How to guides with step by step instructions are the preferred type of training notes
• Customise deskGIS training to just cover individuals flowlines rather than try and teach an introduction to ArcGIS.
• Cumulative searching is often required (i.e. querying more than one data layer at a time)
The solution devised a method to validate, clean and migrate 1,000,000 spatial records. The data is loaded, maintained and managed in two Oracle Databases with ArcSDE. The records have been linked with the six legacy databases using a combination of web services and PL/SQL technology. This data is held alongside 700GB of modern and historical mapping.
ArcGIS is installed on two CITRIX boxes for deskGIS and deployed to users through CITRIX clients. deskGIS is used to enhance the data and perform more advanced analysis, it can be deployed throughout EH including historic properties and is customised to enable fast and efficient data capture.
Lesson Learned
• Having a dedicated support database set up so that you can easily retrieve old enquiries and the solutions, also useful to track trends.
• Having a method for reporting and recording data errors saves time and ensures issues are followed up
• Having a method of prioritising requests for change etc established is very useful
• Senior director buy in is key to success – particularly to obtain resource for testing etc.
• Testing takes much longer than you think!
• Good working relationship with the supplier is vital
• Dedicated Project Manager with experience of running IT projects (not necessarily GIS) gives you a much chance of success
• Clear and concise communication strategy is key to engaging with users (as well as a free lunch to entice people to come to meetings)
• Producing a national seamless coverage of Historical Mapping is not a simple task!
• Rapid Application Development approach worked well to help people who didn’t understand GIS – and we’ve continued to use it for other projects
• How to guides with step by step instructions are the preferred type of training notes
• Customise deskGIS training to just cover individuals flowlines rather than try and teach an introduction to ArcGIS.
• Cumulative searching is often required (i.e. querying more than one data layer at a time)
Other GI resources used
English Heritage Datasets
Scheduled Monuments
Listed Buildings
Parks and Gardens
Battlefields
World Heritage Sites
NMR AMIE Monuments
NMR AMIE Events
Other
Prewar Historical Mapping supplied by Landmark
Maritime Boundaries supplied by Law of the Sea, UKHO
Ancient Woodland
AONB
Heritage Coast
Joint character Areas
Local Nature researves
National Nature Reserves
National Parks
Natural Areas
RAMSAR
SAC
SPA
SSSI
Scheduled Monuments
Listed Buildings
Parks and Gardens
Battlefields
World Heritage Sites
NMR AMIE Monuments
NMR AMIE Events
Other
Prewar Historical Mapping supplied by Landmark
Maritime Boundaries supplied by Law of the Sea, UKHO
Ancient Woodland
AONB
Heritage Coast
Joint character Areas
Local Nature researves
National Nature Reserves
National Parks
Natural Areas
RAMSAR
SAC
SPA
SSSI
Future
- Training continues to be provided throughout the organisation – to date over 700 staff have attended a 3 hour training course in webGIS
- Starting to look at our public interface (through the Heritage Gateway) in conjunction with re-designing systems as a result of changes to designation as set out in the Heritage White Paper
- Mobile Data Capture
- Spatially enabling the internal case work system
- Adding new datasets (e.g. SeaZone, Conservation Areas, EH Estates, Statutory Protected Wrecks) to corporate database
References
English Heritage
Heritage Gateway
\'GIS is proving to be an indispensable tool in our day-to-day casework. Goodness knows how we coped before.\'
Casework Assistant
\'webGIS looks great and is priceless for us in our work lives.\'
Business Manager
Heritage Gateway
\'GIS is proving to be an indispensable tool in our day-to-day casework. Goodness knows how we coped before.\'
Casework Assistant
\'webGIS looks great and is priceless for us in our work lives.\'
Business Manager
Enviroment Agency - Virtual Environmental Planning – an Interreg Project (Environment Agency (EA))
GI Project
Aim
VEPS logo
VEPS in use
The Virtual Environmental Planning Project (VEPs) is developing web applications to help people view, comment on and understand the environmental issues associated with proposed planning developments and help them to participate more fully in the planning process.
Demonstrations of the technology are freely accessible here
Demonstrations of the technology are freely accessible here
3D view
Sample area
Background
The Virtual Environmental Planning project (VEPs) is an alternative approach to planning consultation, allowing people to view and make comments on planning developments in three-dimensions (3D) within the context of an existing landscape or cityscape.
Many people find it difficult to:
By combining 3D views with discussion forums, VEPs allows people to freely explore and interact with 3D models and make comments directly via an online system. Anyone accessing the web application will be able to view these comments and share their own views online, 24 hours a day.
Many people find it difficult to:
- access and comment on planning proposals during office hours
- visualise what a development will look like from two-dimensional plans
- understand how planning decisions are made and how their comments are taken into account
By combining 3D views with discussion forums, VEPs allows people to freely explore and interact with 3D models and make comments directly via an online system. Anyone accessing the web application will be able to view these comments and share their own views online, 24 hours a day.
Technical commentary
The VEPs project is bringing together 3D views, 2D maps and discussion forums in a web browser,
These three web service components talk to each other via a simple message broker.
Comments, in the form of text, pictures or audio, may then be attached to buildings or located at sites of interest using any of these components. Environmental information such as flood and noise models can also be added to help people understand the environmental implications of planning decisions.
- 3D VRML visualizations delivered using Deegree (opensource
- web3D service from a database storing CityGML (OGC standard) building and terrain data.
- 2D maps from a web map service (WMS)
- Comments geo-located in 3D space and associated with an object (e.g. a building) delivered via a web feature service (WFS).
These three web service components talk to each other via a simple message broker.
Comments, in the form of text, pictures or audio, may then be attached to buildings or located at sites of interest using any of these components. Environmental information such as flood and noise models can also be added to help people understand the environmental implications of planning decisions.
Other GI resources used
Aerial Photography
Building datasets derived from Lidar
Terrain derived from Lidar
Open source (OGS compliant) Web services, WMS, WFS, W3DS.
Building datasets derived from Lidar
Terrain derived from Lidar
Open source (OGS compliant) Web services, WMS, WFS, W3DS.
Future
The VEPs project has investigated how existing flood models and maps can be visualised in 3D. The aim of this approach is to help people understand the environmental implications of planning decisions in flood risk areas. The types of flood information that can be viewed in 3D include:
The VEPs project partners are working with the local town authority in Stuttgart, Germany, as a part of the public consultation on a Stuttgart redevelopment proposal to move all the train lines crossing the centre of Stuttgart underground. As a part of this noise simulation models will be brought into the VEPs tools to demonstrate noise pollution associated with the construction traffic and possible abatement plans.
Future work will also look at extending the provision of CityGML data (derived form Lidar data sources) using 3D web services.
- historic flood extent for coastal and/or river flooding
- flood risk maps (2D information)
The VEPs project partners are working with the local town authority in Stuttgart, Germany, as a part of the public consultation on a Stuttgart redevelopment proposal to move all the train lines crossing the centre of Stuttgart underground. As a part of this noise simulation models will be brought into the VEPs tools to demonstrate noise pollution associated with the construction traffic and possible abatement plans.
Future work will also look at extending the provision of CityGML data (derived form Lidar data sources) using 3D web services.
References
- CityGML 1.0 XML Schema (latest version from 2006-04-03, zip archive, 220 KB; previous version from 2006-02-15, zip archive, 157 KB). The GML application schema is based on the GML3.1.1 XML Schemas, originally provided by the OGC
- CityGML UML data model 1.0 (latest version from 2006-03-09, PDF document, 214 KB; previous version from 2006-02-22, PDF document, 223 KB).
- Open Source GML3 3D viewer application Aristoteles (Version 0.9 beta built 8, zip archive, 13.1 MB) developed by the Institute for Cartography and Geoinformation, University of Bonn. Java 1.5 is needed (Java3D libraries are included in the package). Aristoteles is not restricted to CityGML files; it can visualize arbitrary GML3 files (like the German cadastre standard ALKIS/NAS). Further information can be found on the Aristoteles project homepage.
- Free CityGML viewer application LandXPlorer developed by the company 3DGeo and the Hasso-Plattner-Institute of the University of Potsdam. Further information and download.
Environment Agency - Catchment variables for fisheries modelling and prediction (Environment Agency (EA))
GI Project
Aim
Catchment variables
Predicted Juvenile trout densities
Fisheries management requires the assessment of fish stocks. It’s extremely expensive to monitor every small section of river nationally, so modelling techniques are used to expand monitoring data more widely. These have traditionally relied on manually derived map-based site and catchment environmental variables to help explain the spatial variation of fish populations. GIS has more recently been used to add to and improve the effectiveness of the assessments performed.
Predicted juvenile trout densities in the Upper River Severn
Background
The Environment Agency has a statutory duty to maintain, improve and develop freshwater fisheries. To fulfil this duty, information to describe and understand fish stocks is required. Current fisheries management tools rely upon the measurement of site and catchment features to aid the interpretation of fish survey data.
Manual methods of extracting site and catchment features are inherently time consuming and may be prone to human error. A huge advantage may be gained if such methods could be automated. The use of a GIS allows for the extraction of attributes for any sites of interest on the "river network". This enables the refinement, and improvement, of the existing management tools and assists with the development of new tools.
The project provided an analysis of new and existing GIS techniques for the measurement of site and catchment features. The GIS provides a data source, a modelling platform and a mapping tool that aim to supply useful improvements to existing fisheries management techniques and have wider usefulness outside the fisheries function.
Manual methods of extracting site and catchment features are inherently time consuming and may be prone to human error. A huge advantage may be gained if such methods could be automated. The use of a GIS allows for the extraction of attributes for any sites of interest on the "river network". This enables the refinement, and improvement, of the existing management tools and assists with the development of new tools.
The project provided an analysis of new and existing GIS techniques for the measurement of site and catchment features. The GIS provides a data source, a modelling platform and a mapping tool that aim to supply useful improvements to existing fisheries management techniques and have wider usefulness outside the fisheries function.
Technical commentary
The work was carried out in ArcGIS (mainly with ArcView but with some use of ArcEditor) and with the Spatial Analyst extension and the ArcHydro data model supporting tool set (ESRI). MS Excel and MiniTab were also used for the analysis and comparisons of datasets plus the development of demonstration models. ArcGIS was used for the data extraction and the back application of equation based models to produce predictive maps.
Solution
Hydrological modelling was undertaken using the Spatial Analyst extension of ArcGIS on the 50m resampled version of the NextMap surface DEM following the methods described in (Coley, 2003) and the ArcHydro tools for terrain reconditioning.
The derived datasets were then used again in ArcGIS (with Spatial Analyst) to summarise catchment upstream values for every 50m cell of the river network.
Data was extracted and combined with fisheries population data for specific sites within a statistical package (for example MiniTab) and a demonstration relationship described (as an equation). The equation was back applied within ArcGIS to predict a fish population on each 50m cell of the river network.
GIS provides the ability to automate and improve measurement of catchment features that will aid interpretation of fish survey (or other environmental survey) data and improve the cost-effectiveness of fisheries (or environmental) management methods. However, good data auditing is required. This is of particular significance in relation to location data, which is prone to errors when taken from older data sources.
GIS provides the ability to calculate attributes that are easy to calculate by hand in an automated way but also offers the ability to calculate variables that would be either very time consuming or impossible to calculate without using GIS.
Attributes can be calculated in a systematic way and the calculation of new attributes can be achieved by using new or improved datasets, as they become available. The advantage of such a system is threefold:
1. By having raster datasets attributes can be extracted for any 50m cell on the river network.
2. Any relationships discovered during analysis can easily be applied to the whole river network.
3. Any dataset alterations or improvements can easily be applied.
Lesson Learned
Derived dataset production is time consuming (processing time on PC) and recent introduction of ArcGIS 9.x with model builder and scripting would allow for better implementation by running of batch processes to completion rather than requiring manual intervention at the end of each stage.
Solution
Hydrological modelling was undertaken using the Spatial Analyst extension of ArcGIS on the 50m resampled version of the NextMap surface DEM following the methods described in (Coley, 2003) and the ArcHydro tools for terrain reconditioning.
The derived datasets were then used again in ArcGIS (with Spatial Analyst) to summarise catchment upstream values for every 50m cell of the river network.
Data was extracted and combined with fisheries population data for specific sites within a statistical package (for example MiniTab) and a demonstration relationship described (as an equation). The equation was back applied within ArcGIS to predict a fish population on each 50m cell of the river network.
GIS provides the ability to automate and improve measurement of catchment features that will aid interpretation of fish survey (or other environmental survey) data and improve the cost-effectiveness of fisheries (or environmental) management methods. However, good data auditing is required. This is of particular significance in relation to location data, which is prone to errors when taken from older data sources.
GIS provides the ability to calculate attributes that are easy to calculate by hand in an automated way but also offers the ability to calculate variables that would be either very time consuming or impossible to calculate without using GIS.
Attributes can be calculated in a systematic way and the calculation of new attributes can be achieved by using new or improved datasets, as they become available. The advantage of such a system is threefold:
1. By having raster datasets attributes can be extracted for any 50m cell on the river network.
2. Any relationships discovered during analysis can easily be applied to the whole river network.
3. Any dataset alterations or improvements can easily be applied.
Lesson Learned
Derived dataset production is time consuming (processing time on PC) and recent introduction of ArcGIS 9.x with model builder and scripting would allow for better implementation by running of batch processes to completion rather than requiring manual intervention at the end of each stage.
Other GI resources used
NextMap surface model DEM (re-sampled to 50m resolution, method independent of a specific DEM but this one chosen for the study).
Land Cover 2000 (LCM 2000).
CEH 1:50,000 blue-line river network (method independent of a specific river network but this one chosen for the study).
OS Meridian 2 - mean High Water Mark coastline for clipping of boundaries.
OS Strategi data based 1: 250,000 scale urban areas polygons.
National Fisheries Population data from the Environment Agency NFPD fisheries survey database.
Derived datasets using a combination of some or all of the above
Other Datasets
LCM 2000
1:50k River network
NextMap DEM
Software
ESRI
ArcGIS
ArcView
ArcEditor
ArcGIS extension (Spatial Analyst)
Land Cover 2000 (LCM 2000).
CEH 1:50,000 blue-line river network (method independent of a specific river network but this one chosen for the study).
OS Meridian 2 - mean High Water Mark coastline for clipping of boundaries.
OS Strategi data based 1: 250,000 scale urban areas polygons.
National Fisheries Population data from the Environment Agency NFPD fisheries survey database.
Derived datasets using a combination of some or all of the above
Other Datasets
LCM 2000
1:50k River network
NextMap DEM
Software
ESRI
ArcGIS
ArcView
ArcEditor
ArcGIS extension (Spatial Analyst)
Future
The general method is now recognised but it is likely to be run at a more detailed scale when the Environment Agency's new Detailed River Network (DRN) is ready.
The derived datasets will be made available more widely in the business so that data can be extracted by non GIS specialist staff quickly for a specific survey site to "plug in to" a specific fisheries or other environmental modelling package. This will reduce the time spent on collecting such data and reduce the likely level of human-induced error in any manual collection of the data.
The derived datasets will be made available more widely in the business so that data can be extracted by non GIS specialist staff quickly for a specific survey site to "plug in to" a specific fisheries or other environmental modelling package. This will reduce the time spent on collecting such data and reduce the likely level of human-induced error in any manual collection of the data.
References
Coley A, 2003 Relationship between juvenile salmonid populations and catchment features. Environment Agency R&D W2-065 Technical Report
Environment Agency - Wales Environmental Information Provision System (WEIPS) (Environment Agency (EA))
GI Project
Aim
Provide a system that allows the creation of final external quality reports to be derived for a wide variety of business functions within the Environment Agency. The final outputs should be of direct use to the many departments and groups in the Environment Agency that require geo-spatial data (or statistical data for specified regions). The final output will likely be in a document-ready format (e.g. PDF or MS Word) and also include an output geo-database (storing processed data and relevant metadata) and other intermediate products to allow easy access to the processed data that was used to create the final output PDF/Word document.
Background
The Environment Agency is a data rich organisation that has a wide variety of functions that have developed over the last 10 years. This has led to a rather fragmented approach to data management and a reduced ability to report effectively from the various systems available.
Technical commentary
ArcMap local client (interaction of the user with spatial data)
Data access via network drives (shape files) and ArcSDE (central data store)
Bespoke created tools using ArcObjects running within the local ArcMap client
Solution
Key Environment Agency functions where identified that would benefit from a more streamlined way of reporting geo-spatial information. A ‘fixed format document reporting’ method was agreed on (i.e. users would select a list of pre-designed templates for a specific area and a package would then be created based on this and other inputs).
Templates for each key area were designed and then the process of document creation was automated using VB6 code executable from within ArcGIS (a server-side solution is also being developed for thin clients). Users can then create an output report based on their selected template for any area within Wales (and nominally England).
Business savings are mainly through a significant increase in making appropriate and fit-for-purpose information (and data) available to users who previously were not able to access/use this data (due to restriction on the systems available, time to extract and process data and expertise to process data).
This is an ongoing project, but we expect to show significant increases in the complexity and quality of the work that may now be created also.
Crystal Reports (final output reports)
Lesson Learned
• Fixed format document reporting can be very effective at delivering targeted outputs
• Flexibility is however lost using this approach.
• In addition to the final output reports, a geo-database is also created and other intermediate data objects (e.g. Excel worksheets with all the data inside used to make the plots in the final report). These allow the users to access the output result in a number of different ways.
Data access via network drives (shape files) and ArcSDE (central data store)
Bespoke created tools using ArcObjects running within the local ArcMap client
Solution
Key Environment Agency functions where identified that would benefit from a more streamlined way of reporting geo-spatial information. A ‘fixed format document reporting’ method was agreed on (i.e. users would select a list of pre-designed templates for a specific area and a package would then be created based on this and other inputs).
Templates for each key area were designed and then the process of document creation was automated using VB6 code executable from within ArcGIS (a server-side solution is also being developed for thin clients). Users can then create an output report based on their selected template for any area within Wales (and nominally England).
Business savings are mainly through a significant increase in making appropriate and fit-for-purpose information (and data) available to users who previously were not able to access/use this data (due to restriction on the systems available, time to extract and process data and expertise to process data).
This is an ongoing project, but we expect to show significant increases in the complexity and quality of the work that may now be created also.
Crystal Reports (final output reports)
Lesson Learned
• Fixed format document reporting can be very effective at delivering targeted outputs
• Flexibility is however lost using this approach.
• In addition to the final output reports, a geo-database is also created and other intermediate data objects (e.g. Excel worksheets with all the data inside used to make the plots in the final report). These allow the users to access the output result in a number of different ways.
- Automated recording of metadata is possible via this approach with little to no additional information needed from the user. This allows a robust audit trail to be created.
- Access to secure data (via a centralised data store) is very useful, although a system based on locally stored data is also possible to design (this was implemented here in cases of no network connection).
Other GI resources used
EA Pollution Inventory
EA WIMS
EA IPCIS/PAS Database
EA REGIS Database
EA Historic Landfills
EA River CentreLine (1:10k)
EA GQA Data
EA RQO Data
EA Flood Risk Mapping layers (NAFRA)
EA OSPAR Database
EA Priority Issues Database (created within the project)
OS Raster Basemapping (various scales)
EA Regional and Area Boundaries
Wales Local Authority Boundaries
Plus a number of other data sets from within the Environment Agency
EA WIMS
EA IPCIS/PAS Database
EA REGIS Database
EA Historic Landfills
EA River CentreLine (1:10k)
EA GQA Data
EA RQO Data
EA Flood Risk Mapping layers (NAFRA)
EA OSPAR Database
EA Priority Issues Database (created within the project)
OS Raster Basemapping (various scales)
EA Regional and Area Boundaries
Wales Local Authority Boundaries
Plus a number of other data sets from within the Environment Agency
Future
- Further templates are being developed and a strategic approach to using them is in design.
- A sister project is taking the operational (client side) tool and piloting the ability to create the same reports in a server-side (thin client) environment.
HMRC - London Tube Maps (Her Majesty's Revenue and Customs (HMRC))
GI Project
Aim
Bakerloo Line
Central Line
Our aim was to create underground/tram maps to compliment the ‘Boundary Line’ stations/railways data in major UK cities. As part of the restructuring of HMRC in London we needed a reference to ‘tube’ lines to aid the decisions on ease of travel across London when considering alternative accommodation.
Circle Line
District Line
Docklands Light Rail
East London Line
Hammersmith & City Line
Jubilee Line
London Underground Zone 1
Metropolitan Line
Northern Line
Piccadilly Line
Victoria Line
Background
As part of the Government agenda to make £100m savings across the estate, GIS maps of office and staff locations were produced to inform the geographical position to look at ease staff of travel to potentially new offices and provide a reference in the published review of the proposals for closures and retentions of offices.
Technical commentary
Internet search revealed several sources for the traditional tube maps, but I came across an entry in Wikimedia that used GPS data for station locations. Using MapInfo as the geographical software the process to load the GPS data was fairly straightforward. The vector drawing tool was used to ‘join the dots’ and the lines were coloured (approximately) to the traditional tube line colours. Separate files for each tube ‘line’ were then created.
Other GI resources used
MapInfo Professional V8.0
Ordnance Survey ‘Boundary Line’ – to ensure ‘fit’ with major rail stations
PGA
Boundary Line
Code Pointand Code Point Polygons
Meridian 2
Other Datasets
MapInfo
Professional
Ordnance Survey ‘Boundary Line’ – to ensure ‘fit’ with major rail stations
PGA
Boundary Line
Code Pointand Code Point Polygons
Meridian 2
Other Datasets
MapInfo
Professional
Future
Need to find a more accurate method of creating the ‘tube’ lines as zooming in shows a discrepancy in the positioning. Will also be looking at sources of GPS data to produce similar maps for underground/tram maps of other UK cities.
Data available in various formats.
Data available in various formats.
References
Office for National Statistics - Automated Mapping Tool for large numbers of Census Field Maps (Office for National Statistics (ONS))
GI Project
Aim
Automated Mapping Tool Dialog Box
Example ED Map
The Census is a large logistical task requiring maps for different parts of the country, so an automated method of map production is essential. The solution developed is being widely applied in ONS and may be of interest to other IGGI members who need to produce large numbers of maps.
Background
An automated mapping system is essential for the Census because of the large numbers of maps required (approximately 117,000 unique ED maps and 376 unique Local Authority maps were produced for the 2001 Census). The system needs to be able to cope with the wide variation in area characteristics (from very urban to very rural), and also to be able to produce maps at different scales, page sizes, and paper orientations. It is also important to take account of the successes from the methods used for the 2001 Census and the areas identified for improvement.
In addition to the census requirements we wanted to create a system that could be used for other purposes (e.g. producing maps of Super Output Areas within different Local Authorities) to maximise value for money.
In addition to the census requirements we wanted to create a system that could be used for other purposes (e.g. producing maps of Super Output Areas within different Local Authorities) to maximise value for money.
Technical commentary
The system was developed using ESRI’s ArcGIS 9.1 software and Visual Basic for Applications (VBA) macros because this is the standard GIS software in ONS, and because it had all the capabilities necessary to meet the requirements. However, it should be possible to produce a system using any GIS software.
The system needed to be able to handle different input layers and creation of different types of maps. To achieve this it was decided to allow the user to select the input layers, page size, symbology, and label settings in ArcMap before starting the tool.
A dialog box is displayed to collect information from the user about what is required.
The tool zooms to each area, calculates the appropriate page orientation, adds map furniture (title, scale text, legend, and purpose/copyright statements) and exports the map to a PDF file. The PDF files can be sent to a printer in batches.
Solution
The requirement for the ED maps is to clearly show the area that each enumerator is responsible for. This means that the boundary of the area needs to be clear on the map, and where possible street names are included on the raster backgrounds to aid navigation. Only the boundary of the specific ED is shown to avoid confusion with neighbouring areas. Colour raster backgrounds were chosen because it is easier to distinguish different types of features compared with black and white rasters.
The ED boundary and raster datasets are used on all the ED maps. Scale thresholds are used to control which raster dataset is the most appropriate one to be displayed on each specific map. The postcode data is only shown on maps of rural areas to assist the enumerator with matching the address details to the map where street names are less common. Rural areas were identified by plotting Output Area centroids against the ED boundaries and using the ONS Area Classification at Output Area level to define area type. This is a reasonable although not perfect method.
The Automated Mapping Tool is an efficient way of creating maps. For the Census Test it was used to produce about 800 maps in 4 hours (excluding printing time), although this does depend on page size. In fact, the majority of the time required to produce the maps is taken up with printing. This is a much more efficient way of producing maps than creating them manually (even for small numbers of maps). It is also a more consistent way of producing maps because the map furniture is added automatically by the tool using information in the files which gives all the maps the same look and feel and should prevent errors.
Another benefit is that we are now able to offer a service to customers to produce series’ of maps, and crucially not just for census purposes. ONS would be very happy to discuss this further and share this tool with other IGGI members, contact Donna Viney for information.
Lessons Learned
The decision to use as much core functionality as we could was important in making the application as easy as possible to migrate between different software versions. The code used in the application is also split into lots of different modules which helps with changing the functionality and locating problems.
Allowing the user to specify inputs, symbology etc has proved very important in allowing the use of the tool for many different purposes.
The system needed to be able to handle different input layers and creation of different types of maps. To achieve this it was decided to allow the user to select the input layers, page size, symbology, and label settings in ArcMap before starting the tool.
A dialog box is displayed to collect information from the user about what is required.
The tool zooms to each area, calculates the appropriate page orientation, adds map furniture (title, scale text, legend, and purpose/copyright statements) and exports the map to a PDF file. The PDF files can be sent to a printer in batches.
Solution
The requirement for the ED maps is to clearly show the area that each enumerator is responsible for. This means that the boundary of the area needs to be clear on the map, and where possible street names are included on the raster backgrounds to aid navigation. Only the boundary of the specific ED is shown to avoid confusion with neighbouring areas. Colour raster backgrounds were chosen because it is easier to distinguish different types of features compared with black and white rasters.
The ED boundary and raster datasets are used on all the ED maps. Scale thresholds are used to control which raster dataset is the most appropriate one to be displayed on each specific map. The postcode data is only shown on maps of rural areas to assist the enumerator with matching the address details to the map where street names are less common. Rural areas were identified by plotting Output Area centroids against the ED boundaries and using the ONS Area Classification at Output Area level to define area type. This is a reasonable although not perfect method.
The Automated Mapping Tool is an efficient way of creating maps. For the Census Test it was used to produce about 800 maps in 4 hours (excluding printing time), although this does depend on page size. In fact, the majority of the time required to produce the maps is taken up with printing. This is a much more efficient way of producing maps than creating them manually (even for small numbers of maps). It is also a more consistent way of producing maps because the map furniture is added automatically by the tool using information in the files which gives all the maps the same look and feel and should prevent errors.
Another benefit is that we are now able to offer a service to customers to produce series’ of maps, and crucially not just for census purposes. ONS would be very happy to discuss this further and share this tool with other IGGI members, contact Donna Viney for information.
Lessons Learned
The decision to use as much core functionality as we could was important in making the application as easy as possible to migrate between different software versions. The code used in the application is also split into lots of different modules which helps with changing the functionality and locating problems.
Allowing the user to specify inputs, symbology etc has proved very important in allowing the use of the tool for many different purposes.
Other GI resources used
For the Census Test Enumeration District (ED) maps:
- 2001 ED boundaries (ONS)
- Full range of Colour Raster Datasets (Ordnance Survey)
- National Statistics Postcode Directory (ONS)
Future
The Automated Mapping Tool was developed as a pragmatic solution for the 2007 Census Test using desktop technology. A full enterprise system will need to be developed for the 2011 Census.
There are some extra pieces of functionality that could be added to the Automated Mapping Tool like increasing the font size of the title as page size increases, and positioning the legend more precisely. Also the identification of rural areas could be refined by checking the assignment from the Area Classification against the scale of the map at certain page sizes (e.g. at A4 a very rural area would be a much smaller scale than a very urban area).
Further work could also be undertaken to investigate the use of the mapping tool for statistical (e.g. choropleth) as well as reference maps. There is no reason why the tool could not be used for this purpose.
There are some extra pieces of functionality that could be added to the Automated Mapping Tool like increasing the font size of the title as page size increases, and positioning the legend more precisely. Also the identification of rural areas could be refined by checking the assignment from the Area Classification against the scale of the map at certain page sizes (e.g. at A4 a very rural area would be a much smaller scale than a very urban area).
Further work could also be undertaken to investigate the use of the mapping tool for statistical (e.g. choropleth) as well as reference maps. There is no reason why the tool could not be used for this purpose.
References
The webpage National Statistics Census Geography provides more information about the geographies used in the Census.
The ESRI online support website and the
ESRI Developer Network proved useful for sample scripts and help information. Also the sample scripts provided with the ArcGIS software were useful.
The Ordnance Survey website provides information about the raster datasets.
The ESRI online support website and the
ESRI Developer Network proved useful for sample scripts and help information. Also the sample scripts provided with the ArcGIS software were useful.
The Ordnance Survey website provides information about the raster datasets.
South East England Development Agency - The SEE-IN Data Hub (South East England Development Agency (SEEDA))
GI Project
Aim
SEE-IN image 1
SEE-IN image 2
Through the development of the SEE-IN Data Hub, we are aiding those outside of the research field in sourcing data and information to support their work. By delivering an online solution to geographic data queries we are bringing together a catalogue of data, accessed through one easy to use portal.
SEE-IN image 3
Background
As the regional observatory for the South East, SEE-IN works to improve access to, and the use of data and intelligence. The provision of raw data is insufficient for users unfamiliar with working with data so through the Data Hub we have added value to the data, creating something of use to practitioners.
Querying the Data Hub, users can access over 120 data sets at a range of geographies, from administrative areas through to RDA defined economic geographies. The most exciting element however, is the option of user defined boundaries. Creating a polygon will pull together data from the LSOAs whose centroid falls within that polygon. This is then saved for future use.
All output is available for export, either as an image file, a CSV file or as part of a user defined report in PDF or word format. This ensures the maps created can then be dropped directly into reports or presentations, with no specialist GI software or knowledge needed.
Querying the Data Hub, users can access over 120 data sets at a range of geographies, from administrative areas through to RDA defined economic geographies. The most exciting element however, is the option of user defined boundaries. Creating a polygon will pull together data from the LSOAs whose centroid falls within that polygon. This is then saved for future use.
All output is available for export, either as an image file, a CSV file or as part of a user defined report in PDF or word format. This ensures the maps created can then be dropped directly into reports or presentations, with no specialist GI software or knowledge needed.
Technical commentary
One of the key driving forces during the design of the Data Hub was industry standards. The tool had to perform complex functions yet remain in accordance with the W3C Accessibility ratings. In addition, it was important to promote the use of metadata standards among users. The data itself is catalogued according to the Integrated Public Sector Vocabulary keywords. Each dataset includes metadata conforming to the Gemini schema. Addressing these standards now is also intended to aid further development towards interoperability. In terms of software, the Data Hub has been designed and built from scratch, including the mapping function. The graphics are displayed as SVG.
Lessons Learned
A number of lessons have been learned through the development of the Data Hub, from data through to partnerships. However, with specific reference to the GI element of the project, the importance of a well managed GI database cannot be underestimated. Prior to starting a project such as this, a well organised and up-to-date database of boundary files, raster tiles and related material can reduce delays and errors in the data.
Additionally, it is important to think carefully about what should and shouldn’t be displayed on a map. Some datasets lend themselves well to geographic presentation, others do not. Finally, colleagues and partners should be actively encouraged to ensure any policy defined geography is based upon administrative boundaries. If robust data is needed, hand drawn boundaries will create problems.
Lessons Learned
A number of lessons have been learned through the development of the Data Hub, from data through to partnerships. However, with specific reference to the GI element of the project, the importance of a well managed GI database cannot be underestimated. Prior to starting a project such as this, a well organised and up-to-date database of boundary files, raster tiles and related material can reduce delays and errors in the data.
Additionally, it is important to think carefully about what should and shouldn’t be displayed on a map. Some datasets lend themselves well to geographic presentation, others do not. Finally, colleagues and partners should be actively encouraged to ensure any policy defined geography is based upon administrative boundaries. If robust data is needed, hand drawn boundaries will create problems.
Other GI resources used
Census Output Areas (2001)
Super Output Areas – Lower level
Super Output Areas – Middle level
2003 CAS ward
2003 Standard Wards
1991 Districts
2005 LAD/UAD/County
Primary Care Trusts
Rural/Urban Classifications
SEEDA Economic Geography Contours
South East Plan Boundary Data
Over 120 datasets from across government and regional agencies
Super Output Areas – Lower level
Super Output Areas – Middle level
2003 CAS ward
2003 Standard Wards
1991 Districts
2005 LAD/UAD/County
Primary Care Trusts
Rural/Urban Classifications
SEEDA Economic Geography Contours
South East Plan Boundary Data
Over 120 datasets from across government and regional agencies
Future
Driving the future development of the Data Hub is the promotion of data sharing. We have provided users with the ability to load their own data into the tool, encouraging users to share their data with the wider community. As this user engagement grows, we are investigating the potential for the Data Hub to improve the Regional Monitoring process within the region, against both the Regional Economic Strategy and the Integrated Regional Framework.
If successful, this would reduce the burden on all organisations involved in the collation and provision of geographic data. Additionally, we are working to assist in more localised monitoring of local area agreements by encompassing the suite of indicators proposed by Government.
If successful, this would reduce the burden on all organisations involved in the collation and provision of geographic data. Additionally, we are working to assist in more localised monitoring of local area agreements by encompassing the suite of indicators proposed by Government.

Show more detail
Hide detail