Warning:
This wiki has been archived and is now read-only.

Working Use Cases

From Spatial Data on the Web Working Group
Jump to: navigation, search

Deadline for submissions to be considered at the Barcelona Face to Face meeting : March 1st 2015.

The deliverable on Use cases and requirements is in place:

Contents

Style Template Use Case (Best Practice, Time, SSN, Coverage, Unsure)

Contributed by: Kerry Taylor

CSIRO Australia needs to share spatial data with scientists in the Australian Bureau and Statistics and Geoscience Australia. This is a claim made purely for the benefit of providing an example use case. Please include data that exemplifies the use case if you have some, like this Spreadsheet, or copy an extract in to the page, or upload a file here and link to it. Provide external links for more info if you can, like this Bureau of Meteorology Radar for Canberra.

This use case covers aspects of all 4 of the (non Use Case) Working Group deliverables (Best Practice, Time, SSN, Coverage) which is why they are all named in the title above. Please do the same thing -- i.e. name the deliverables that clearly contribute to a solution to this use case and include "Unsure" if there may be other of the 4 that you have not named but it is not clear to you whether you should have (and if you are not sure about any of them, "Unsure" alone is fine for now!).

The description of the use case may be only 3 or 4 paragraphs. Tell a story about how it will work (or how it works now and what you want to do better). Try to articulate the benefit of solving the problem (ideally, you will also describe the challenges you are facing now, but that might be asking too much). Please see CSV on the Web Use Cases for a style we would like to emulate.

Meteorological Data Rescue Use Case (Best Practice, Time, SSN, Coverage)

Contributed by Chris Little, based on scenarios used for the WMO insfrastructure requirements

This is really one of several future, but realistic, meteorological scenarios to aim at.

National Hydro-Meteorological Services around the world are coordinated via the WMO (World Meteorological Organisation), part of the the United Nations system. WMO has the same status as ISO, and its standards and regulatory materials applies to all its 193 national meteorological services and are available in the six working languages ( عربي | 中文 | Fr | Ru | Es | En). WMO has embarked on a long-term (think a decade or so) programme to update the global meteorological operational infrastructure. This is known as the WIS (WMO Information System). The global infrastructure also has aviation, oceanographic, seismic and other users. The WIS includes a global, federated, synchronized, geospatial catalogue, envisaged to encompass all hydro-meteorological data and services. Currently several nodes are operational, cataloguing mainly routinely exchanged observations and forecasts.

Envisage an environmental scientist in Cambodia, researching the impact of deforestation in Vietnam as part of investigating the regional impacts of climate change. She submits her search keywords, in Cambodian, and receives responses indicating there is some data from the 1950s, printed in a 1960 pamphlet, in the Bibliothèque Nationale, a library in Paris, France, in French. She receives an abstract of some form that enables her to decide that the data are worth accessing, and initiates a request for a digital copy to be sent.

She receives the pamphlet as a scanned image of each page, and she decides that the quantatitive information in the paper is useful, so she arranges transcription of the tabular numerical data and their summary values into a digital form and publishes the dataset, with a persistent identifier, and links it to a detailed coverage extent, the original paper source, the scanned pages and her paper when it is published. She also incorporates scanned charts and graphs from the orginal pamphlet into her paper.

Her organisation creates a catalogue record for her research paper dataset and publishes it in the WIS global catalogue, which makes it also visible to the GEO System of Systems broker portal.

Habitat zone verification for designation of Marine Conservation Zones (Best Practice, Time, SSN, Coverage)

Contributed by Jeremy Tandy; use case is based on a conservation with representatives from Natural England at a CEFAS/DEFRA-sponsored Marine Data Workshop in 2014

The Marine and Coastal Access Act 2009 allows for the creation of a type of Marine Protected Area (MPA), called a Marine Conservation Zone (MCZ). MCZs protect a range of nationally important marine wildlife, habitats, geology and geomorphology and can be designated anywhere in English and Welsh inshore and UK offshore waters.

The designation of a MCZ is dependent on a detailed analysis of the marine environment which results in the definition of geometric areas where a given habitat type is deemed to occur and is published as a habitat map.

Being a policy statement, it is important to be able to express the provenance of information that was used to compile the habitat map. Moreover, because the marine environment is always changing, it is important to express the time at which this information was collected.

The information includes:

  • acoustic survey
  • video (from a video camera towed behind a boat)
  • biota observations (based on what is observed in the video and physical collection)
  • particle size (sand/mud)
  • water column data
  • seabed character map; discrete seabed features & backscatter information (from sonar) to determine bottom type

These information types are varied in type and size. In particular, the acoustic survey (e.g. side-scan sonar) is difficult to manage as these survey results can be many gigabytes in size and cover large areas. A way is needed to refer to just a small part of these coverage data sets that are relevant to a particular habitat zone analysis.

Real-time Wildfire Monitoring (SSN, Best Practice, Time)

Contributed by: Manolis Koubarakis

This use case is about the wildfire monitoring service of the National Observatory of Athens (NOA) as studied in project TELEIOS [1].

The wildfire monitoring service is based on the use of satellite images originating from the SEVIRI (Spinning Enhanced Visible and Infrared Imager) sensor on top of the Meteosat Second Generation satellites MSG-1 and MSG-2. Since 2007, NOA operates an MSG/SEVIRI acquisition station, and has been systematically archiving raw satellite images on a 5 and 15 minutes basis, the respective temporal resolutions of MSG-1 and MSG-2.

The service active in NOA before TELEIOS can be summarized as follows:

(1) The ground-based receiving antenna collects all spectral bands from MSG-1 and MSG-2 every 5 and 15 minutes respectively.

(2) The raw datasets are decoded and temporarily stored in the METEOSAT Ground Station as wavelet compressed images.

(3) A Python program manages the data stream in real-time by offering the following functionality:

1. Extract and store the raw file metadata in an SQLite database. This metadata describes the type of sensor, the acquisition time, the spectral bands captured, and other related parameters. Such a step is required as one image comprises multiple raw files, which might arrive out-of-order.

2.Filter the raw data files, disregarding non-applicable data for the fire monitoring scenario, and dispatch them to a dedicated disk array for permanent storage.

3. Trigger the processing chain by transferring the appropriate spectral bands via FTP to a dedicated machine and initiating the following steps: (i) cropping the image to keep only the area of interest, (ii) georeferencing to the geodetic reference system used in Greece (HGRS 87), (iii) classifying the image pixels as "fire" or "non-fire" using appropriate algorithms, and finally (iv) exporting the final product to raster and vector formats (ESRI shapefiles).

4. Dispatch the derived products to the disk array and additionally store them in a PostGIS database system.

It would be interesting for NOA to see how to use the standards developed by this working group to achieve the following:

  • Improve the thematic accuracy of generated products.
  • Generate thematic maps by combining the generated products

with other kinds of data such as: Corine Land Cover, the Administrative Geography of Greece, OpenStreetMap data and Geonames.

This use case is further discussed in the paper [2].

The service is operational at [3].

Some data that can be used by the service can be found at [4].

Diachronic Burnt Scar Mapping (SSN, Time, Best Practice)

Contributed by: Manolis Koubarakis

This use case was studied by the National Observatory of Athens (NOA) in project TELEIOS [5].

The burnt scar mapping service is dedicated to the accurate mapping of burnt areas in Greece after the end of the summer fire seasons, using Landsat 5 TM satellite images.

The processing chain of this service is divided into three stages, each one containing a series of modules. The pre-processing stage is dedicated to (i) identification of appropriate data, downloading and archiving, (ii) georeferencing of the received satellite images, and (iii) cloud masking process to exclude pixels “contaminated” by clouds from the subsequent processing steps.

The core processing stage comprises (i) a classification algorithm which identifies burnt and non-burnt sets of pixels, (ii) a noise removal process that is necessary to eliminate isolated pixels that have been classified wrongfully as burnt, and (ii) converting the raster intermediate product to vector format.

Finally, the post-processing stage consists of (i) a visual refinement step to ensure product thematic accuracy and consistency, (ii) attribute enrichment of the product by overlaying the polygons with geoinformation layers and finally (iii) generation of thematic maps.

It would be interesting for NOA to see where the standards to be developed in this working group could be used.

The service is operational at [6].

Harvesting of Local Search Content

Contributed by: Ed Parsons

This is a rather generic and broad use case, relevant to Google but clearly also relevant to anyone interesting in machine processing of html referring to about locations and activities which take place at those locations. Local search providers spend much time and effort creating databases of local facilities, businesses and events.

Much of this information comes from web pages published on the public web, but in an unstructured form. Previous attempts at harvesting this information automatically have meet with only limited success, currently alternative approaches involve business owners manually adding structured data to dedicated portals. This approach although clearly an improvement does not really scale and there are clearly issues in terms of data sharing and freshness.

The information of interest includes;

  • The facilities address
  • The type of business/activity
  • Opening hours
  • Date; time and duration duration of events
  • Telephone; email and website details

Complexities to this include multiple address standards, the differences between qualitative representations of place, and precise spatial co-ordinates, definitions of activities etc.

Ultimately these web pages should become the canonical source of local data used by all web users and services.

Locating a thing...

Contributed by: Ed Parsons

With the increasing availability of small, mobile location aware devices the requirement to identify a location human terms is becoming more important.

While the determination of sensor in space to a high level of precision is a largely solved problem we are less able to express the location in terms meaningful to humans.

The fact that the Bluetooth-LE tracker attached to my bag is at 51.4256853,-0.3317991,4.234500 is much less useful than the description, "Under your bed at home".

At others time the location description, "24 Bridgeman Road, Teddington, TW11 8AH, UK" might be equally valid, as might "Teddington", "South West London", "England", "UK", "Inside", "Where you left it Yesterday", "Upstairs", "45 minutes from here", "150 metres from the Post Office".

A better understanding of how we describe places in human terms, the hierarchical nature of places and the fuzzy nature of many geographical entities will be needed to make the "Internet of Things" manageable.

A new scale of geospatial analysis may be required using a reference frame based on the locations of individuals rather than a global spherical co-ordinate, allowing a location of your keys and their attached bluetooth tag to be described as "in the kitchen".

Publishing geographical data (Best Practice)

Contributed by: Frans Knibbe

This use case is for representing the perspective of a party that is interested in publishing data on the web and wants to do it right with respect to the geographical component of the data. The point of this use case is that it would be good to remove barriers that stand in the way of more spatial data becoming available on the web.

A data publisher could have the following questions:

  1. How should I publish vector data? What is the best encoding to use?
  2. How should I publish raster data?
  3. How do I make the CRS known?
  4. How do I make the spatial resolution/level of detail/accuracy known?
  5. Which data publishing software has good support of geographical data types and geographical functions?
  6. Which data publishing software has good performance when it comes to spatial operations on data?

From the last two questions it follows that the WG could also be involved in enabling conformance testing and stimulating development of benchmarks for software.

Consuming geographical data in a web application (Best Practice)

Contributed by: Frans Knibbe

This use case is somewhat complementary to the use case “Publishing geographical data”. It takes the consumer perspective, specifically that of a developer of a web application that should visualise data and allow some kind of user interaction. The hypothetical web application has little or no prior knowledge about the data it will encounter on the web, but should be able to do something meaningful with any spatial data that are encountered, like drawing data on a map or rendering the data in a 3D city scape.

The point of this use case is that in order for spatial data on the web to be succesful, supply and demand must be balanced to create a positive feedback loop. High quality data must be available in high quantitities but those data must also be highly usable for experts as well as non-experts.

A web application developer could have the following questions:

  1. How do I find geographical data on the web?
  2. How can I tell what kind of spatial data I will get? Raster or vector? 2D or 3D?
  3. Which encoding of vector data can I expect?
  4. Which encoding of raster data can I expect?
  5. Can I get the data with coordinates that match the coordinate system of my map?
  6. What is the spatial extent of this dataset/collection of resources/resource?
  7. How can I filter data to get the most appropriate spatial representation of a resource/collection of resources?
  8. How can I use spatial data on the web without having to take a four year academic course first?
  9. Which spatial operations does this SPARQL endpoint support?
  10. Can I use spatial operations in federated queries?
  11. How can I ensure responsiveness of my application (low wait times when accessing data)?

Enabling publication, discovery and analysis of spatiotemporal data in the humanities (Best Practice, Time)

Contributed by: Frans Knibbe

A research endeavour that has just started tries to stimulate researchers in the various fields of the humanities to make research data available in such a way that the data are and remain usable by other researchers, in such a way that the data may be used for purposes other than those envisaged by the original researcher. The emphasis lies on spatiotemporal data, because they are nice to visualise (a map with a time slider) and because it is thought that it would be interesting to try to discover patterns in time and/or space in interlinked distributed data sets.

This project has the following aspects that seem relevant to this Working Group:

  1. Technologies must be easy to implement for people that generally do not have a high affinity with IT. This goes for data publishing as well as data consumption.
  2. References to time and space are often inexact or have shifting frames of reference, so simple encodings like basic geo or ISO 8601 do not suffice.
  3. References to time and space do need to be as exact as possible, to enable automatic discovery of spatiotemporal patterns.
  4. Datasets do not just need to be published, they need to be easily discovered too, using spatial and/or temporal filters.

below added by Karl Grossner 1 Mar 2015

Note this use case shares characteristics with #19, Publishing Cultural Heritage Data (Best Practice, Time, Coverage)

Adding examples below relevant to items 2 and 3 above, from one existing scholarly web application case, which may contribute to a more general (i.e. not necessarily historical) requirement for representing several types of uncertainty: imprecision, probability, confidence. Standards for gazetteers--particularly historical (temporal) ones--are non-existent, although several projects with potentially global reach are under way. It will be helpful to have this Working Group in dialog with developers for such projects as Pelagios, Library of Congress, Pleiades, and Past Place (cf. Humphrey Southall).

Spatial

  • A set of life path data were developed for a kinship network of 30,000 individual Britons linked by birth and marriage. Spatial data for the locations of life events has several levels of granularity, from street address (10 Downing Street) to country (China). How can spatial containment relationships for places be expressed so that spatial-temporal contemporaneity be calculated?
  • References to places in historical works are often limited to toponyms (i.e. absent geometry or precise spatial relations), and qualified by such terms as "near," and "north of." How can these be indexed spatially so as to be discoverable>

Temporal

  • As with spatial data, historical sources contain temporal references at varying granularity. A single data set may contain expressions for exact dates, months, or years -- or ranges containing a mix of any of those.
  • Temporal references are frequently inexact, or relational with variable precision. The above referenced data set has a mix, including "around March 1832," "before 1750," "after WW II."

Publishing geospatial reference data (Best Practice)

Contributed by Clemens Portele; use case based on the European Location Framework (ELF)

Mapping and cadastral authorities maintain datasets that provide geospatial reference data. Reference data is data that a user/developer uses to provide location for her own data (by linking to it), by providing context information about a location (overlaying his data over a background map), etc.

A key part of this is persistent identifiers for the published data to allow linking to the reference data. Let's assume that http URIs following the Cool URI note are used as identifiers.

In ELF - and INSPIRE - reference data is typically published using a web service by the national authority. In ELF this is an OGC Web Feature Service.

To provide access to the different datasets via a single entry point, all the national services are made available via a proxy web service that also handles authentication etc.

In addition, it is foreseen to publish the reference data in other commonly used web-based platforms for geospatial data to simplify the use of the data - developers and users can use the tools and APIs they are familiar with.

As a result, the same administrative unit (to pick an example) is basically available via multiple (document) URIs: via the national web service, the ELF proxy web service and web services of the other platforms. Different services will support different representations (GML, JSON, etc). The web services may not be accessible by everyone and different users will have access to different document URIs.

Which real-world object and document URIs for the administrative unit should be maintained and what does a GET return in order

  • to support linking other data to the administrative unit,
  • to deliver the document and representation that the user expects when dereferencing the link?

A related challenge is that today such links are often implicit. For example, a postal code or a statistical unit code is a property in the other data, but the link is not explicit like a http URI. What is a good practice to make use of such implicit links? Should they be converted to http URIs to be explicit or are there better ways (e.g. additional context that provide information about the semantics and a pattern how to construct dereferencable URIs)?

Integration of governmental and utility data to enable smart grids (SSN, Best Practice)

Contributed by: Frans Knibbe

The research project CERISE-SG aims to integrate data from different domains: government, energy utilities and geography, in order to enable establishment of smart energy grids.

The project has recognized Linked Data as an appropriate concept for integration of data from separate semantic domains. One approach of achieving cross-domain interoperability is to switch from domain-specific semantics to common semantics. For example, the concept of an address has its own definitions in governmental standards and utility standards. Using a common definition improves interoperability.

An example of a domain model that is an international standard in electric utilities is the Common Information Model (CIM). Its data model provides definitions for an important entity: the electricity meter. These meters provide useful data on consumption and production of energy. If it is possible to view these devices as sensors, it could be possible to move from domain specific semantics (CIM) to common semantics (SSN), and to have ready linkage to geographical semantics (location and network topology). What is required in this case is a low-threshold way of using sensor semantics, because people involved in integration of data from multiple domains should not be burdened with having to grasp the full complexity of each domain.

Using spatial data from the web in GIS systems during emergency response operations

Contributed by: Bart van Leeuwen

During Emergency response operations the only spatial data available to emergency response services is the predefined data in their GIS warehouses. This while the incidents and accidents handled by emergency response services are by nature unpredictable, it is impossible to determine on forehand which data you might need. Ad-hoc data available on the web with a spatial component is not easily used right now, neither can the available data about a incident be easely shared over the web.

A related issues is that the relation between the data in the GIS warehouses is only spatial, while most of the time there is a adminstrative relation as well.

Under the umbrella of various projects a first attempt has been made to at least share definitions of the terminology used by various emergency response services, both national and cross border. This resulted in the start of a project called the Firebrary, now the terminology and definitions are available on the web as linked data as SKOS. Still linking from the spatial data to these definitions and vice versa is not standardized.

What seems to be missing is a way to define a relationship between GIS data ( in e.g. WFS services ) and data on the web and vice versa, express that a certain linked data resource is also available through a GIS service ( rdfs:seeAlso is too limited imho ) or describe the spatial component in the linked data directly.

Being able to plot and exchange data about active incidents through the web and visualize them in GIS tools with open standards would be a huge leap foreward for Emergency response services.

Publication of air quality data aggregations (SSN, Time)

Contributed by: Alejandro Llaves, Miguel Angel García-Delgado (OEG-UPM), Rubén Notivol, Javier Celma (Ayuntamiento de Zaragoza)

What: The local authorities of Zaragoza (Spain) want to publish the air quality data of the city. Each observation station has a spatial location described with an address. The dataset contains hourly observations and daily aggregations of different gases, e.g., SO2, NO2, O3, CO, etc.

How: We use the Location Core vocabulary to model the address, e.g. :station locn:address "C/ Gran Vía (Paraninfo)"^^xsd:string. We use xsd:dateTime to represent hourly observations, e.g. :obs ssn:observationResultTime "2003-03-08T11:00:00Z"^^xsd:dateTime.

Open challenges: The combination of hourly observations and daily aggregations in the same dataset may cause confusion because the granularity of the observation is not explicit. For daily aggregations, we suggest using time:Interval from the Time Ontology. To make the temporal modelling more homogeneous, time:Instant could be used for the hourly observations. [LINK TO DATA SAMPLE TO BE ADDED]

Publication of transport card validation and recharging data (SSN, Best Practice)

Contributed by: Alejandro Llaves (OEG-UPM)

What: The Regional Transport Consortium of Madrid (CRTM) wants to make available data about transport card validations and transport card recharging. In the case of transport card validations, the NFC sensors are located on buses, and at the entrance and (some) exit points of metro stations. The observation value of a validation includes data related to the transport card, such as the card identifier and the user profile. The sensors for transport card recharging are ATMs and ticket selling points distributed around Madrid. The observation value of a recharging includes the card identifier and the type of recharging.

How: To model transport card validations, we consider two observed properties: user entry (EntradaUsuario) and user exit (SalidaUsuario). Validation sensors at metro stations have a fixed location and a unique identifier, e.g. 02_L12_P2. A bus validation sensor is moving continuously, so for the sake of pragmatism, there is a unique sensor identifier for each bus stop in every line, e.g. 03_L20_P837. Those identifiers point to an address and geographic coordinates. The observed property when a user adds money to her transport card is the act of recharging (CargaTTP). In both cases, validation and recharging observations, the feature of interest is the transport card.

Combining spatial RDF data for integrated querying in a triplestore (Best Practice)

Contributed by: Matthew Perry (Oracle)

RDF datasets with spatial components are becoming more common on the Web. Many applications could benefit from the ability to combine, analyze and query this data with an RDF triplestore (or across triplestores with a federated query). Challenges arise, however, when trying to integrate such datasets.

  • Inconsistent, incomplete, and non-standard metadata descriptions of spatial data
  • Different representations of geometry data across different datasets
  • Different spatial reference systems used across different datasets
  • Different scales used across different datasets

For example, Ordnance Survey linked data (http://data.ordnancesurvey.co.uk/) uses British National Grid SRS and represents geometries with an Ordnance Survey-developed ontology, and LinkedGeoData (http://linkedgeodata.org/Datasets) uses WGS84 longitude latitude and represents geometries as GeoSPARQL WKT literals.

Best practices in the following areas would help make integration more straightforward.

  • Agreed-upon vocabulary for metadata about spatial datasets
  • Agreed-upon URIs for common spatial reference systems
  • Recommendations for a default, canonical spatial reference system for spatial data published on the web
  • Recommendations for serializing geometries as RDF

Consistent metadata descriptions about spatial datasets will take out a lot of guess work when combining datasets, and standard URIs for spatial reference systems will be an important part of this metadata description. A recommended canonical SRS would make combining datasets more efficient by eliminating the coordinate transformation step, which would make federated GeoSPARQL queries more feasible.

Dutch Base Registry use case (Best Practice)

Contributed by: Linda van den Brink

Dutch government data is for a large part open data. However, at the moment the data is difficult to find, and it cannot be easily linked to other data. It is not helping that most registrations are making use of their heavy backoffice standards for opening their data. These problems are counteracted by copying data of others, involving heavy expenses for collecting, converting and synchronising the data, or by building expensive national provisions. The result is an abundance of copies and much doubt regarding the authenticity of the information.

A better solution would be to make the authentic data permanently available as linked data, so that everyone can use it and the datasets can be interlinked, resulting in more coherence and improved traceability and no more need for copying and synchronisation.

There are now 13 Dutch ‘base registries’ containing government reference data: e.g.

  • BAG (Buildings and Adresses)
  • NHR (Businesses, organizations)
  • BRP (Citizens)
  • BGT (large scale topography)
  • BRT (small scale topography)
  • BRK (cadastre)
  • WOZ (building tax)
  • etc

A lot of these have geospatial content or refer to geospatial resources in other base registries (such as addresses). At the moment these references are informal and often incorrect or outdated. This means there is a need to express geospatial content in linked data (i.e. a standard vocabulary) and to perform spatial queries over linked data.

Geometries, especially lines and polygons, may contain many coordinates. For example, a municipal boundary could easily contain more than 1500 coordinate pairs. Compared to non-geometric properties, this can result in large amounts of data to transfer and process. The coordinates can easily be 95% of all data of an object when using polygons. The question rises whether there is a need for performance optimization and/or compression techniques for large amounts of coordinates. If so, there could also be a need to standardize such a technique, similar to the PNG format for encoding images.

Coordinate reference systems (CRS) are to geo-information what character encodings are to text. If you don’t know which CRS is used, you can’t use the coordinates. Different CRSs exist for a reason: localized CRSs provide more precise coordinates for a certain part of the globe. It is not possible for a global CRS to be as precise, for example because the continental plates move a few centimetres every year. For large scale data and applications this continental drift could be very relevant over time. Take for example the boundary of cadastral parcels. If this drift is not taken into account, there could be issues if parcel boundaries that were established e.g. 10 years ago are overlaid over recently acquired aerial imagery with high accuracy (e.g. 10 cm). There could be visual differences, while the actual situation did not change.

While the possibility to use different CRSs hinders interoperability (datasets using different CRSs cannot be easily combined, a complex transformation is necessary), on the other hand this option is perhaps needed for use cases where a high precision of coordinates is important. The BGT (large scale topography) is an example of such a use case.

A prototype application, based on linked data, where BGT, BAG, NHR and WOZ data is combined, is here: http://almere.pilod.nl/bgtld

BAG linked data is here: http://bag.kadaster.nl (“Begrippen”: the vocabulary; “BAG Data”: the data)

SPARQL endpoint for both: http://almere.pilod.nl/sparql.

Various Sensor Use Cases (SSN)

Contributed by: Kerry Taylor, on behalf of the W3C SSN Incubator Group


These were collected to drive the initial development of the SSN ontology http://www.w3.org/2005/Incubator/ssn/wiki/Use_cases and http://www.w3.org/2005/Incubator/ssn/XGR-ssn-20110628/#Motivating_Use_cases_.28Sensor_Web_and_Sensor_Networks.29

There are 4 categories identified:

Use Case Class Description
Data Discovery and linking Find all observations that meet certain criteria, and possibly link them to other external data sources. The user may use different criteria to select the spatial area, temporal window, and types of observations to be found, and may relate the results obtained to external data sources.
Device Discovery and Selection Find all the devices that meet certain criteria. The criteria may include type, geographic region, measured phenomenon, range of measurement, availability, owner or responsible party, and manufacturer, or combinations of those.
Provenance and Diagnosis Provide extra information about the instrument to better evaluate or process the data
Device Operation Tasking and Programming Command a device's operation using its description and information on its conditions of use

From the greater detail provided, the following requirements can be determined

  • spatial and temporal extent of observations for discovery by bounding box or named region or user-defined geometry
  • named observed property for discovery and provenance
  • device capability including performance in extreme conditions and accuracy, precision, drift, sensitivity, selectivity, measurement range, detection limit, response time, frequency and latency, for discovery and assessment of fitness-for-purpose
  • sensor data sheet information including deployment-specific information for catalogues and community standards for particular fields of application
  • link to domain-specific definitions for types of features to be observed or types of properties to be measured.
  • The physical structure on which the sensor is deployed and its location (may include the altitude or depth below a normative stream height), the custodian responsible for the sensor, the maintenance schedule for the device (e.g. how often is the sensor checked and freed of weeds) and the environmental conditions under which the sensor is expected to operate according to specification.
  • sufficient information about the capability of sensor devices and about the current state of the devices to support a palette of options for selection by the user. For example, a user should be able to define the desired observation frequency expressed in terms of the possible frequencies identified for the sensing device. It should be possible to extend the ontology to capture command language templates sufficient for device drivers to translate a completed template to an executable device-specific program. See How to represent a process implemented by a sensor for one way to model this and Taylor and Penkala 2009 for another.
  • The user should be able to understand the network resource cost of proposed instructions (for example, power required per measurement, current battery life, latency before instruction can be executed). These qualities could be interpreted by the scientist user directly, or by an automated agent aiming to optimise network efficiency through resource scheduling and optimisation algorithms.

Summary wrt UCRs for SSN

All these needs are covered in either the current SSN ontology, the requirements for SSN, or by identified best practice requirements for spatial and temporal data more broadly. However, many of these are covered by SSN currently only as a generic placeholder. For example, the tasking and programming capability in SSN may need more prescriptive finer design especially for dynamic IoT applications. As another example, latency is mentioned a few times and, although it is clear how this should be done in SSN, 'latency' itself is not a term in the ontology. Likewise for 'power required per measurement' and 'current battery life', and domain-specific definitions for types of features to be observed or types of properties to be measured. The encoding of time and location and the measurement values themselves are additional examples of the openness of SSN that probably should be reduced in some areas.

I suggest summarising this as two requirements

  1. Review the extent to which domain-specific or open-ended elements of SSN should be extended, possibly by reference to external ontologies (skos-like vocabularies) as exemplars, or by small additional components.
  2. Model tasking, programming and actuation of sensing devices.

Note also the things I have collected up as requests from other people since SSN was first published: SSN Wish List

Publishing Cultural Heritage Data (Best Practice, Time, Coverage)

Contributed by Lars G. Svensson

Cultural Heritage Data such as library authority files are increasingly being published as Linked (Open) Date. Those datasets contain, among other entities, descriptions of spatio-temporal events such as World War I, the Birth of Albert Einstein (date and place) or Martin Luther's pinning of his 95 theses. The problem is that most of the spatio-temporal information is inexact. This inexactness ranges from time spans (second quarter of the 9th century, e. g. approx. 825-850, which also could be 823 or 852) to geographic entities such as Renaissance Italy (what did Italy look like at that time, and to what extent is the Italian renaissance as a time period different from the English?).

When cultural heritage institutions put their data on the web, the staff members mapping their data to web standards often do not have expertise in temporal or geospatial data formats. Formats such as WKT are standardised but it is difficult to know if the mapping from the local data source is done correctly. A validator for commonly used formats such as WKT or GeoJSON would prove helpful.

Challenges include:

  1. There is no framework available to describe fuzzy temporal information. ISO 8601 and the related XSD datatypes assume a precision that cannot be supplied by the data publishers.
  2. In addition to that, OWL reasoning over cultural heritage datasets is severely hampered since OWL only accepts the datatypes xsd:dateTime and xsd:dateTimeStamp as temporal datatypes (cf. [Time Instants]).
  3. Little or no possibilities to perform validation of temporal and/or spatial data formats (e. g. WKT).

Note: This use case has similarities to Enabling publication, discovery and analysis of spatiotemporal data in the humanities

Dissemination of 3D geological data (Best Practice, Coverage)

Contributed by Rachel Heaven

The British Geological Survey (BGS), like all Geological Survey Organisations (GSOs), has as one of its principal roles to be the primary provider of geoscience information within its national territory. Increasingly the information provided is digital and dissemination is over the internet, and there is a trend towards making more information freely available. For BGS’s 2D information this requirement has been met by the provision of various OGC web map services http://bgs.ac.uk/data/services/wms.html.

However, geological units and structures are three-dimensional bodies and their traditional depiction on two-dimensional geological maps leads to a loss of information and the requirement of quite a high level of geological understanding on the part of the user to interpret them. The geoscience data user community includes scientific users, but also includes many other stakeholders such as exploration companies, civil engineers, local authority planners, as well as the general public. It is therefore the aim of many Geological Surveys, including BGS, to move towards the provision of geological information as spatial 3D datasets on the web that are accessible and useable by non-experts.

We have implemented a few ways of disseminating the 3D data on the web (http://www.bgs.ac.uk/services/3Dgeology/lithoframeSamples.html , http://www.bgs.ac.uk/services/3Dgeology/virtualBoreholeViewer.html, http://earthserver.bgs.ac.uk/, investigation of augmented reality smartphone application) but the remaining issues are

  • user should not need any special software for discovery and assessment purposes
  • user can subset the data by x,y,z limits
  • user can overlay their own area/volume of interest on the model (e.g. for tunnelling projects)
  • user may have to overlay their own (or an open data) DTM if the model is built using a non-open data DTM
  • to represent complex geology (folding, faulting, intrusions etc) and varying data resolution the delivery method must be able to handle triangulated irregular networks (TINs) and heterogeneous resolution voxel grids.

If there existed a best practise or standard way of publishing this sort of data then it would encourage development of applications on the web to handle them. The datasets that BGS is generating are

  • 3D spatial models of rock type and/or lithology currently represented as stacks of 2d subsurface grids representing the interfaces between different layers.
  • 3D voxel datasets of x,y,z grid cell and geological, physical or chemical property (+ associated uncertainty).
  • 3D LIDAR point cloud data e.g. of retreating cliff faces, underground mine structures

Publication of Raw Subsurface Monitoring Data (Best Practice, SSN, Time)

Contributed by Rachel Heaven

The UK Government is funding a new Energy Security and Innovation Observing System for the Subsurface (ESIOS). ESIOS will consist of a group of science research facilities where new subsurface activities such as fracking (hydraulic fracturing) for shale gas can be tested and monitored under controlled conditions. This research will address many of the environmental issues that need to be answered for the development of the UK’s home-grown, secure energy solutions. This includes carbon capture and storage, geothermal energy, nuclear waste disposal, underground coal gasification and underground gas storage.

Data will be collected from monitoring boreholes and from surface, airborne and satellite sensors. The raw scientific data will be published freely online, possibly in real-time or near real-time, to encourage transparency and public confidence in the industry, and to provide underpinning science for regulation.

The scientific data will consist of:

  • Location data for the sensor facilities
  • Time series data consisting of x,y,z (depth), time, and an observed property (e.g. porosity, resistivity, density, methane content, fracture orientation, groundwater flow direction, seismic ground motion).

We want to be able to publish this raw data on the web in such a way that it can be easily consumed by third party web applications for visualisation, spatio-temporal filtering, statistical analysis and alerts.

(Another similar use case is for publication of geomagnetic monitoring data, for which the primary outputs are time series tables or graphs, and the location data for the observation station is relatively simple and low accuracy)

Use of a place name ontology for geo-parsing text and geo-enabling searches (Best Practice, Time)

Contributed by Rachel Heaven

BGS has valuable geoscience data in text form dating back 180 years, which is gradually being scanned and OCR to make it more accessible and searchable. Much of the information in the reports concerns observations or interpretations made at a location or about a named geological feature. We would like the relevant information in those documents to be retrievable from a web search using coordinate limit criteria or using a place name criteria, so this use case requires a place name ontology (or federated ontologies).

For BGS's purposes the ontology should contain historical place names, named subsurface geological features (e.g. Widmerpool Gulf), palaeogeographic place names, and named submarine features (e.g. GEBCO undersea feature names http://www.gebco.net/data_and_products/undersea_feature_names/).

To extend the capabilities into the vertical dimension then the ontology should also contain the names of qualitative earth realms (vertical divisions within the atmosphere, ocean and solid earth – such as in the SWEET ontology https://sweet.jpl.nasa.gov/).

To extend the capabilities into the time dimension then the ontology should also contain the names of historical and geological time periods (e.g. https://www.seegrid.csiro.au/wiki/CGIModel/GeologicTime#GeologicTime_XML, used in a recent example of geological age name parser at http://www.agenames.org)

With a resource like this, all text resources could be parsed to locate them in time and space.

Each named feature should have a spatial attribute, either as topological relations to other named features, or as spatial-temporal extent appropriate for various scales and with appropriate uncertainties (i.e. fuzzy definitions of geometry and time periods). Versioning will be important e.g. for administrative boundaries that change frequently.

(NB geonames http://www.geonames.org/ goes much of the way to meeting this requirement)

Driving to work in the snow (SSN, Time, Coverage)

Contributed by Cory Henson (Bosch RTC)

Consider the following wildly-fictional scenario: Sue is driving to work in the snow on a cold Pittsburgh morning. On entry, her car recognizes the cold weather and automatically heats the interior to Sue's preferred temperature and turns on the defrost to clear the frost from the wind-shield. On the way, the snow causes significant traffic delay on her route forcing her to re-schedule an early morning meeting. In response, the car suggests she stop at her favorite nearby coffee shop for a Flat White until the roads are clear.

The scenario above requires access to multiple types of observation, spatial, and temporal data which may be local to the car or available on the Web.

The different types of observation data may include:

  • sensed environmental observations (e.g,. freezing-temperature, frost-on-windshield)
  • user behavior observations (e.g., Sue sets the thermostat to 75F, Sue stops at the coffee shop, Sue updates her calendar)
  • observations on the Web (e.g., current weather conditions, traffic conditions)

The different types of spatial data may include:

  • points-of-interest (e.g., home, work, coffee shop)
  • spatial relations (e.g., coffee shop is NEAR Sue's current location)

The different types of temporal data may include:

  • calendar events (e.g., Sue's meeting on calendar)
  • schedules (e.g., schedule when the coffee-shop is open)
  • temporal relations (e.g., the predicted time to reach work occurs after the beginning of a scheduled meeting)

In addition, the car uses light-weight communication protocols, such as CoAP and/or MQTT, to exchange data (i.e., observations, spatial, and temporal data) between networked components.

This scenario may face the following general challenges for representing, managing, and querying observation data:

  • discover observation streams within a given spatial context (and matching some criteria)
  • query for observations within a given spatiotemporal context (and matching some criteria)
  • publish and subscribe to an observation stream within a given spatial context (and matching some criteria)
  • filter an observation stream based on given set of criteria (e.g., quality, feature-of-interest, observed-property)
  • represent data with a small syntactic footprint (for exchange between resource-constrained devices)
  • integration of SSN with existing, well-known, IoT protocols (CoAP, MQTT, etc.)
  • represent "high-level" qualitative observations (such as observations of user behavior, e.g., Sue stopped at the coffee shop)

Intelligent Transportation System (Best practices, Time, SSN, Coverage)

Contributed by Antoine Zimmermann

Intelligent Transportation Systems (ITS) can be defined as the application of advanced information and communications technology to surface transportation in order to achieve enhanced safety and mobility while reducing the environmental impact of transportation. The addition of wireless communications offers a powerful and transformative opportunity to establish transportation connectivity that further enables cooperative systems and dynamic data exchange using a broad range of advanced systems and technologies. - See more at: http://www.its.dot.gov/standards_strategic_plan

ITS do so by exploiting information from various origins, especially the Web. Several web sites, web services, datasets related to public transport services, traffic, road network structure, localized incidents, and so on have to be exploited in order to convey users with the best decisions, in real time. All of these information sources rely considerably on spatio-temporal data. The challenge is to model dependency in both space and time seamlessly and simultaneously so that the accuracy of analysis can be improved (for instance for regulation of multimodal transportation network) or the processing of aggregated information can be simplified (for instance for multimodal traveler information system). For such systems to work well in a pervasive way, it is also important that the system can easily discover relevant datasets/services based on the user current location.

Consequently, such systems would greatly benefit from standardized formats, standard practices for publishing or making spatial data available online. A standard way of indicating time and time frames would also help correlate several temporally situated entities such as bus schedules, real time bus position, and traffic light durations.

A specific type of ITS is Advanced Traveler Information System (ATIS) that computes an accurate travel duration. To do so, ATIS should be able to combine data following different spatio-temporal scales. These data could be related to the current or anticipated network traffic (the congestion level), the network topology (number of lines on the routes, presence of traffic lights, etc.), the presence of expected events (which can be static, like work on the road, or dynamic like demonstrations), the weather state (the presence of rain or mist on a part of the itinerary), and so on.

ITSs can also be dedicated to the management of parking spots. For a driver, the choice of its parking spot is a multi-criteria decision process that takes into account static data given by the description of the infrastructure (whether the spot is private or public, reserved for disabled, etc.), dynamic data given by sensors (like traffic) and personal data (destination, budget).

Optimizing energy consumption, production, sales and purchases in Smart Grids

Contributed by Antoine Zimmermann

In smart grids, energy management has to take into account the fact that any energy consummer may also be a producer (they are thus "prosumers"). This leads to new load balancing problems as well as new forms of economic exchanges regarding selling and buying energy. In order to take an informed decision on what amount of energy to buy from whom at what cost, or to sell, decision algorithms must use information that can be local (their own consumption and production), global (statistical data on seasonal household energy consumption), and possibly external to grid (meteorological data). In such context, reliance on Web data from several sources adds real value to the decision process.

The kind of data that has to be considered are, for the most part, highly fluctuating: weather for assessing heating needs, stock exchange for pricing appropriately, current and future offer and demand, etc.

There is a need for a temporal model that covers historical data for statistical analysis, short term timestamped sensed data, and data about future predictions.

The need for spatio-temporal information is even increased if the smart grid is including electric vehicles that can serve as energy producers when they are not consuming electricity for recharging.

"101" Smart City Use-cases

Contributed by Payam Barnaghi on behalf of the EU FP7 CityPulse Project

The CityPulse project has identified 101 smart city scenarios and related use-cases in cooperation with partner cities and the City Stakeholder Group in the project. The scenarios are made available online for the wider community to rank the use-cases. The scenarios are available online at : [7] A Large set of of semantically annotated datasets collected from partners of the CityPulse EU FP7 project and relevant resources for smart city data are also available at: [8] The annotation tool for the datasets is also available at: [9]

In "101" Smart City use-cases, each scenario is described in a short narrative and is ranked based on stakeholder needs and community groups by completing an online survey. The following lists top three ranked scenarios from the use-cases. The complete list and details of the ranking and scenario evaluations are described in M. Presser et al, Smart City Use-cases and Requirements, available at: [10]

1) CONTEXT-AWARE MULTIMODAL REAL TIME TRAVEL PLANNER

Tony needs to travel from home to work. Different means of transportation are generally available to him and include walking, biking, moped/scooter (own, shared, electric/petrol), car (own, pooling, ride sharing, taxi), public transportation (bus, metro, train, ferry/boat). Transportation can be optimised to Tony’s preferred travel time, convenience (comfort, seating, crowdedness, safety, environmental quality), total cost, environmental impacts, scenic route, and personal health. Factors that impact this optimization include conditions of the different transportation modes (road, weather, maintenance works, traffic intensity, people density, parking availability, charging pole availability, pollution, air quality, irregularities in traffic schedules, road tolls, seating availability, accidents, availability of city bikes,...). Tony will be presented with his ideal route and will be able to select each leg of the journey based on concurrent and projected aggregated conditions. Recalculation of his chosen route(s) can happen if conditions or preferences change, and will adapt to any detour of own choice. (Details available at: [11])


2) PUBLIC PARKING SPACE AVAILABILITY PREDICTION

Frank is having a hard time finding a public parking space. The city is increasingly reducing the amount of parking spaces per unit (e.g. apartments), and the difficulty of finding a parking space means Frank has to circulate his car looking for available parking spots. This is both annoying for him and results in negative environmental impacts (pollution, noise). By using multiple input sources of information a certain degree of probability of finding a parking spot in different locations can be provided, also including timed no parking zones, thus reducing circulation times. By knowing the current situation of other circulating cars, Frank can avoid congested hot spots by being rerouted towards different paths to even out the distribution. When Frank ends up leaving his spot he can also actively provide parking availability data via his smartphone. (Details available at: [12])


3) STIMULATING GREEN BEHAVIOR

The city council has an interest in making citizens aware of their own environmental impacts in an attractive way without forcing the issue. The council provides citizens and interested parties with a dashboard, so they can follow the "environmental heartbeat" of the city as well as their own impacts and contributions. Now citizens will be able to see and measure the environmental impact on the city as a whole as well as their own personal actions, indicating noise levels, air quality, waste index, recycling activities, fresh water quality, sea water quality etc. Anyone can now compare behavior and activities to that of other groups such as neighbours, neighbourhoods or city districts, resulting in competitions between these to collect "Green Points". Not only the fun of competition is stimulating, but Green Points can be traded for rebates on public transport and other environmentally friendly actions which forms a "green economy" ("green coins"). (Details available at: [13])

Linked Data for Tax Assessment

Contributed by Luigi Selmi (from public-sdw-comments)

Tax assessments are based on the comparison of what is due by a citizen in a year for her ownership of real estates in the area administered by a municipality and what has been paid. The tax amount is regulated by laws and based on many criteria like the size of the real estate, the area in which it is located, its type: house, office, farm, factory and others. Taxpayers can save money from the original due depending on the usage of the estate. A family that owns the house in which they live can save the entire amount. Many other regulations lighten in different ways the burden of the tax for other categories of taxpayers. Furthermore the situation about a taxpayer changes over the years in relation to her properties share and family status. Due to the many different situations met, an employee in charge of performing tax assessments on behalf of a municipality must collect many information before being able to assert with a good degree of confidence that a difference between the original amount and what has been paid is not justified and an advice has to be sent to the taxpayer starting a long and expensive process to recover the difference. Currently each single assessment requires the employee to collect information from different public administrations web sites, archives, registries, documents. Data scattered in so many silos and formats dramatically reduce employees productivity and assessment effectiveness at the point that it is not always clear whether the money recovered is worth the cost of the assessment. A Linked Data approach for sharing spatial and temporal data would certainly increase the productivity of the assessor.

Images, e.g. a Time series of a Water Course (Best Practice, Time, SSN, Coverage)

Contributed by Kerry Taylor on behalf of Jamie Baker, Australian Commonwealth Department of Communications

This use case is provided to extend three primary use cases already before the Working Group:

  • Publishing geographic data (best practice)
  • Consuming geographic data in a web application (best practice)
  • Publishing geospatial reference data (best practice).

More broadly the Commonwealth of Australia has developed a National Map web platform which is currently making available authoritative national datasets. There is a need to recognise that data can an image (e.g. an image-based tile set for example) and therefore in itself also create a time series-based resource (for example, the change in a water course over time which can be visualised as time series layers). Indeed both the ISO and OGC have recognised this in their standards. It is the Australian Government Department of Communication’s view, as the lead agency stewarding spatial data policy, that image-based resources should also be included in the consideration of this working group as it relates to geographic and spatial features geometries. Wheresoever possible the Commonwealth view is to maintain the highest applicability of a standard or best practice guide and not limit conformance options for data holdings (especially of public origin). This also applies to cadastral and other data at the state/territory level which could show the change in land parcel, development or other property and built environment features over time. In terms of our future cities, sensors and other data sources may also need linkage to image-based resources for citizen use. As such:

  1. Image-based data needs to be recognised and discoverable as it too tells a story
  2. Time series data can be visual and therefore visualised as a data layer or an image in time or both
  3. Linking of data whether image-based or not should be discoverable and mix or match just as easily as data of a similar or dissimilar type
  4. Metadata conformance is crucial to support discoverability, interoperability and provide information on the nature of a data resource (e.g. Time series image or time series data)
  5. A challenge exists in maximising the interoperability of geographic and/or spatial data both above and below ground level. (An example may be subsurface water imaging data combined with sensor data).

This additional information supports a broader need for SSN, Coverage and Time considerations for the above three current use cases.

Droughts in geological complex environments where groundwater is important (Best Practice, Time, SSN, Coverage)

Question: how does the Thames Basin respond to droughts and can abstraction be maintained under severe drought conditions?

Contributed by Chris Little on behalf of Andrew G Hughes, British Geological Survey

During the period 2011-2013, the UK faced an extraordinary drought only to be saved from a likely major crisis by very high spring and summer rainfall (CEH, 2012). Government asked questions such as “how much water is left in the tank?”, at which point managers and regulators realised that they didn’t know the answer with any certainty (EA, 2012). A National Drought Group of leading stakeholders was formed and led by the Chief Executive of the Environment Agency (EA) reporting to the Secretary of State for Environment, Food and Rural Affairs. The whole of the UK was affected, but the south-east most severely because of the lower rainfall and high water demand.

When will London run out of water? How socially accepted is drought and associated water restrictions to the general public? When will water company groundwater sources begin to switch off? Questions like these are critical for drought management, but often the science is not sufficiently advanced to address them, and where it is, not fully integrated to satisfactorily answer them.

The River Thames Basin is home to 13 Million people, considerable industry and valuable aquatic ecosystems all of which require the effective and sustainable management of the water environment in the basin to thrive. A thorough understanding of the hydrology of the basin is vital to underpin this management to ensure the best use of resources. This is particularly important given the twin pressures of increasing water consumption and climate change. The groundwater system of the Thames consists of around 12 aquifers most of which are not hydraulically connected, except via the River Thames and its tributaries. These aquifers are locally very important for water supply and their provision of base flow sustains the ecology of the river system in dry summer periods and droughts.

To properly simulate the system then a good geological understanding has to be translated into a hydrogeological knowledge and then simulated. This is not a straight-forward task. The important elements of the system include: 3D geological understanding encapsulated into a geological model, dynamic model of the surface processes, groundwater and river systems along with a model of water supply (e.g. IRAS; Mastrosov et al., 2010). This will ultimately involve:

  • Static data (updated as understanding increases)
  • Data passed in a one way chain between models runs separately
  • Dynamically linked models to investigate feedbacks between different parts of the system

The aim would be to develop an integrated system that can address the question “When will water company groundwater sources begin to switch off” or similar.

References

  • CEH. (2012). Retrieved 7 Sep 2013, from www.ceh.ac.uk/data/nrfa/nhmp/other_reports/2012_Drought_Transformation.pdf
  • EA (2012). Review of the 2010-2012 drought and prospects for water resources in 2013. Environment Agency Report.
  • Matrosov E.S., Harou, J.J. and Loucks D.P., 2010. A computationally efficient open-source water resource system simulator - Application to London and the Thames Basin. Environmental Modelling & Software. Volume 26, Issue 12, December 2011, Pages 1599–1610

Soil data applications (Best practice, SSN, Coverage)

Submitted by Simon Cox on behalf of Peter Wilson, Bruce Simons @ CSIRO

1. Farmer wants to know soil types and properties in an adjacent property which he is considering purchasing. ... the global soil community wants to be able to publish standardised soil site description/classification and soil analysis data which can then be collated (such as in the Harmonised World Soil Database) and used for modelling the spatial distribution of soil properties (digital soil mapping) (for example as part of the ISRIC 1kmSoilGirds or IUSS GlobalSoilMap projects). This would utilise our efforts with the SoilML (ISO28258) meta-model and the fully attributed implementable extension (currently ANZSoilML) to deliver the standardised soil data services.

2. Compare similar soils and productivity responses to addition ... the IUSS GlobalSoilMap project wants to deliver high resolution estimates of functional soil properties as 90m raster data across the globe, constructed through bottom up, country delivery of standardised data. Our TERN Soil and Landscape Grid of Australia project has now developed the required data for Australia and we need to progress delivery as standardised services (using WMS,WFS and WCS) as a demonstrator of how to do this globally. The GlobalSoilMap project (maybe through the UN Global Soil Partnership, or via ISRIC the World Soil Data Centre) could develop a portal to allow discovery/display of all the contributing country data and to facilitate user (eg global climate or food security modellers) connection to the services from multiple sources.

3. Agronomist needs observations of soil properties such as pH, Nitrogen, and soil-type and derive new properties using locally defined pedo-transfer functions ... Access observed and interpreted soil properties (by soil type and/or by spatial distribution) in a standard format that allows using algorithms/pedotransfer functions to use these properties to calculate additional interpreted soil properties.

Bushfire response coordination centre (Best practice, SSN)

Submitted by Simon Cox on behalf of Paul Box, Simon Cox and Ryan Fraser @ CSIRO

This user story covers a number of interrelated use cases:

  • UC1 Search for place name
  • UC2 Disambiguate place, based on type and provide
  • UC3 Find the location of a place (centroid, representative location)– where is it?
  • UC4 Find information about a place
  • UC5 Find and use a suitable alternative geometric representations of a place – its shape, for a given scale and application
  • UC6 Discover, access and use measurements relating to a place
  • UC7.1 Discover related places - find synonyms
  • UC7.2 Discover related places - topologically related places such as neighbouring, or containing regions

User story

A bush-fire is underway in Blue Mountains NSW. An incident management team has been established, with an incident controller from NSW Fire and Rescue in charge, based in a coordination centre. She notices that the Twitter analytics feed has flagged a Tweet that mentions a fire in ‘Springwood’. The location of the Tweet shows on the incident map as being in the ‘Blue Mountains’ – (this location is a geocode of place name used in the Tweeter’s Profile). The watch officer enters ‘Springwood’ [uc1] in a multi-gazetteer index and gets 41 hits for Springwood in Australia. She zooms to the Blue Mountains and sees there are 13 places called Springwood. These results include a school, a number of rural properties, and an official suburb named Springwood [uc2] near which most of the other places are located. The officer selects the suburb name in the National Gazetteer, and the map zooms to the bounding box for the selected place [uc3]. The controller wants to find more detailed information about the place and clicks on its identifier (a URI for the place). The user is provided with information about:

  • identity of the place and data sets/collection to which it belongs [uc4]– e.g. the national gazetteer
  • available geometries for the place [uc5]- e.g. a feature-service for a gazetteer data source, hosted by Geosciences Australia
  • existence of links to additional sources of information about the place [uc6] – e.g. links to data about the suburb provided by the local government
  • synonyms for the place – alternative identifiers used for the place [uc7.1] – e.g. identifiers used for suburbs in the Australian Statistical Geographic Standard (ASGS)
  • related places [uc7.2] – e.g. a local government area that contains the suburb, or hydrological reporting units cover the suburb.
  • information about related places e.g:
    • population profiles for the place codes using ASGS codes [uc7.1&6]
    • nearby sensors providing hydro/met data that are in the containing hydrological reporting unit [7.2 & 6]

An official report of the fire location now also appears on the screen, from a fire service operator on the ground. With the fire location now confirmed, the priority is to identify the areas at risk, and assess community impact, locate possible evacuation centres and set in place evacuation plans.

A fire spread model has been run using reported fire location. An impact analysis and evacuation plan is being developed. The predicted fire spread polygon is shown on the incident map. To assess affected population the analyst needs to find population geography and data. [uc5]

The Springwood place landing page has a link to get information about the data source [uc4]. This is the national gazetteer, which provides bounding box geometries only. This is not accurate enough for her analysis. Returning to the graph of linked resources, the analysis determines that the gazetteer entry has a synonym in the ASGS [uc7.1]. She clicks on this and sees it’s the census geography for the same place (Springwood suburb) [uc4]. She finds the data source link which she discovers uses polygonal geometry and adds this as a service to her map.

She is now able to see that Springwood suburb will be within the predicted fire polygon and will need to be evacuated. The analyst clicks linked information resources for Springwood (the synonym in the ASGS dataset) and a graph of related resources is displayed [uc 7.1, 7.2, 6]. This shows a link to a suburb profile based on the most recent national population and census data is available the analyst clicks on this and a query for predefined measurements (plus the place identifier) is passed to a census data cube service. The analyst visualises and saves the result set locally.

The analyst also notices that information resources are connected to Springwood (in the gazetteer dataset) [uc 7.1, 7.2, 6]. These include a link to a containing local government area (LGA) and links to LGA emergency management resources on the website. This lists contact information and evacuation centres information which is used to inform development of the evacuation plan.

Observations on geological samples (SSN, Time)

Submitted by Simon Cox

Geological samples are retrieved from the field and then processed in the laboratory to determine various properties, including chemistry, mineralogy, age, and petrophysical properties like density, porosity, permeability.

Samples obtained as part of economic activities, such as mineral exploration, are usually processed in commercial assay and chemistry labs. For QA/QC purposes, each batch of samples will have a number of control samples inserted, for which the concentration of particular chemical species are already known. For confidentiality reasons the location information associated with each sample is not provided to the lab, but must be re-attached during the interpretation phase. During processing, many derived samples will be generated by various physical and chemical procedures. In some cases the derived samples are strict sub-samples, whose intensive properties are intended to be the same as the parent. In other cases, the split is 'biased', with the derived sample intended to select a specific sub-sample, defined by a particular particle size, density, magnetic properties, etc. The link from the derived sample to the parent sample must be preserved, and the link from the parent to the location from which it was obtained also. In some cases the location is associated with another sampling artefact, such as a drill-hole or traverse or cruise, with the latter carrying the detailed location information.

In a research context some samples have a particularly high-value, having been obtained by an expensive process (involving drilling or ships or spacecraft) or from a location that is hard to visit (remote, offshore, in space). These samples are sometimes sub-divided and distributed to multiple research teams or labs for different specialized observations. Each lab will run its own LIMS system, which will usually asign a local identifier for the sample. When the results of these observations are reported, it is necessary that observations from different labs can be correlated with each other, so that the complete picture around each sample can be assembled.

These stories focus on sensing applications involving ex-situ sampling, where a location is visited and a specimen obtained using some sampling process, then transported to one or more laboratories where it is processed into one or more sub-samples and various observations made. Sample identity is usually key, and the relationships between samples, between samples and other artefacts of the sampling process, and also with other geographic features or locations. The sampling time and analysis and reporting time are all different.

Similar process apply to botanical sampling, and to environmental sampling (water, air, dust).

Spatial Sampling (Best Practice, SSN)

Submitted by Simon Cox

Most observations are made on _samples_ that are selected to be somehow representative of the feature of ultimate interest which is being characterized. The sample may be statistical, or related to accessibility, or may be of a proxy phenomenon which can be related to the property of ultimate interest.

In environmental observations, certain spatial distributions are commonly used across multiple disciplines, such as

  • grids
  • transects, cruises, flight-lines
  • cross-sections
  • physical sampling

These may be related to each other (samples taken along a drill-hole, stations on a traverse, shots along a seismic section) and the relationships provide a kind of 'topology' of sampling which assists access and processing. Sampling features may also be associated with other organizational structures, such as cruises, field trips, campaigns, projects, missions, orbits, deployments, platforms, which are used for discovery and for navigation within a datasets. Sampling strategies are often combined with an observational procedure or instrument to define a standard 'protocol' for observations. The protocol may be identified by name.

Additional comment by Rachel Heaven

The locations within a spatial distribution may have a different degree of certainty with respect to each other than the positional certainty of the spatial distribution as a whole e.g. the ends of a sampling traverse may be known in a national or global coordinate reference system to +/-5m accuracy; soil samples may be taken along the traverse at every 1m +/-0.01m interval, or species sightings that need to be re-visited may be described in real world terms such as "half way up the burn on the left hand bank". Similarly, measurements taken down a drill hole are known accurately in down hole depth with respect to the drilling datum, but less accurately in true vertical depth and with respect to a national vertical datum. If the hole deviates from vertical, the absolute location will be even more uncertain.

Select hierarchical geographical regions for use in data analysis or visualisation (Best practices, Time)

Contributed by Bill Roberts based on needs arising from Swirrl's own work

Statistical data is frequently referenced against geographical regions. A common requirement is to select a collection of non-overlapping regions with complete coverage of a 'parent' region (a 'Mutually Exclusive Collectively Exhaustive' - MECE - set). This might be used for data aggregation: given the population statistics for all council areas in Scotland, calculate the population of Scotland.

Or it might be for data visualisation: retrieve data on average house prices for all parliamentary constituencies in the UK, then combine this with polygons of the constituency boundaries and use it to draw a choropleth map.

Although geographical data frequently includes 'contains' or 'within' relationships between larger and smaller areas, this is not sufficient for the above use cases. A larger area can be broken down into smaller areas in a variety of ways. Sometimes a combination of 'contains' relationships and knowledge of the 'type' of region can be enough: it may allow separating out a particular level in a geographical hierarchy. But that doesn't allow for cases where regions of a particular type don't have full coverage of the parent. An example is 'parishes' in England. The collection of all current parishes is non-overlapping, but it is not exhaustive. Some locations are not in any parish.

The variation of administrative, statistical and political geography over time is also an issue. A particular division of a region into sub-regions may be valid only for a specific period. For example, council boundaries change from time to time. At any given time, there is a MECE set of council boundaries in a region, but the boundaries change occasionally, so if analysing data on English councils from 2014, a different set of areas is required than would be needed for say 2012. 2012 might involve areas A,B,C,D,E,F whereas 2014 requires A,B,C,D,G,H. A similar issue arises when dividing Europe up into countries for example.

These are common problems and there are probably many separate solutions already in active use. It would be useful however to have a standardised vocabulary to represent these kind of relationships, which would increase the interoperability of data analysis tools.

Satellite data processing (Best practice, SSN, Coverage)

Contributed by Kerry Taylor, informed by Matt Paget and Juan Guerschman, CSIRO

Vegetation fractional cover is a key metric for monitoring land management, both in pastoral and agricultural settings. The aim is to estimate the fractions of photosynthetic and non-photosynthetic vegetation and the remaining fraction of bare soil. Fractional cover is computed from both Landsat and MODIS satellite surface reflectance products but calibration and validation via ground-based observations is also needed.

The method for computing fractional cover was developed by comparing geo-aligned Landsat sensor and two MODIS-derived surface reflectance products. Scaling issues associated with different sensors and spatial resolutions were addressed, along with locally-measured effects of soil colour and soil moisture.

Source Data:

1) Data from the TM (Landsat 5) and ETM+ (Landsat 7) sensors were downloaded from the United States Geological Survey (USGS) and corrected for atmosphere, topographic and bi-directional surface reflectance effects, standardised to a nadir view (i.e., satellite zenith angle is zero) and a solar zenith angle of 45°)

2) The MODIS 16-Day Nadir BRDF-Adjusted Reflectance product (MCD43A4) provides surface reflectance data as if they were taken from the nadir view and uses the solar angle calculated at local solar noon (Schaaf et al., 2002). MCD43A4 data were obtained from the Land Processes Distributed Active Archive Center (LPDAAC). These data were resampled to a geographic coordinate system.

3) The MODIS surface reflectance products from the Terra satellite (MOD09) provide an estimate of the surface spectral reflectance as it would be measured at ground level in the absence of atmospheric scattering and absorption (Vermote et al, 2011; Vermote & Kotchenova, 2008). The 8-day composite (MOD09A1) selects the best possible observation from an 8-day window, selected on the basis of high observation coverage, low viewing angle, cloud free and low aerosol loading, with a spatial resolution of 500 metres and seven spectral bands. The MOD09A1 surface reflectance data used here were subject to the same geometric processing as the MCD43A4 data.

4) Field measurements of fractional cover were obtained at 913 sites across Australia (ABARES, 2013). Exactly 78 of those sites were sampled repeatedly, resulting in a total of 127 observations (a measurement taken at a given site on a specific date). The field observations did not systematically record soil colour or soil moisture. Recent observations include soil colour (Munsell Soil Color Charts, 1994), yet soil moisture is only subjectively measured (i.e., wet or dry). To derive these two soil properties consistently and objectively for the entire series we used information derived from other sources.

As a result, a combined product is proposed which gives flexibility to use MODIS-derived estimates when large areas and high temporal repetition is desired, and Landsat-derived estimates when high spatial resolution is essential and/or when data prior to 2000 is needed. The algorithms needed for implementing a fractional cover product based on a blended Landsat-MODIS product are given[1].

Now, this fractional cover coverage product over Australia is computed monthly and distributed by the NSW government[14], where it is used for their Dustwatch program[15] amongst other things. The Dustwatch program publishes monthly (PDF) reports of wind-related erosion and groundcover change.

[1] Guerschman et al, "Assessing the effects of site heterogeneity and soil properties when unmixing photosynthetic vegetation, non-photosynthetic vegetation and bare soil fractions from Landsat and MODIS data", Remote Sensing of Environment, to appear 2015.http://dx.doi.org/10.1016/j.rse.2015.01.021 (Note that this paper provides several references to similar approaches to using multispectral coverages to determine vegetation)

Marine observations - eMII (SSN, Coverage, Best Practice)

Uploaded by Simon Cox on behalf of IMOS eMII

Water column observations

I am a modeller and I want to find, filter and extract water column data that has been collected by profiling instruments (e.g. CTD, XBT, ARGO Floats, CTD’s mounted on animals) so that I can prime my models. I want to easily be able to discover these data either by nominating the collection device type, or by nominating data parameters of interest. Once I can see which datasets meet my broad discovery criteria, and whilst still in the Portal, I want to be able to filter out data that is not of interest (e.g. those data outside of my region of interest, those not covering my features of interest, data which is unqualified, data below a certain depth and data from institutions I don’t trust). I want to extract these data in a harmonised format (i.e. receive a single file of aggregated data expressed using common data fields, or in multiple files where each file has a similar syntactic and semantic encoding). I don’t want to have to spend time transforming datasets with differing formats, nor guess which data fields in datasets from different sources are semantically covering the same information. I need to know what each field in the downloaded data represents.

Reconfiguring data ingestion process

I am an eMII Project Officer. I spend my day pulling data from partner services and transforming it so that it can be published through the 1-2-3 Portal. Just when I think I have tweaked all of the systems I need to in order to successfully ingest and publish provider data, the provider changes his/her data format, schema syntax or semantics. I then have to re-write or re-configure systems to obtain any new data. This happens very frequently. Even data providers who supply me with data from the same instruments use different data encodings and formats so I have to create individualised database tables to manage their incoming data. I would like data providers to agree on common schema for expressing similar data types and in collaboration develop some ‘governance’ rules surrounding data publication to the Portal to reduce the time I spend on repetitive (and often unnecessary) tasks.

Observations along profiles

I am an eMII Project Officer and I manage multiple profile type datasets (e.g.: Argo profile, seals profile, XBT profile …). I want to be able to assess the quality of the data provided by partners before inclusion into the IMOS database and making it available through the IMOS portal. I want to set up a system whereby every new profile will be compared with existing profiles available in the IMOS database. The incoming profile will have to conform to a standard format so that it is relatively easy to implement and develop different set of rules to enable comparison with existing profiles. The system will send me an alert if one or multiple profiles failed some tests. Then I will be able to follow up more quickly with the corresponding partners to check if an error occurs during the processing of the data or if actually the data is correct. In the end, this process will enable an increase of the quality of the data provided to the end user.

Marine observations - data providers (SSN)

Uploaded by Simon Cox on behalf of IMOS

Atlas of Living Australia (ALA)

The ALA would like to integrate their data into the AODN. The ALA serves a range of web services including WMS and corresponding ISO19115/MCP metadata. The ALA's use case is unusual in that it has tens of thousands of WMS layers and metadata records. This data cannot be added to version 2 of the AODN portal because it is too large to be harvested into the menu tree. ALA will need to be integrated with the 123 portal. Dave Martin's team has created a proof of concept integration. There would be a single metadata record for ALA, which will allow it to be discovered in Step 1 of the portal. After proceeding to Step 2 the user would see something like this mockup: http://bl.ocks.org/nickdos/raw/119e3c16edeced2a9355/


Reef Life Survey (RLS)

RLS have visited 2500+ coral and rocky reef sites and have conducted approx 6000 surveys across those sites. Each survey is conducted at a nominal ‘site’.

Methods 1 & 2:

During a survey observations are recorded of each of (1) vertebrate species abundance and biomass and (2) invertebrate species abundance.

Method 3:

During a survey downward looking photographs are taken. The photographs are sequenced 1-20 for each site and are not geolocated. Subsequently, the photographs are scored at 5 points within each image. Each point is scored into one of 36 categories. Parameters are date, depth, resolution, major category, minor category, numerical value.

User Story 1

I’m interested in ecosystems, reef assemblages and inter-species interactions. Show me what vertebrate and invertebrate species were found at this site (and any corresponding location/depth/habitat information).

What I want to see:

By site, all vertebrate species abundance and biomass values (for each survey?)

By site, all invertebrate abundance values (for each survey?)

User Story 2

I have a large-scale question to ask about a particular species, for example, I am interested in broad distribution patterns of lobsters, plankton dispersal and settling rates. Show me all of the sites that were surveyed and the presence/absence of a particular species at each of those sites.

What I want to see:

Across all sites that have been surveyed by RLS, the latitude, longitude, depth and presence/absence of a particular vertebrate or invertebrate species (no time component)

A time selector that shows changing or stable presence/absence values for repeat surveys at the same site

Institute for Marine and Antarctic Studies (IMAS)

The IMAS use case includes a number of data collections. The main requirements is a mechanism to easily install the necessary applications. Ideally the AODN will host the applications (GeoNetwork, Geoserver etc) in the NeCTAR Cloud. This cloud based infrastructure will be manged by the AODN, but IMAS will have administrator accounts on each application and will be responsible for data content.

Marine observations - data consumers (SSN, Best Practice)

Uploaded by Simon Cox on behalf of IMOS

Download Temperature and Velocity Data from NSW Moorings

The user would like to download temperature and velocity data from NSW moorings without downloading large numbers of NetCDF files, and without needing many clicks.

(Based on feedback from Robin Robertson)

Download Glider Data

The user would like an easy way to download the calibrated glider data. The user does not want the data delivered manually via drop box, or to face the difficulty of downloading NetCDF files in the way they are currently provided.

(Based on feedback from Robin Robertson)

Download ANMN Timor South moorings data

The user would like to download the ANMN Timor South moorings data - without needing 160 clicks.

(Based on feedback from Rebecca Cowley)

Download XBT data

The user would like to download XBT data from the portal. Not just the metadata - but the actual data.

(Based on feedback from Rebecca Cowley)

Download NRS data

The user would like to be able to download NRS moorings data.

(Based on feedback by Peter Thompson)

Understandable by scientists from other fields

The user would like to be able to understand the portal even though she is from another field (e.g. genomics).

(Based on feedback from Levente Bodrossy)

Filter moorings data by deployment and instrument type

The user would like to be able to filter moorings data by deployment and instrument type.

(Based on feedback from Craig Steinberg)

Download data as CSV

The user would like to download sea surface temperature from the Bass Straight as a CSV file - not NetCDF

(Based on feedback from Andre Chiaradia)

Argo float data in a bounding box in the Southern Ocean.

The user would like to download argo data from a particular region in the Southern Ocean.

(Based on feedback from Esmee)

Also see additional stories in un-edited emails

Building information management and data sharing (Best Practice)

Contributed by: Linda van den Brink (with thanks to Henk Schaap - Gobar)

The Dutch organization Rijkswaterstaat is responsible for the practical execution of the public works and water management, including the construction and maintenance of waterways and roads, and flood protection and prevention in the Netherlands. The following is a use case about sharing Rijkswaterstaat information to support building processes.

A part of a highway is in need of a new tarmac layer. This involves a lot of information sharing between the contractor (Rijkswaterstaat), the organization responsible for organizing the project and the organization responsible for carrying out the maintenance work. Building Information Management (BIM) is used for this and the data is published via a webserver.

The information being exchanged is asset management information, i.e. the location of the roads, tunnels, bridges, aquaducts, railway lines, surrounding terrain and waterbodies involved (geometric information). In addition, non-spatial information is important, like the layers of material the road consists of, when it was last maintained etc. The spatial information is not only shared as 2D geometries: (detailed) 3D information is also used in the building process. The area involved contains about 9.000 relevant physical objects (about 100 different object types) and about 2.000 spatial objects that relate to the traffic network, about which information is exchanged.

Additional information (added 21-5-2015): Reason for publishing data via a webserver is to make the (complex) data available for a broad public in a form that is easy to use.

Another publication method which is used in this context is through a COINS container. COINS is a Dutch BIM exchange standard. The container contains an OWL file and a folder with data files. It is accessed through an API. There is also a need for validation of COINS containers.

Landsat data services (Best Practice, Time, Coverage)

Contributed by: Kerry Taylor (on behalf of Aaron Sedgmen of Geoscience Australia)

Geoscience Australia (GA) maintains an archive of Landsat 5, 7 and 8 satellite imagery over the Australian continent from 1986 to present. The Australian Reflectance Grid 25 (ARG25) dataset produced from the Landsat archive is a collection of approximately 184,000 individual Landsat 5 and Landsat 7 scenes processed to the ARG25 specification. The ARG25 data are available to the public as file downloads and OGC web services. The ARG25 collection can be searched using an OGC Catalogue Service (CSW) containing ISO 19115 metadata for each scene. Note that the ARG25 data services are expected to be superseded by the Australian Geoscience Data Cube when it becomes publically available.

The ARG25 data services were promoted for use at the 2013 and 2014 Australian GovHack events, a competition aimed at mainstream (i.e. largely non geoscience/geospatial specialist) web and application developers, to mashup, reuse, and remix open government data. The predominant use case for the ARG25 data at GovHack has been to perform spatiotemporal searches on the catalogue for an area of interest, retrieve and subset/stitch scenes from the web services, and provide an animated time sequence of the imagery to allow users to visualise changes in land cover over time, e.g. “show me how my town has grown over the last 10 years”.

The relative complexity and richness of the OGC/ISO web service APIs and data exchange formats presented a barrier to developers who were accustomed to lighter weight APIs and formats optimised for rapid integration and mashing up of data in mobile and browser based applications. As a result, uptake of the ARG25 data at GovHack was less than hoped for, and we see this as indicative of the mainstream web app development community in the real world.

GA has had much success with OGC and ISO standards in the sharing of data with government, research and industry partners and clients who are power users of spatial data and savvy in the standards. The less traditional users who are not spatial data specialists are less likely to access GA’s data delivered using OGC and ISO standards, and this is a section of the user community that can potentially apply the data to highly innovative and entrepreneurial uses.

GA does use proprietary and quasi-standard light weight data exchange formats (e.g. JSON) and web APIs (e.g. ESRI RESTful API) for delivering some geospatial data, although, in accordance with government policy, it is GA’s preference to adopt standards when possible to maximise interoperability.

Metadata and Search Granularity (Best Practice, Time)

Contributed by: Kerry Taylor (on behalf of Aaron Sedgmen of Geoscience Australia)

Geoscience Australia (GA) collects and curates Australian national geoscience and geographic data sets, for use by government, industry and the community. Following is a typical requirement of a user of GA data - “A mineral exploration company is collating published geological data for their mining lease. They are particularly interested in sample locations where gold ppm values are above 0.1ppm, occurring in greenstone, located on or near a fault line, and aged around 2.6 Ga”.

Users are able to perform structured searches for GA datasets at the collection level using catalogues of ISO 19115 metadata. The collection level metadata provides users with download links to the packaged datasets, and in limited instances, links for accessing the data via web services and/or applications that provide visualisation and GIS analysis capability.

To perform fine grained searches within the dataset, such as feature level searches (e.g. show me sample locations in the OZCHEM database with gold ppm > 0.1), users must download the packaged datasets to their local environment and use their own tools to search through the data. Web services providing data access, e.g. WFS, and web applications with GIS capability served by GA, e.g. the Rock Properties Explorer app, can provide some capability for searching within data collections.

Usability of search and discovery systems would be enhanced by having standards that define the line between spatial data and metadata in the context of searches, and standard methodologies for searching across collection level and feature level data.

Crowd sourced earthquake observation information (Best Practice,SSN)

Contributed by: Kerry Taylor (on behalf of Aaron Sedgmen of Geoscience Australia)

Geoscience Australia (GA) collects earthquake observation information from the general public to improve its knowledge base of the impact of earthquakes across the Australian continent. An online HTML form is available on the GA website for members of the public to report their experiences of earthquake events. Information collected includes the person’s location (both geographic and within a building), time of event, perception of intensity and observed effects on the built environment. The information provided by the public is rated against the Modified Mercalli Intensity (MMI) Scale and is used to improve the accuracy of shake maps for earthquake prone regions of the country. This feeds into GA’s understanding of exposure of the Australian built environment to natural disaster, and is used for disaster mitigation purposes including the determination of minimum building codes for various regions of the country.

There is potential for GA to improve the efficiency by which it obtains earthquake observation information from the general public by leveraging popular social media services (such as Twitter), and adopting common standards and best practices for collecting crowd sourced information.

TCGA / Microscopy Imaging (Best Practices, Coverage in Linked Data?)

Contributed by Erich Bremer

Studying the morphology of disease at the cellular and sub-cellular levels using high resolution tissue images is extremely important to help understand the nature of various cancers. The Cancer Genome Atlas (TCGA) contains over 32,000 de-identified whole-slide microscopy images (WSI) of over two dozen cancer types. These images can contain between 100K-1M nuclei each. Biomedical informatics researcher have developed (and continue to develop) software to automatically segment nuclei for study. The spatial features of each nucleus and groups of nuclei as it relates to other nuclei combined with other linked data such as other morphological features (crypts, ducts, etc.) and/or patient lab results are used in analyzing and categorizing tissues and patients into groups and in comparing such groupings to understand disease mechanisms in a particular cancer type as well as across cancer types.

Representing nuclear segmentations is often done with binary masks or through polygon representations (e.g., the use of Well Known Text (WKT) representations) and also by leveraging work from the Geospatial community. However, in the case of nuclear segmentations, coordinate systems are 2D & 3D Cartesian based. Although the majority of work is this area is 2D-based, a growing segment of microscopy is also 3D-based as the technology develops and become more sophisticated. As living tissue can change over time through growth, infection, cancer, damage, etc, (as well as its associated organism’s various properties) it is important that spatial locations of features such as nuclear segmentation be also represented in a temporal aspect for proper comparisons.

Samples of TCGA WSI data can be viewed at: http://cancer.digitalslidearchive.net

Crop Yield Estimation using multiple satellites( Best Practice, Coverage, SSN)

Contributed by Kerry Taylor with Zheng-Shu Zhou, CSIRO

Space-borne Synthetic Aperture Radar (SAR) observations are coming on line rapidly over the next few years. SAR signals are represented in 2D space but can be processed to point observations in 3D space, or to 3D triangulated surfaces using polarimetric and phase information. A compelling use case for SAR data is crop classification, i.e., identification of cereal crops (wheat, barley, rice etc.), through analysis of the radar backscatters and polarisations over the variable-height surface and volume of the crop.

Multispectral (e.g. Landsat or MODIS) satellite imagery has been widely used to estimate vegetation cover and growth rates. It seems that combining SAR derived crop-type observations with Landsat-derived vegetation estimations could be used to estimate crop yields throughout the growth cycle. In principle, access to such data is open, but in practice it is difficult to get hold of and difficult to process for anyone other than well-connected scientists in developed nations. How could this data be opened up to a bigger community to help solve this problem, perhaps aided by reference to local knowledge?

We might expect that this will be used to assist in logistics and market planning in developed countries, and for food security in developing and war-torn nations.

Geospatial extensions to domain-independent metadata schemas (Best Practice)

Contributed by: Andrea Perego (European Commission - Joint Research Centre)

DCAT-AP (DCAT application profile for data portals in Europe) is a metadata interchange format, based on and compliant with the W3C Data Catalog vocabulary (DCAT), defining a minimum set of metadata elements to ensure cross-domain and cross-border interoperability across European data portals.

Work is under-way for a development of an extension aiming at defining a DCAT-AP compliant representation of geospatial metadata, referred to as GeoDCAT-AP.

GeoDCAT-AP will build on preliminary work concerning the alignment of INSPIRE metadata with DCAT-AP (referred to as INSPIRE+DCAT-AP). The objective is to consolidate this work, and to extend it in order to cover the set of metadata elements corresponding to the union of the INSPIRE metadata schema and the core profile of ISO 19115.

Methodologically, GeoDCAT-AP will be designed based on the following requirements:

  1. agree on mappings with metadata elements available in DCAT-AP (e.g., title, abstract, licence, distributions)
  2. define alignment with elements not available in DCAT-AP, by using, whenever possible, popular RDF vocabularies

The requirement for point (2) is to identify an RDF representation of elements missing in DCAT-AP that can be re-used, if relevant, in other domains. E.g., elements concerning data quality (e.g., conformity, topological consistency) and granularity (e.g., spatial / temporal resolution), two notions not supported in DCAT-AP (nor in DCAT). This implies that, in many cases, there may be the need of relaxing the ISO 19115 specification whenever it may be a barrier to re-use.

Another key design principle is that GeoDCAT-AP is not meant to be a replacement of ISO 19115 / 19139, but an alternative representation, built on a set of harmonised mappings. For this reason, the principle is that any ISO 19115-conformant metadata record could be transformed into a GeoDCAT-AP one, but the opposite is not a requirement.

Issues to be addressed include the following:

  • Recommendations on the use of HTTP URIs for geospatial data and metadata
  • Recommendations on the representation of geometries, and for the specification of bounding boxes, centroids, etc.
  • Recommendations for the specification of spatial and temporal reference systems
  • Recommendations for the specification of spatial and temporal resolution

Related use cases:

Improving discovery of spatial data on the Web (Best Practice)

Contributed by: Andrea Perego (European Commission - Joint Research Centre)

Use case based on work presented at INSPIRE 2014 by Adam Iwaniak (Wroclaw University of Environmental and Life Sciences, Poland)

Geoportals offer effective discovery functionalities for specialists. However, as in most data portals, using basic free text search is usually far from being a satisfactory experience. Actually, users (both non-experts and specialists), when searching for data, are frequently making use of popular search engines as a first step to get to the data they are looking for.

Improving free text search in (geo)data portals is unlikely to address this issue. Moreover, it would not help users who do not know in which portal(s) the relevant data are available. Users will keep on using in any case search engines for this purpose.

An option would be optimising geoportals for Web discovery, by implementing consistently SEO (Search Engine Optimisation) techniques. The advantages include (but are not limited to) the following:

  • Increase visibility of spatial data - as well as of the geoportals giving access to them.
  • Enabling queries not limited to free free text fields (e.g., dataset title and description), but concerning also coordinates, spatial / temporal resolution, etc.
  • Enabling users to find the data better satisfying their requirements (in terms of spatial and temporal coverage, granularity, formats, access and licensing conditions, etc.)

The SDW WG BPs may contribute to this by recommending best practices for publishing geospatial metadata on the Web. For example, by proposing standard serialisations of geospatial metadata in formats and vocabularies used by search engines to index Web resources - e.g., RDFa, Microdata, Microformats.

Related use cases:

INSPIRE compliance using web standards (Best Practice)

Contributed by: Erwin Folmer, Dutch Cadastre (via public-sdw-comments@w3.org)

The European INSPIRE directive leads to the availability of many datasets with geographical aspects. Unfortunately the burden for data providers to comply with INSPIRE is high, which leads to the potential danger that the means (INSPIRE) becomes more important than the end (to have interoperable data). For many data providers the sole purpose is to state that they are INSPIRE compliant. This limited but understandable approach of data providers results in potential users being overlooked. Implementations of more user-friendly web-related solutions will be very difficult and limited in the next few years, unless we find a (documented, proven and accepted) way to comply with INSPIRE by using web standards (Linked Data).

The Dutch Cadastre is a major provider of INSPIRE data in the Netherlands. It also maintains the portal PDOK, a central facility for making INSPIRE-compliant geographical data available in the Netherlands.

Event-like geographic features (Best Practice, Time)

Contributed by Karl Grossner, Stanford Libraries

Events are geographic phenomena. They comprise activity associated with particular locations on the earth surface, and their participants' locations and attributes over time are integral to their analysis as well as their indexing in information systems. Event participants may be human and agentive or not--including for example objects present at or resulting from activity, or natural phenomena like hurricanes or earthquakes.

In addition to class or type, and the nature of their participants, essential descriptors for events include their static or dynamic location(s) and temporal extents, described with spatial and temporal reference systems. Location may be static or dynamic. Static events routinely modeled include crime, mortality, battles, performances, etc. Temporal extents may be modeled as instants or intervals, in cases aggregated as "multi-instants" or "multi-intervals."

Although it is inherently difficult to model dynamic phenomena, there are many compelling reasons to do so. They can be conceived variously, as processes modeled as sequences of discrete events or as functions. Examples include: trajectories of people in commercial activity, journeys, battles, and biographical "life-paths."

From a spatial perspective, many places are essentially dynamic and modeling these is a core challenge in historical and cultural heritage applications. The size and shape of political entities changes over time; they grow, shrink, split, merge, disappear, reappear, etc. The point being their spatial extent is directly bound to time. Historical periods are considered as 'place-at-period' - for example there is not a simple "Bronze Age" period, rather "Bronze Age Britain" and "Bronze Age Southern Levant."

Taken together these share a requirement to consider space and time together.

There is ongoing work in several research communities to arrive at better general models for representing and computing over such spatial-temporal and dynamic phenomena. One approach aims at 4-dimensional model of space-time (e.g. CIDOC-CRM E92-Spacetime Volume). Another seeks to add a "when" component to the "where" (geometry) of GeoJSON and GeoJSON-LD.

[1] http://www.cidoc-crm.org/docs/cidoc_crm_version_6.0.pdf

[2] https://github.com/geojson/geojson-ld/issues?q=is%3Aissue+is%3Aclosed

Creation of “virtual observations” from “analysis” phase of weather prediction model (primarily SSN; also Best Practice & Time )

Contributed by Jeremy Tandy, Met Office

National Meteorological Services (NMS), such as Met Office, maintain a network of weather observation sites within their region of responsibility in order, amongst other things, to provide input to their numerical weather prediction models. The cost of maintaining these weather observation sites means that their number is limited.

Within the UK, and likely in other places too, there is a high demand for weather observations for specific locations. To meet this demand, the Met Office provides data for many more locations than the number of weather observation sites they maintain. In order to do this, “virtual observations” for these locations are derived from the “analysis” of the numerical weather prediction model. (“Analysis” is the term used to describe the initial state of the numerically modelled atmosphere from which the forecast is calculated; it incorporates real observations and provides a dynamically balanced representation of the atmosphere at a snapshot in time.)

The metadata needed to provide context to a “virtual observation" is identical to that for normal observations; albeit that the procedure used to create the observation involves a computational simulation rather than a physical sensor and stimulus. Clearly, it is important to provide information about the procedure used to create the observation so that “real” observations can be distinguished from “virtual” observations.

The Observations and Measurements (O&M, ISO 19156) is sufficiently flexible enough to accommodate use of a computational simulation for the observation procedure. However, the Semantic Sensor Network model is (appears to be?) rooted in the “sensor-stimulus-observation” model and, as such, does not seem to be applicable to cases such as “virtual observations”.


Incorporating geospatial data (e.g. geo-referenced geometry) into interactive 3D graphics on the web (Best Practice)

Contributed by Stefan Lemme, DFKI/Saarland University

This usecase relates to UC-9 and maintains the bridge 3D-web applications (without targeting the actual rendering process, which is out-of-scope).

Visualizing geospatial data, such as geo-referenced 3D geometry of building, is a crucial capability even for web applications. This usecase targets web developers, that are using 3D graphics in their (existing) web applications. To ease the pick up of 3D graphics for web developers, since they are usually non-graphics experts, the "Declarative 3D for the Web Architecture Community Group" of W3C [1] did previous work to determine the requirements, options, and use cases for an integration of interactive 3D graphics capabilities into the W3C technology stack. Thereby, they propose a declarative approach to describe the 3D scene content as an extension of HTML5 rather than interfacing low-level APIs for rendering. Several implementations, such as X3D, X3DOM, and XML3D [2], address this approach. However, web developers are usually non-geospatial experts either. Thus, to achieve a similar low-entrance barrier for them to incorporate geospatial data into interactive 3D graphics on the web, any (web)service providing geospatial data (including geometry) might consider a compatible content delivery format and API. Firstly, this implies none to only very little processing overhead on the client. In particular, when having mobile web applications in mind an efficient content delivery (bandwidth-wise as well as client-side-processing-wise) is becoming important. Secondly, web developers utilize established libraries, such as jQuery, to interface remote (RESTful) APIs. To ease interfacing geospatial services, web developers tend to reuse their tools. Finally, existing best practices of the web should be taken into account and applied to the access of geospatial data according, such as paging of result sets, caching of resources at several stages (server, browser), etc.

  1. Declarative 3D for the Web Architecture Community Group - https://www.w3.org/community/declarative3d/
  2. XML3D - http://xml3d.org/ (sample 3D client based on WCS/WCPS: http://earthlook.org/demo/elevation/elevation-client-bgs.html)
  3. Examples using XML3D and OSM data - http://130.206.80.175/poi-client/single-tile-brussels.html
  4. Examples using XML3D and OSM data - http://130.206.80.175/poi-client/buildings-tum-static.html

Provenance of climate data (Best Practice, Time-series, Observations, Coverages, Data Provenance, DOI, Metadata)

Contributed by Bruce Bannerman, Australian Bureau of Meteorology

Added 21/5/2015

This use case is inspired by one of the conclusions of the UK Parliamentary inquiry into ClimateGate "...It is not standard practice in climate science to publish the raw data and the computer code in academic papers. However, climate science is a matter of great importance and the quality of the science should be irreproachable. We therefore consider that climate scientists should take steps to make available all the data that support their work (including raw data) and full methodological workings (including the computer codes...)." When a Climate Scientist publishes a paper, he needs to be able to refer reviewers to the source data and software source code that underpins the assertions made within the paper. Climate data is typically time-series and can be quite complex. Data can be sourced from a single National Meteorological and Hydrological Service (NMHS), or from a number of NMHS. Software source code is typically stored within a software revision control repository, such as git.

Climate data may comprise all of the following:

1. A time-series of observations of a specific phenomena at a single sensor, including:

  • estimations of the value of an observed property
  • a detailed understanding of the conditions under which the observation was made
  • any changes that have been made to the observation (e.g. due to Quality Assurance processes etc)

2. A collection of the time-series observations described at 1, of the same phenomena, at the same time steps, perhaps in the form of a discrete coverage (time-series).

3. A time-series representing the distribution of values of the collection of time-series observations represented as perhaps a

  • continuous two dimensional coverage, or
  • continuous coverages as three dimensional cubes, or
  • continuous coverage as n-dimensional models
  • an ensemble, comprising a number of models
  • where these time-series coverages /cubes / models represent the outputs of some analytical process.

So using the description of climate data above, when a paper is published, the scientist needs to be able to refer viewers to:

  • the analytical data that underpins the paper (perhaps the n-dimensional continuous coverage time-series at #3).
  • the quality assured observations data that the continuous coverages at #3 were derived from at #2 and #1 (with details as to why each change to the Quality Assured observations described at #1 were made).
  • the ‘raw’ observations data described at #1, with details as to the conditions, sensors etc that the observation was made under.
  • the version of the software source code that was used to manipulate the data at #1, #2, and #3.
  • This is not a trivial data management problem to address, however its resolution will provide a solid data management grounding for future climate science and help address much spurious debate.

Parts of the puzzle are currently being worked on, e.g.:

  • The World Meteorological Organisation (WMO) have published WMO No. 1131, Climate Data Management Systems Specifications that provide a high level conceptual architecture to address much of the data management issues described above. See: http://library.wmo.int/opac/index.php?lvl=notice_display&id=16300#.VV260-ePJVx
  • WMO and OGC have developed and are developing relevant logical data models ISO 19156 Observations and Measurements, OGC Timeseries, and WMO METCE. The last two are based on Observations and Measurements.
  • WMO have released a standard for describing Observations Metadata, called WIGOS Metadata.
  • WMO are about to start work on a logical data model based on Observations and Measurements and Timeseries for describing WMO Observations. A future iteration of this model will need to cater for data provenance.
  • W3C have developed PROV-O, which has considerable potential for describing data provenance.

The missing part is:

How can the provenance of the collection of climate data and the software used to manipulate it be best modeled and in the future, found via the Internet?

The resolution of this issue will be of relevance to many domains.