BenchmarkCouncil

From W3C Wiki

LOD2 BENCHMARK COUNCIL

1. Introduction

In order to foster progress in RDF database query performance and functionality, the LOD2 consortium – a EU FP7 project dedicated to supporting Linked Open Data (LOD) technology -- is undertaking efforts in benchmark development and support.

In corresponding to that purpose, LOD2 Benchmark council is founded aiming at defining benchmark rules for RDF/SPARQL, providing auditing services, coorporating with vendors in developing benchmarks and getting offical approval stamp from LOD2 for benchmark results.


2. RDF Benchmarks

These following RDF/SPARQL benchmarks are being considered in LOD2.


Berlin SPARQL Benchmark (BSBM)

A benchmark suite which is developed by people at Freie Universität Berlin, Germany building around an e-commerce use case.

   http://www4.wiwiss.fu-berlin.de/bizer/BerlinSPARQLBenchmark/


RDF-H

A RDF version of TPC-H which is developed by people at Openlink


Social Intelligence Benchmark (SIB)

A benchmark suite developed by people at CWI and Openlink taking the schema from Social Networks for generating test areas where RDF/SPARQL can truly excel, and challenging query processing over highly connected graph.

   http://www.w3.org/wiki/Social_Network_Intelligence_BenchMark


3. Members

- CWI

- Openlink

All the vendors are welcome to join and co-operate for developing RDF/SPARQL benchmarks as well as suggesting modifications of benchmark auditing rules.