Skip to toolbar

Community & Business Groups

ORE 2015: Competition

Home | Call for Papers | Competition | Programme | Organization | Attending

Call for Systems

We invite reasoner developers to submit their systems for participation in the 2015 OWL reasoner competition. The outline for the competition is as follows:

  • The test sets will include OWL ontologies from all OWL 2 profiles and of varying sizes, from a large corpus of ontologies (including ontologies from the NCBO BioPortal, a web crawl, and user-submitted ontologies).
  • The tested tasks will include consistency checking, classification, and realisation.
  • Developers will have to submit an executable wrapper script that triggers the reasoning system, and the system itself to the competition organizers, who will then carry out the benchmarks.

Framework: https://github.com/andreas-steigmiller/ore-2014-competition-framework/
Dataset: http://zenodo.org/record/10791
Instructions: https://bitbucket.org/andreas-steigmiller/ore-2014-testing-framework

Information about last year’s competition can be found on the ORE 2014 website: http://www.easychair.org/smart-program/VSL2014/ORE-competition.html

In addition to the system submissions, reasoner developers are invited to submit a short paper describing their system. See Call for Papers for details.

Please, submit your system to ore2015 [at] easychair [dot] org by May 1, 2015.

Call for Ontologies

We invite ontology developers to submit ontologies which they believe pose a challenge performance-wise for current OWL reasoners to handle. These ontologies will be included in our ontology corpus, and additionally will have a separate analysis in the competition proceedings.

In addition to the ontology submissions, ontology developers are invited to submit a short paper describing their ontology. See Call for Papers for details.

Please, submit your ontology to ore2015 [at] easychair [dot] org by May 1, 2015.

One Response to ORE 2015: Competition

  • Dear Organizers,

    We would like to present a new ontology that, due to its complexity and large size (25,809 classes and 73 object properties) cannot be processes by the most popular OWL reasoners (Fact++, HermiT, or Pellet).

    Moreover, we have created a set of SWRL rules that, in combination with the ontology, can be used to infer new information. However, we could not use them with the whole version of the ontology, and we had to performed different experiments with reduced versions. Results were successful, proving that the ontology is consistent and that the rules can be used to infer new knowledge. However, the main bottleneck has been the performance of the ontology reasoners used.

    We believe that the ontology can be a great resource to test and improve new or current reasoner engines. Therefore, we are interested on submitting it for the next ORE 2015 Competition.
    We would very grateful if you could give us detailed instructions about how to do this.

    Thank you very much,

    Maria Herrero
    Univesidad Carlos III de Madrid (Spain)

    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

Before you comment here, note that this forum is moderated and your IP address is sent to Akismet, the plugin we use to mitigate spam comments.

*