MathML 3 Implementation Testing Results Summary

Last updated: 16 Jul 2010

Table of Contents

Introduction

This document summarizes the results of MathML 3 implementation testing. Implementors used an automated system to compare the output of their software against reference images in the MathML Test Suite. Results were then submitted and tabulated.

Systems Tested

MathPlayer

Software Maker: Design Science Inc.

Testing Organization: Design Science

Software Details: MathPlayer development version + IE8

Name of tester: Neil Soiffer

Results last updated: Mon Jun 28 22:42:01 CEST 2010

Goals: Test MathPlayer 3's implementation of MathML 3

WirisOM

Software Maker: Maths 4 More Inc.

Testing Organization: DFKI GmbH

Name of tester: Paul Libbrecht

Results last updated: Sun Jun 27 10:57:38 CEST 2010

MathEX

Software Maker: Integre Technical Publishing Co., Inc.

Testing Organization: Integre

Software Details: MathEX ActionScript

Name of tester: Sam Dooley

Results last updated: Tue Mar 16 22:10:40 CET 2010

MathFlow

Software Maker: Design Science Inc.

Testing Organization: Design Science Inc

Software Details: MathFlow 2.0 development version

Name of tester: Gang Du

Results last updated: Tue May 11 23:37:04 CEST 2010

Goals: Test new MathML3 linebreaking

ctop

Software Maker: David Carlisle

Testing Organization: NAG (personal project)

Software Details: ctop xsl stylesheet running via greasemonkey in Firefox 3.6.6

Name of tester: David Carlisle

Results last updated: 2010/07/12

pmml2tex

Software Maker: David Carlisle

Testing Organization: NAG (personal project)

Software Details: pmml2tex xsl stylesheet producing TeX rendered by pdftex.

Name of tester: David Carlisle

Results last updated: 2010/07/26

RichEdit

Software Maker: MicroSoft Inc.

Testing Organization: Microsoft

Software Details: development version

Name of tester: Mikhail Baranovsky

Results last updated: Sat Jun 05 03:48:13 CEST 2010

MathJax

Results last updated: Thu Mar 06 12:08:51 GMT+01:00 2014

Name of tester: Peter Krautzberger

Testing Organization: MathJax Consortium

Goals: Evaluate MathJax v2.3

Comments: Tested on Chrome 32 / Linux (with a userscript injecting MathJax) MathJax version: v2.3 MathJax configuration: MathJax.Hub.Config({jax: ['input/MathML','output/HTML-CSS'],extensions: ['mml2jax.js','MathEvents.js'],MathML: {extensions: ['content-mathml.js']}, SVG: {font: 'STIX-Web',mtextFontInherit: true, linebreaks: { automatic: true }},'HTML-CSS': {webFont: 'STIX-Web',linebreaks: { automatic: true }},MathMenu: {showRenderer: true},menuSettings: {zoom: 'Click'},MatchWebFonts: {matchFor: {SVG: true},fontCheckDelay: 500,fontCheckTimeout: 15 * 1000},messageStyle: 'none'}) (STIX webfonts, automatic linebreaks, ContenMathML extension)

Software Details: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/32.0.1700.107 Chrome/32.0.1700.107 Safari/537.36

Results last updated: Tue Mar 11 17:46:59 GMT+01:00 2014

Name of tester: Peter Krautzberger

Testing Organization: MathJax Consortium

Goals: Evaluate MathJax v2.3

Comments: Tested on Chrome 32 / Linux (with a userscript injecting MathJax) MathJax version: v2.3 MathJax configuration: MathJax.Hub.Config({jax: ['input/MathML','output/HTML-CSS'],extensions: ['mml2jax.js','MathEvents.js'],MathML: {extensions: ['content-mathml.js']}, SVG: {font: 'STIX-Web',mtextFontInherit: true, linebreaks: { automatic: true }},'HTML-CSS': {webFont: 'STIX-Web',linebreaks: { automatic: true }},MathMenu: {showRenderer: true},menuSettings: {zoom: 'Click'},MatchWebFonts: {matchFor: {SVG: true},fontCheckDelay: 500,fontCheckTimeout: 15 * 1000},messageStyle: 'none'}) (STIX webfonts, automatic linebreaks, ContenMathML extension)

Software Details: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/32.0.1700.107 Chrome/32.0.1700.107 Safari/537.36

Results last updated: Tue Mar 11 18:53:33 GMT+01:00 2014

Name of tester: Peter Krautzberger

Testing Organization: MathJax Consortium

Goals: Evaluate MathJax v2.3

Comments: Tested on Chrome 32 / Linux (with a userscript injecting MathJax) MathJax version: v2.3 MathJax configuration: MathJax.Hub.Config({jax: ['input/MathML','output/HTML-CSS'],extensions: ['mml2jax.js','MathEvents.js'],MathML: {extensions: ['content-mathml.js']}, SVG: {font: 'STIX-Web', linebreaks: { automatic: true }},'HTML-CSS': {webFont: 'STIX-Web',linebreaks: { automatic: true }},MathMenu: {showRenderer: true},menuSettings: {zoom: 'Click'},messageStyle: 'none'}) (STIX webfonts, automatic linebreaks, ContenMathML extension)

Software Details: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/32.0.1700.107 Chrome/32.0.1700.107 Safari/537.36

Results last updated: Wed Mar 12 09:55:47 GMT+01:00 2014

Name of tester: Peter Krautzberger

Testing Organization: MathJax Consortium

Goals: Evaluate MathJax v2.3

Comments: Tested on Chrome 32 / Linux (with a userscript injecting MathJax) MathJax version: v2.3 MathJax configuration: MathJax.Hub.Config({jax: ['input/MathML','output/HTML-CSS'],extensions: ['mml2jax.js','MathEvents.js'],MathML: {extensions: ['content-mathml.js']}, SVG: {font: 'STIX-Web',mtextFontInherit: true, linebreaks: { automatic: true }},'HTML-CSS': {webFont: 'STIX-Web',linebreaks: { automatic: true }},MathMenu: {showRenderer: true},menuSettings: {zoom: 'Click'},MatchWebFonts: {matchFor: {SVG: true},fontCheckDelay: 500,fontCheckTimeout: 15 * 1000},messageStyle: 'none'}) (STIX webfonts, automatic linebreaks, ContenMathML extension)

Software Details: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/32.0.1700.107 Chrome/32.0.1700.107 Safari/537.36

Results last updated: Tue Mar 18 12:57:30 GMT+01:00 2014

Name of tester: Peter Krautzberger

Testing Organization: MathJax Consortium

Goals: Evaluate MathJax v2.3

Comments: Tested on Chrome 32 / Linux (with a userscript injecting MathJax) MathJax version: v2.3 MathJax configuration: MathJax.Hub.Config({jax: ['input/MathML','output/HTML-CSS'],extensions: ['mml2jax.js','MathEvents.js'],MathML: {extensions: ['content-mathml.js']}, SVG: {font: 'STIX-Web',mtextFontInherit: true, linebreaks: { automatic: true }},'HTML-CSS': {webFont: 'STIX-Web',linebreaks: { automatic: true }},MathMenu: {showRenderer: true},menuSettings: {zoom: 'Click'},MatchWebFonts: {matchFor: {SVG: true},fontCheckDelay: 500,fontCheckTimeout: 15 * 1000},messageStyle: 'none'}) (STIX webfonts, automatic linebreaks, ContenMathML extension)

Software Details: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Ubuntu Chromium/32.0.1700.107 Chrome/32.0.1700.107 Safari/537.36

Safari5.1

Software Maker: Apple Inc.

Results last updated: Thu Jul 21 00:19:08 CEST 2011

Name of tester: Paul Libbrecht

Testing Organization: CERMAT and DFKI

Goals: Testing Safari 5.1's freshly announced MathML support.

Comments: Going to scriptsize inside mfrac seems to be the biggest miss. Much of menclose is unsupported also.

Software Details: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_6_8) AppleWebKit/534.50 (KHTML, like Gecko) Version/5.1 Safari/534.50

Key

Folder Entries. Each cell for a folder shows the percentage of tests passed for that implementation. In most browsers hovering over the cell will show the number of tests passed, the number failed or not tested and the total number of tests. The colour of the cell is red if the number failed or not tested is greater than half the total, it is grey if no tests have been attempted. The cell is yellow green if most tests have been passed, and mint green if all tests have been passed.

Test File Entries. The entries for individual tests show the reported result: p=passed, s=some-passed (parts of the test were passed), n=not-tested, b=broken (there is a problem with the test file), and f=failed. For the Combined results column on the right, a test is considered passed if two implementations pass, it is considered not-tested if no implementation has done this test, otherwise it is considered to be failed.

Results Summary

Test File MathPlayer WirisOM MathEX MathFlow ctop pmml2tex RichEdit MathJax Safari5.1 Combined
testsuite 97% 11% 43% 8% 79% 16% 3% 85% 1% 97%
   + Characters 100% 0% 93% 0% 98% 0% 0% 100% 0% 100%
   + General 100% 8% 80% 4% 72% 0% 0% 92% 0% 100%
   + Presentation 97% 0% 96% 0% 85% 49% 0% 99% 7% 100%
   + Topics 97% 0% 43% 37% 30% 20% 20% 55% 0% 95%
   + TortureTests 91% 0% 29% 12% 20% 0% 0% 87% 0% 100%
   + Content 99% 31% 0% 7% 95% 0% 0% 90% 0% 100%
   + StrictContent 96% 19% 0% 0% 94% 0% 0% 81% 0% 92%
   + ErrorHandling 100% 0% 52% 40% 16% 0% 0% 76% 0% 100%