MWI Team Blog

Dispatches from members of the W3C Mobile Web Initiative Team

Categories: Current state (32) | Developing Countries (15) | Events (20) | Looking forward (13) | News (42) | Technical (33) |

Web Compatibility Test for Mobile Browsers — 16 April 2008

(This post was also published as part of the W3C Q&A blog)

I co-chair the Mobile Web Test Suites Working Group: this group aims at improving the interoperability of browsers on mobile devices through the development and the diffusion of test suites for Web technologies that work on mobile devices.

I have already mentioned here some of the work we've been doing toward that goal, but I would like to focus today on our most recent (and rather exiciting) deliverable: the Web Compatibility Test for Mobile Browsers.

That test, in the same spirit as the ACID tests, combines in a single page tests for 12 Web technologies, ranging from well-deployed (but often poorly implemented on mobile devices) technologies such as HTTPS and PNG, to technologies we believe will matter in a year or two (like SVG animation and CSS Media Queries).

Tests are visualized by squares, sorted roughly in order of difficulty (first line, well-deployed technologies, second line, technologies increasingly used today, third line, technologies for tomorrow), and a browser needs to render each square in the same tone of green to pass completely the test - which as far as I know, no currently released browser (on mobile devices or elsewhere) does.

Enough words, everybody wants to see pictures, so here come a few screenshots of the test rendered in a variety of browsers:

Screenshot of the test in Blazer 4.3.2.1
Blazer 4.3.2.1

Screenshot of test in Opera Mini 4.1 beta 1
Opera Mini 4.1 beta 1

Screenshot of the test in Netfront on the PSP
PSP's Netfront

Screenshot of the test in Android webkit-based emulator
Android emulator webkit-based browser

Screenshot of the test in Firefox 3, beta 3
Firefox 3 beta 3

Screenshot of the test in IE6
Internet Explorer 6

Test design

So, what's the guiding idea behind this test?
To make it easy to spot at a glance how ready for the Web your browser is; given that we target in particular browsers installed on mobile devices, the test needs to be fairly quick to load, not too large in dimensions, and surveying a range of technologies that are relevant on mobile
How does it relate to the ACID tests?
The ACID tests were clearly an inspiration for this test, but there are some significant differences:
  • the test doesn't try to detect specific bugs in well-known browsers - a rather large tasks on mobile devices where the number of browsers remains much larger than on dekstop computers -, it simply helps visualize rough support for a given technology;
  • the test is mobile-friendly in its dimensions and weight, allowing it to give meaningful results on a wider range of devices.
This of course doesn't mean mobile browsers shouldn't try to pass the ACID tests (and some already do, as a matter of fact)! But hopefully our test also helps setting a goal for a wider set of browsers.
Couldn't you find a better name?
No, actually, we couldn't! We thought about calling it a "mobile ACID test", but since it is not an ACID test, we preferred something more descriptive of its real nature; but we're very interested in better suggestions!
Why is X in there? Why isn't Y in there?
While we have documented the reasons of our choices of technologies, we're very much open to suggestions for modifications, additions, and improvements (especially in the form of concrete markup to add in the test); so please send them in to our group list public-mwts@w3.org (publicly archived)!

Running the test

Running the test is as simple as pointing your browser to its address, namely http://dev.w3.org/2008/mobile-test/test.html.

Entering an address is a pain on a phone? Quite often, indeed, so a couple of alternatives to save you a bit of that pain:

  • if your phone has a camera and a QR code reader (which you can probably find out on your preferred search engine), you can point your camera's phone to the following code, and it will open the right page in your browser:
    QR code for Web compatibility test for mobile browsers
  • otherwise, here is a shorter equivalent URI for the test: http://tinyurl.com/37e33p

Contribute!

Want to help us with this? Here are a few ideas of how you can contribute to the impact of this test on interoperability:

  • run your test on your browser and send a screenshot to www-archive@w3.org (publicly archived) with the name and version of the said browser; we'll add submissions to our screenshot galleries; to get a screenshot of your phone in action, you can either use a screenshot application on your phone if it has one, and if it doesn't, you can simply take a picture of it with your camera :o)
  • Kai Hendry has started posting screenshots on Flickr, so if you're about to do the same, make sure to use the same wct tag;
  • send suggestions for additional tests, or improved tests, or more generally, feedback on the selection of tests to our group list, public-mwts@w3.org (publicly archived), or simply on as comments below;
  • simply talk about this test around you, in your blog, to your prefered browser vendor, etc.; the more visible this test goes, the more likely it is to have an impact on browser vendors!
by Dominique Hazael-Massieux in News, Technical 5 comments Permalink

Comments, Pingbacks:

Comment from: Jason [Visitor]
Congratulations, this is an excellent initiative!

I ran the test on a Nokia N95 (firmware v21) and got a fail on the XMLHTTPRequest test but I know the S60 browser supports this JavaScript object.

I will send the screenshot shortly.
PermalinkPermalink 2008-04-16 @ 13:00
Comment from: Kai Hendry [Visitor] · http://hendry.iki.fi/
@Jason: I noticed this myself and posted to the http://lists.w3.org/Archives/Public/public-mwts/2008Apr/0023.html mwts list about Nokia.
PermalinkPermalink 2008-04-16 @ 14:07
Comment from: Jason [Visitor]
Opera 8.5 on the Motorola V8 also supports the XHR object but fails the test.
PermalinkPermalink 2008-04-17 @ 14:55
Comment from: Rehan [Visitor]
Hi
I use internet regularly on my Nokia N95 but I cannot seem to run the flash objects correctly on web pages. Is there any software for rich experience like my IE or Firefox.

PermalinkPermalink 2008-04-25 @ 17:24
Comment from: Privatni smestaj [Visitor]
I will try this test
PermalinkPermalink 2008-06-03 @ 23:45

Contacts: Dominique Hazael-Massieux