<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Marco's accessibility blog &#187; Testing</title>
	<atom:link href="http://www.marcozehe.de/tag/testing/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.marcozehe.de</link>
	<description>Musings, tips and tricks about the accessible software world</description>
	<lastBuildDate>Tue, 22 Jun 2010 07:26:33 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0</generator>
		<item>
		<title>Starting an Accessible Name refactor, need your help in testing!</title>
		<link>http://www.marcozehe.de/2008/10/11/starting-an-accessible-name-refactor-need-your-help-in-testing/</link>
		<comments>http://www.marcozehe.de/2008/10/11/starting-an-accessible-name-refactor-need-your-help-in-testing/#comments</comments>
		<pubDate>Sat, 11 Oct 2008 07:49:39 +0000</pubDate>
		<dc:creator>Marco</dc:creator>
				<category><![CDATA[Accessibility]]></category>
		<category><![CDATA[Firefox]]></category>
		<category><![CDATA[QA]]></category>
		<category><![CDATA[Testing]]></category>

		<guid isPermaLink="false">http://www.marcozehe.de/?p=84</guid>
		<description><![CDATA[For those of you following the Firefox/Gecko platform development, or for those interested in helping out, this is a call for participation. If you&#8217;re not afraid to get your hands dirty a bit and would like to help the Firefox accessibility team, now would be a good time to get involved! The problem: The code [...]]]></description>
			<content:encoded><![CDATA[<p>For those of you following the Firefox/Gecko platform development, or for those interested in helping out, this is a call for participation. If you&#8217;re not afraid to get your hands dirty a bit and would like to help the Firefox accessibility team, now would be a good time to get involved!</p>
<p>The problem: The code that calculates the names for any created accessibles has been growing over time and became largely unmaintainable. New features suich as adding the aria-label property support requires code duplication for HTML and XUL, and in general the code has many stylish un-niceties.</p>
<p>So, our team has started a code cleanup and code refactoring series to get the code into better shape and maintainability.</p>
<p>As with any refactor, the result <strong>should</strong> be identical in output with what we started out from. However, as those of you familiar with software development know, the risk of regressions is there and should not be discounted.</p>
<p>While we do have test cases for many of these instances already, there may still be cases we&#8217;ve missed. So any help we get from the community will help make sure that the refactor goes smoothly, but also help fill in any possible gaps in our testcases.</p>
<p>So, how can you help? By downloading and installing the <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/">latest nightly builds of Firefox 3.1</a> for <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/firefox-3.1b2pre.en-US.win32.installer.exe">Windows</a> or <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/latest-mozilla-central/firefox-3.1b2pre.en-US.linux-i686.tar.bz2">Linux</a>, and testing the heck out of them. Use your favorite screen reader, use your familiar web sites, use it for day-to-day surfing. Obviously the most likely pages you&#8217;ll find differences on, if any, will be those pages you visit frequently, sites you know what the output should be.</p>
<p>If you find something that is different from what you know, you can download the <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2008-10-10-03-mozilla-central/">last Windows</a> or <a href="ftp://ftp.mozilla.org/pub/mozilla.org/firefox/nightly/2008-10-09-02-mozilla-central/">last Linux</a> build before the refactor, unzip it into a separate folder, and compare your findings using that build.</p>
<p>If you find differences you did not expect to find, you have two main choices that will get the developer team&#8217;s attention:</p>
<ol>
<li><a href="https://bugzilla.mozilla.org/enter_bug.cgi?alias=&#038;assigned_to=nobody%40mozilla.org&#038;blocked=&#038;bug_file_loc=http%3A%2F%2F&#038;bug_severity=normal&#038;bug_status=NEW&#038;comment=&#038;component=Disability%20Access%20APIs&#038;contenttypeentry=&#038;contenttypemethod=autodetect&#038;contenttypeselection=text%2Fplain&#038;data=&#038;dependson=&#038;description=&#038;flag_type-203=X&#038;flag_type-270=X&#038;flag_type-271=X&#038;flag_type-325=X&#038;flag_type-369=X&#038;flag_type-37=X&#038;flag_type-370=X&#038;flag_type-385=X&#038;flag_type-4=X&#038;flag_type-416=X&#038;flag_type-417=X&#038;flag_type-447=X&#038;flag_type-449=X&#038;flag_type-450=X&#038;flag_type-451=X&#038;flag_type-5=X&#038;form_name=enter_bug&#038;keywords=&#038;maketemplate=Remember%20values%20as%20bookmarkable%20template&#038;op_sys=Windows%20XP&#038;priority=--&#038;product=Core&#038;qa_contact=accessibility-apis%40core.bugs&#038;rep_platform=PC&#038;short_desc=&#038;target_milestone=---&#038;version=Trunk">File a bug in Bugzilla</a>:
<ul>
<li>Component: Disability Access APIs</li>
<li>Version: Trunk</li>
<li>Platform: PC or whichever you use</li>
<li>OS: Windows or Linux, depending on where you found the bug.</li>
</ul>
</li>
<li>Post a message on the <a href="news://news.mozilla.org/mozilla.dev.accessibility">mozilla.dev.accessibility newsgroup</a> (<a href="http://groups.google.com/group/mozilla.dev.accessibility/topics?start=">Google Groups mirror</a>).</li>
</ol>
<p>In any case, your bug report should contain the URL of the page you are experiencing the difference with, the expected output of the element, and the output you&#8217;re now getting. Also, is that element a graphic, link, heading, form field etc.? Also, you should mention what screen reader you&#8217;re using. If posting to the newsgroups, it will also help to mention the operating system.</p>
<p>How to update the nightly builds to pick up latest code changes: The builtin Check for Updates feature, if invoked from a nightly build, will always grab an update to the latest nightly build and install it for you. So, you only need to download and go through the installation process once. You can then daily check for updates and get the latest code that way.</p>
<p>The first build to see changes will be the October 11 build, build ID 1.9b2pre/20081011.</p>
<p>Working with different profiles: If you don&#8217;t want to put your regular profile into the hands of the Firefox nightly builds, you can start Firefox.exe or the ./firefox executable with the -p option to bring up Profile Manager. You can then create a new profile and start Firefox with that profile. That way, your Firefox 3.0.x profile won&#8217;t be touched by the 3.1 nightlies if you choose not to. I&#8217;ve found, however, that the nightlies are very stable already, and I often flip back and forth between 3.0.x and 3.1 builds on the same profile without problems. The one thing that most certainly would happen is that some extensions may not work in 3.1 yet.</p>
<p>I&#8217;d like to thank all of you in advance who decide to participate in this effort and help everyone who relies on Firefox accessibility by testing out the code refactor. You can make a real difference because we obviously can&#8217;t test all of the web pages out there, and yours may just be the one we might miss out on.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.marcozehe.de/2008/10/11/starting-an-accessible-name-refactor-need-your-help-in-testing/feed/</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
		<item>
		<title>Progress on automated testing for the accessibility module</title>
		<link>http://www.marcozehe.de/2008/08/05/progress-on-automated-testing-for-the-accessibility-module/</link>
		<comments>http://www.marcozehe.de/2008/08/05/progress-on-automated-testing-for-the-accessibility-module/#comments</comments>
		<pubDate>Tue, 05 Aug 2008 20:31:52 +0000</pubDate>
		<dc:creator>Marco</dc:creator>
				<category><![CDATA[Accessibility]]></category>
		<category><![CDATA[Mozilla]]></category>
		<category><![CDATA[QA]]></category>
		<category><![CDATA[Testing]]></category>

		<guid isPermaLink="false">http://www.marcozehe.de/?p=55</guid>
		<description><![CDATA[Today, I checked in two changes that allow the unit tests we&#8217;ve developed for the accessibility module so far, to run on what we call a staging server. A staging server is a server that simulates production conditions, but isn&#8217;t the live thing just yet. It allows us to test new features in build, testing, [...]]]></description>
			<content:encoded><![CDATA[<p>Today, I checked in two changes that allow the unit tests we&#8217;ve developed for the accessibility module so far, to run on what we call a staging server. A staging server is a server that simulates production conditions, but isn&#8217;t the live thing just yet. It allows us to test new features in build, testing, web sites etc., in close-to-real-life conditions before finally pushing them to production.</p>
<p>Obviously, getting these tests running on the production tinderboxes so we immediately see when we broke something is the next step. But until that can be done, we need to find a solution for <a href="https://bugzilla.mozilla.org/show_bug.cgi?id=441974">bug 441974</a>. Basically what is happening is that tests pass when each test file is run stand-alone, but some of these tests fail randomly when running all files in one big batch. But I made some good connections at the Mozilla summit last week, and as soon as we get these passing we&#8217;ll start running those tests. They&#8217;ll then run along with the many other unit tests we have for Firefox and the Mozilla platform.</p>
<p>I&#8217;d like to thank our intern Lukas Blakk and a bunch of other members of the QA and build teams to help me with getting these configs for buildbot right!</p>
]]></content:encoded>
			<wfw:commentRss>http://www.marcozehe.de/2008/08/05/progress-on-automated-testing-for-the-accessibility-module/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Accessibility testcases up in Litmus! Go and check them out!</title>
		<link>http://www.marcozehe.de/2008/05/30/accessibility-testcases-up-in-litmus-go-and-check-them-out/</link>
		<comments>http://www.marcozehe.de/2008/05/30/accessibility-testcases-up-in-litmus-go-and-check-them-out/#comments</comments>
		<pubDate>Fri, 30 May 2008 08:55:56 +0000</pubDate>
		<dc:creator>Marco</dc:creator>
				<category><![CDATA[Accessibility]]></category>
		<category><![CDATA[Firefox]]></category>
		<category><![CDATA[Mozilla]]></category>
		<category><![CDATA[QA]]></category>
		<category><![CDATA[Testing]]></category>
		<category><![CDATA[Litmus]]></category>

		<guid isPermaLink="false">http://www.marcozehe.de/2008/05/30/accessibility-testcases-up-in-litmus-go-and-check-them-out/</guid>
		<description><![CDATA[Litmus is Mozilla&#8217;s community testing platform that allows anyone to test Firefox or other Mozilla products by running a set of testcases and giving us feedback about whether the test passed or failed. The Mozilla QA team uses these test runs to do basic functionality tests (run before every beta release), full functionality tests (run [...]]]></description>
			<content:encoded><![CDATA[<p><a href="https://litmus.mozilla.org">Litmus</a> is Mozilla&#8217;s community testing platform that allows anyone to test Firefox or other Mozilla products by running a set of testcases and giving us feedback about whether the test passed or failed. The Mozilla QA team uses these test runs to do basic functionality tests (run before every beta release), full functionality tests (run before releases or release candidates), or other set of tests to ensure that certain areas of the product behave as expected with a given set of steps.</p>
<p>For RC1 and the upcoming RC2, I&#8217;ve now created testcases for accessibility areas. These tests should be performed using Firefox on either Windows or Linux, and using a screen reader like NVDA, JAWS, or Window-Eyes on Windows, or Orca on Linux. To sighted people not using a screen reader, these expected results do usually not make much sense since they are especially tailored towards output generated by screen readers for the blind.</p>
<p>If you&#8217;re interested in helping out testing Firefox on the accessibility side, go get a Litmus account and run the <a href="https://litmus.mozilla.org/run_tests.cgi?test_run_id=27">Firefox 3.0 Accessibility test run</a>.</p>
<p>There are a lot of other test runs to perform if you&#8217;re interested. You may have to find keyboard equivalents for certain mouse-driven actions, but that should be no problem if you know your Firefox!</p>
<p>Look forward to your results!</p>
]]></content:encoded>
			<wfw:commentRss>http://www.marcozehe.de/2008/05/30/accessibility-testcases-up-in-litmus-go-and-check-them-out/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>
