Pros and Cons of 6 Top Web Accessibility Testing Tools
While the need for web accessibility was not envisioned when the Americans with Disabilities Act was signed into law more than 30 years ago, ADA web accessibility has emerged as a fundamental necessity, and top-of-mind topic among web developers and stakeholders.
The need to ensure websites are accessible and inclusive for people with a wide range of disabilities, had fueled the creation of automated tools to help detect accessibility errors. While a majority of these tools were designed to support current Web Content Accessibility Guidelines (WCAG 2.1) they vary in the number and types of errors they detect and the degree to which they can help ensure ADA Accessibility compliance.
So how can a developer, content editor or even sole proprietor business owner sort through the available tools and determine the options that best suit their needs? There are many websites and tools out there that can offer a great start. Here are six of the most popular tools or extensions currently available, and what we consider to be the key advantages and drawbacks to each.
Keep in mind that these are all automated tools, meaning that their use does not require actual interaction with a web page or website. In order to accurately and thoroughly audit a website for accessibility, manual testing and intervention is also required. Automated tools, however, provide a step in the right direction and an essential starting point.
DubBot provides automated solutions designed to simplify website management, with tools that help organizations to detect vulnerabilities that include web accessibility, web governance, SEO, detection of misspellings, broken links, and accessibility task management.
- The DubBot dashboard is amazingly useful. The ability to not only see accessibility issues, but also broken links, governance red flags, and spelling mistakes is helpful at getting a high-level site summary.
- DubBot provides the ability to filter by accessibility error types, view all errors on a single page, site or group, as well as create tasks, mark errors as resolved, or ignore errors on a site or group basis.
- DubBot's support team extremely responsive, offering efficient access to subject matter experts who provide accurate and authoritative responses to questions and concerns.
- DubBot also allows users to configure reporting, that enables up-to-date information on any website's current accessibility state. Reporting includes an error summary and can be sent daily or weekly, (depending on configuration options). This is a very helpful tool during agile development.
- DubBot runs on axe, which is helpful in leveraging automated accessibility testing due to an enterprise ready dashboard that has many configuration options.
- Unlike a few of the other tools, DubBot does not have a Chrome plugin, which means that a website's needs to be compatible with the DubBot crawler tool.
- Integrations with JIRA or other reporting/ticketing software would be helpful.
- The WAVE Chrome and Firefox extensions allow you to review the accessibility of your site directly within the Chrome and Firefox browsers.
- No information is sent to the WAVE server.
- WAVE will show what errors are indicated and make some recommendations on how to correct these issues.
- WAVE provides an overlay of icons to indicate any potential accessibility issues however it gets confused by absolute positioning and doesn’t show any other information about the element.
- The overlay overlay of icons becomes further problematic when you are managing an element that is not visible on the page. It will take a bit of work with dev tools to determine which element is causing the issue.
axe is developed by Deque Systems for Chrome. axe analyzes a page for accessibility defects in just a few moments from a Chrome browser. The final output will show a list of accessibility issues with a link that provides the code that caused the issues and recommendations for fixing the issue.
- axe rates the impact of accessibility issues differently than WAVE. It does not use the “alerts” category, rather all errors are given a severity level. Using this system prompts more errors to be fixed than if some errors are labeled as alerts implying they are not important.
- axe will list elements that are not necessarily accessibility errors but warrant review based on the context of the element..
- axe will point out some color contrast issues that still need to be tested manually.
- While not overtly a drawback with this tool, it does require a bit more knowledge by the user to understand the process for testing.
Siteimprove is an extremely popular tool especially within the areas of government and higher-education. Siteimprove is available as a Chrome extension. It provides visual feedback concerning web content and highlights non compliance issues visually on the page.
- Siteimprove analysis is done entirely within the Chrome browser, allowing secure evaluation of password-protected or non-public pages, multi-step forms, and dynamic content.
- Siteimprove identifies accessibility noncompliance issues within the framework of WCAG, and points out instances where more than one guideline is being being violated.
- The format in which the errors are listed can be confusing for those not familiar with WCAG standards for accessibility.
- Several areas indicate manual testing is needed. As with axe, while not overtly a drawback for this tool, it does require a bit more knowledge by the user to understand the process for testing.
Lighthouse is developed by Google. If you are running an up to date version of Chrome, you most likely already have Lighthouse since it is built into devtools. Open devtools and go to the ‘Audits’ tab, then the ‘Perform an Audit’ button and you will be given a list of the audits Lighthouse can perform.
- Built into Chrome devtools.
- Can analyze more than just accessibility. Also analyzes factors such as SEO, performance and best practices.
- Not as robust as some of the other tools listed. Lighthouse does use axe-core for accessibility audit, but it does not run the full set of about 70 tests that the axe extension does.
- It is possible to get a 100% accessibility rating on Lighthouse and still have a site which is largely not accessible.
Tenon.io differs from the other tools listed here since it is a web service and not an extension. Use of Tenon.io simply requires a link or paste in the markup of the UI and it will generate a report. There are also many ways to integrate Tenon but this is a paid service.
- Does not require anything to be downloaded or installed on your computer.
- Since Tenon works by passing the URL to a browser, your site/UI need to be publicly available.
- Can be slower than the other tools covered here.
Automated tools can serve to significantly streamline the evaluation of a website for ADA accessibility and detect important instances of non compliance. Manual follow-up is always recommended, however, for an accurate analysis and assurance of WCAG compliance.
Just as one, small example of the limitation of automated accessibility tools: automated tools check to ensure the presence of alt text, but if the alt tag is inaccurate such as alt="cow" for a picture of a chicken, the automated tool will not detect it—although some will point an issue that needs to be verified.
Looking for help in determining the automated tool that’s appropriate for your needs, or consultation concerning the process of ensuring WCAG 2.1 compliance for your website? That's what we do! Contact us today.