Main content (Site structure)
Mobile Impairment Simulator (MIS Tool)
Introduction & Information details for the MIS Tool
MIS is a standalone desktop simulation application for mobile application developers. It can provide simulation of common visual impairments as well as issues from indoor and outdoor physical environment. Currently there are implemented following simulation effects (a) Physical environment effects such as Static reflection, Dynamic reflection, Display tremor, Finger occlusion and (b) Visual impairments effects such as Tunnel vision, Blurred vision, Colour blindness, Macular degeneration, Extreme light sensitivity. In comparison to desktop computers or laptops that are usually used indoor (at home, in the office or in a restaurant), mobile devices are often used in different physical environments like in public transport, on the street, in the park, etc. We have analyzed typical issues that can occur in these environments.
The simulator consists of 2 main parts - Filter settings window and Simulation window:
- 1. Filter settings window (see figure 1) where effects and their parameters can be adjusted. At the bottom of the Filter settings window is placed the integrated context help. All three sections of filter settings window are described below.
- Section with adjustable control parameters of currently focused simulation filter (see Figure 1 section 1)
- Stack of simulation effects that are currently applied in Simulation window. These effects are automatically grouped and sorted into three logical levels (Eye, Middle and Display) according to real world order. (see figure 1 section 2) Thus the correct order of applied filters is always ensured.
Figure 1: Screenshot of Filter settings window with marked sections
- 2. Simulation window where simulation effects take place. On the image (see figure 2) is applied effect of reflection from fluorescent lamp on the display, finger occlusion of the display and the effect of blurred vision.
The Mobile Impairment Simulator was developed for Mac OS X and uses Cocoa framework for rendering of effects. Most of the filters are implemented using Core Image, Apple image processing technology that leverages programmable graphics hardware whenever possible to provide near real-time processing. Core Image API provides access to built-in image filters for both video and still images and provides support for creating custom filters. Unfortunately this technology is very closely tied to Mac OS X environment and there is currently no similar multi platform solution.
Figure 2: Screenshot of MIS tool with blur effect placed over the Android emulator
It is also possible to combine parameters and create real life situations such as reflection on the display and finger occlusion or display tremor and blurred vision. The static reflection effect provides preview of the mobile application when for example fluorescent lamps (see left side on figure 3) on the ceiling reflects on the display. Developer can easily adjust strength of the static reflection effect and check if the user interface is still readable. Finger occlusion effect is implemented by modified mouse pointer that is attached to the photo of index finger or thumb (see right side of figure 3). Usage of mobile device while walking or travelling by car or by bus brings tremor of the display and introduces text reading problem. Display tremor effect is simulated by random motion blur effect.
Many of these effects can be also used to check the usability of the visual design for users with no visual impairment.
Figure 3: Screenshot of simulated effects - reflection of fluorescent lamp and finger occlusion
Owner/Main Developer (including also key partners contribution)
CVUT
Intelectual property Rights (IPR issues, Licences)
LGPL licence
Nature of the Code
Open source
Published Papers
- Jan Vystrcil, Zdenek Mikovec, Marek Fronc, Jiri Drbalek, Accessibility Issues Simulation For Mobile Applications, 2nd International AEGIS Conference 2011
Strengths and Weaknesses
| Strengths | Weaknesses |
|---|---|
|
|
Contribution to the state of the art
MIS is an innovative simulation tool that operates in Mac OS systems and after a thoroughly examination in the literature on the subject, we have identified that there isn’t any similar tool that works in Mac Oss.
Technical Testing Results from the developer and beneficiary validation
MIS tool has been tested in pilot tests with developers and beneficiaries and several important usability issues occurred. In the following table we outline the most important issues that were identified during the testing, and how they were addressed for the improvement of the tool.
| Issue description | Priority | Solved | Solution / Explanation |
|---|---|---|---|
| Simulation window does not support scaling, thus landscape mode applications or tablet applications cannot be simulated | 1 | YES | Simulation window supports free scaling so it can be adjusted according the needs of developer. |
| Each filter settings window opens in new window. This leads to too many open floating windows and bad and confusing window arrangement | 1 | YES | Filter settings windows have been redesigned and now there is just one window for all filters. Particular filters that are applied are displayed in the Stack of simulation effects. |
| Combination of multiple filters has to be reordered manually and can lead to wrong order of filters resulting in unrealistic simulation. | 2 | YES | Partially automatic ordering of filters has been implemented. Each filter belongs to one of three predefined categories of layers (Eye, Middle, Display) Thus correct order of the filters is ensured. |
| Position of the simulation window is not remembered and has to be adjusted each time. | 1 | YES | Last position of the simulation window is saved automatically and used each time the MIS tool is started again. |
| After starting of MIS tool there is no window displayed what is confusing the users. | 1 | YES | After starting of the MIS tool the filter settings window provides now necessary feedback to the users. |
| The filter window is not connected with concrete application window. It is necessary to arrange the simulation window and align it above application window. | 3 | NO | It is not affecting the simulation seriously. |
| Parameters of filters are not clearly labelled and explained | 1 | YES | All control parameters of filters have been revised and renamed to provide clear user controls. Some filters have been renamed. |
| MIS tool is not covering possible disabilities | 3 | NO | MIS tool was intended to cover most important subset of disabilities. |
| Unable to use other Operating Systems | 1 | NO | MIS tool is developed with use of Cocoa framework for rendering of effects. Most of the filters are implemented using Core Image, Apple image processing technology that leverages programmable graphics hardware whenever possible to provide near realtime processing. Unfortunately this technology is very closely tied to Mac OS X environment and there is currently no similar multi platform solution. |
| Animation of reflection was not realistic | 2 | YES | MIS tool is intended to provide approximate simulation to warn developer and help him avoid the most serious issues. Moreover the animation reflection has been modified. |
| The finger simulation tool wouldn't move properly when you perform a drag and drop" action. It just shows the starting and ending position | 1 | YES | This bug was successfully resolved. |
| I would like the option of having automated tests, to avoid so much interaction to select different filters | 2 | Partially | Interaction of developer with MIS tool is essential for obtaining valuable results, therefore no automated test were implemented. However MIS tool is now providing option to load XML configuration files where all the filters and its parameter values could be predefined. |
| I miss a simple way to simulate profiles of personas, rather than single disabilities | 2 | Partially | Personas were not intended to be integrated directly to the MIS tool. However the MIS tool is now providing the option to load XML configuration files where all the filters and its parameter values could be predefined |
| MIS tool is not providing information about statistics to know how many users are suffering with some disability (like in DIAS) | 3 | NO | MIS tool is not intended to be an educational tool so it is more focusing on information related to simulation. |
| When using more than one filter at the same time I had troubles using the tunnel filter and the finger pointer. The finger does not allow seeing the device because the centre of the tunnel vision is exactly at the same position as the finger. In reality the user can be looking at one part of the screen while the finger is pointing to another part of the screen | 2 | Partially | Standard real life action of user suffering from loss of peripheral vision should be removing the finger from the display to see what is under the finger. |
Position in the theoretical development process
Currently there are implemented the following simulation effects:
- Physical environment effects
- Static reflection
- Dynamic reflection
- Display tremor
- Finger occlusion
- Visual impairments effects
- Tunnel vision
- Blurred vision
- Colour blindness
- Macular degeneration
- Extreme light sensitivity
- It is also possible to combine parameters and create real life situations such as reflection on the display and finger occlusion or display tremor and blurred vision. The static reflection effect provides preview of the mobile application when for example fluorescent lamps on the ceiling reflects on the display. Developer can easily adjust strength of the static reflection effect and check if the user interface is still readable. Finger occlusion effect is implemented by modified mouse pointer that is attached to the photo of index finger or thumb. Usage of mobile device while walking or travelling by car or by bus brings tremor of the display and introduces text reading problem. Display tremor effect is simulated by random motion blur effect. Many of these effects can be also used to check the usability of the visual design for users with no visual impairment.
A path to obtain the required quality to integrate the tools in mainstream development environments (e.g. Netbeans, JDeveloper)
There isn’t any plan for integrating the MIS tool in mainstream development environments due to the adopted technologies for supporting the Mac OS systems. However, the already implmented DIAS tool, which has similar functionalities with MIS, it has been integrated in IDE enviroments and could be used for the accessibility support of developers and designers through IDEs.
