Usability and Test Automation - TestIstanbul
Usability and Test Automation - TestIstanbul
Usability and Test Automation - TestIstanbul
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
© 2011 ERNI Consulting AG<br />
<strong>Usability</strong> <strong>and</strong> <strong>Test</strong> <strong>Automation</strong>
How <strong>Test</strong> <strong>Automation</strong><br />
Improves <strong>Usability</strong><br />
<strong>Usability</strong> <strong>and</strong><br />
Flight Information Business<br />
Main Focus<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 2
Overview<br />
1. <strong>Usability</strong>: Why?<br />
2. Skyguide: Business Domain<br />
1. Software Under <strong>Test</strong><br />
2. <strong>Test</strong>ing<br />
3. <strong>Test</strong> <strong>Automation</strong><br />
1. <strong>Usability</strong><br />
2. Some Examples<br />
3. Tool & Possibilities<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 3
<strong>Usability</strong>-Why?<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 4
<strong>Usability</strong>:<br />
ISO definition<br />
The extent to which a product<br />
can be used by specified users<br />
to achieve specified goals with<br />
effectiveness, efficiency, <strong>and</strong><br />
satisfaction in a specified context<br />
of use.<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 5
Good <strong>Usability</strong><br />
Google iPod<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 6
Why <strong>Usability</strong>?<br />
if a website is unusable<br />
you leave it<br />
you rather don't buy<br />
anything<br />
you look out for alternatives<br />
you forget about it<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 7
<strong>Usability</strong> in a<br />
Closed Environment<br />
Google (open env.) Skyguide (closed env.)<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 8
<strong>Usability</strong> applied at Skyguide<br />
1. Business Domain<br />
Introduction<br />
2. <strong>Usability</strong><br />
Considerations<br />
3. Practical Examples<br />
on a Specific<br />
Skyguide Software<br />
(SCONE)<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 9
1400 Employees<br />
14 sites<br />
Revenue: 362 millions<br />
Business Domain<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 10
Skyguide's Performance<br />
2010 2010: 2010 2010:<br />
: Approx 1.2 1.2 Mio Mio controlled controlled IFR IFR flights flights flights (3100/day) (3100/day) in in one<br />
of the the densest densest <strong>and</strong> <strong>and</strong> busiest busiest airspace airspace in in the the heart heart of of Europe<br />
Europe<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 11
Business Domain Introduction<br />
NOTAM (1)<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 12
Business Domain Introduction<br />
NOTAM (2)<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 13
Software under test:<br />
SCONE<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 14
<strong>Usability</strong> considerations (1 of 2)<br />
Who are the users?<br />
What do they know?<br />
What can they learn?<br />
user's background?<br />
What do users want or need to do?<br />
What is the user's context of working?<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 15
<strong>Usability</strong> considerations (2 of 2)<br />
What must be left to the machine?<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 16
Documentation:<br />
Requirements <strong>and</strong> <strong>Test</strong> Cases<br />
Requirements<br />
� are mainly written by<br />
� developers<br />
� AIM specialitsts<br />
� users<br />
� no specific role of usability<br />
engineer<br />
<strong>Test</strong> Cases<br />
� explorative test approach<br />
� technical test cases<br />
vs.<br />
business business test cases<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 17
<strong>Test</strong> Levels & Responsibility<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 18
Some examples<br />
Tool <strong>and</strong> Possibilities<br />
<strong>Test</strong> <strong>Automation</strong><br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 19
<strong>Test</strong> <strong>Automation</strong><br />
Where do we use test automation?<br />
Regression <strong>Test</strong>s<br />
Bug Fixes<br />
Business <strong>Test</strong>s<br />
where USABILITY comes in<br />
���� customer satisfaction!<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 20
<strong>Test</strong> <strong>Automation</strong><br />
Some Examples<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 21
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Example (1 of 5)<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 22
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Example (2 of 5)<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 23
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Example (3 of 5)<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 24
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Example (4 of 5)<br />
NOTAM file tree<br />
contains specific items<br />
some items are bold<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 25
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Example (5 of 5)<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 26
<strong>Test</strong> <strong>Automation</strong><br />
Tool & Possibilities<br />
© 2009 ERNI Consulting AG 22.05.2011<br />
Seite 27
<strong>Test</strong> <strong>Automation</strong> Tool<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 28
Languages: Natural vs. Technical<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 29
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Using test automation you can:<br />
• check appereance of specific<br />
information<br />
• check appereance of dialogues<br />
• check contents of JTree objects<br />
• check response time for specific<br />
actions<br />
• check keyboard shortcuts<br />
• …<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 30
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Using test automation you can:<br />
• check appereance of specific<br />
information<br />
• check appereance of dialogues<br />
• check contents of JTree objects<br />
• check response time for specific<br />
actions<br />
• check keyboard shortcuts<br />
• …<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 31
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Using test automation you can:<br />
• check appereance of specific<br />
information<br />
• check appereance of dialogues<br />
• check contents of JTree objects<br />
• check response time for specific<br />
actions<br />
• check keyboard shortcuts<br />
• …<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 32
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Using test automation you can:<br />
• check appereance of specific<br />
information<br />
• check appereance of dialogues<br />
• check contents of JTree objects<br />
• check response time for specific<br />
actions<br />
• check keyboard shortcuts<br />
• …<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 33
<strong>Usability</strong> in <strong>Test</strong> <strong>Automation</strong><br />
Advantages<br />
Advantages<br />
no natural language in test scripts<br />
no room for interpretation<br />
soft facts get nailed down<br />
<strong>Usability</strong> is checked automcatically in every Software Release<br />
Precondition<br />
<strong>Test</strong> <strong>Automation</strong> = Development Project!<br />
Extensibility<br />
Maintainance<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 34
Summary:<br />
How TA improves <strong>Usability</strong><br />
defined, "clear" language<br />
instead of natural<br />
language<br />
Quick Deviation<br />
Detection<br />
Need for Business Staff<br />
is reduced<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 35
Summary:<br />
How TA improves <strong>Usability</strong><br />
defined, "clear" language<br />
instead of natural<br />
language<br />
Quick Deviation<br />
Detection<br />
Need for Business Staff<br />
is reduced<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 36
Summary:<br />
How TA improves <strong>Usability</strong><br />
defined, "clear" language<br />
instead of natural<br />
language<br />
Quick Deviation<br />
Detection<br />
Need for Business Staff<br />
is reduced<br />
© 2011 ERNI Consulting AG 22.05.2011<br />
Seite 37
© 2011 ERNI Consulting AG<br />
Questions
Innovation in Prozess und Technologie.<br />
ERNI<br />
Zürich, Luzern, Bern, Lausanne<br />
München, Bratislava<br />
www.erni.ch
Change language