annual report 2004 - Ãrebro universitet
annual report 2004 - Ãrebro universitet
annual report 2004 - Ãrebro universitet
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Annual Report <strong>2004</strong><br />
Örebro <strong>universitet</strong> Örebro University<br />
Institutionen för teknik Department of technology<br />
701 82 Örebro SE-701 82 Örebro, Sweden
Annual Report <strong>2004</strong> 1<br />
Contents<br />
SUMMARY 2<br />
PREFACE 3<br />
1. CENTER FOR APPLIED AUTONOMOUS SENSOR SYSTEMS (AASS) 5<br />
1.1 ORGANISATION 9<br />
1.2 MANAGEMENT 12<br />
1.3 FUNDING 14<br />
1.4 UNDERGRADUATE EDUCATION 16<br />
1.5 GRADUATE EDUCATION 18<br />
1.6 CO-OPERATION 23<br />
1.7 DISSIMINATION OF INFORMATION 28<br />
2 RESEARCH LABS 34<br />
2.1 BIOLOGICAL INSPIRED SYSTEMS LAB 35<br />
2.2 MOBILE ROBOTICS LAB 42<br />
2.3 INTELLIGENT CONTROL LAB 56<br />
2.4. LEARNING SYSTEMS LAB 68<br />
3. PUBLICATIONS 80<br />
3.1 BOOKS (INCL. PHD/LIC THESIS) AND EDITED VOLUMES 80<br />
3.2 CHAPTERS IN EDITED VOLUMES 80<br />
3.3 JOURNALS 80<br />
3.4 CONFERENCE PAPERS 81<br />
3.5 WORKSHOP AND SYMPOSIUM PAPERS 82
2 AASS – Center for Applied Autonomous Sensor Systems<br />
Summary<br />
The Applied Autonomous Sensor Systems Centre (AASS) organizes all research and graduate<br />
education in the area of Autonomous Systems and also is responsible for the undergraduate<br />
and MSc programs in Computer Engineering (Datateknik) at the Dept. of Technology, at<br />
Örebro University, Örebro, Sweden. The research effort has a pronounced interdisciplinary<br />
character being a fusion of a variety of disciplines from Systems and Control, Measurement<br />
Technology and Sensors, Computer Science and Artificial Intelligence, and Operations<br />
Research but, with emphasis on Intelligent Control and Sensors, Machine Learning, Planning<br />
and Automated Reasoning, and Biologically Inspired Systems. The Applied Autonomous<br />
Sensor Systems Centre is organized in four laboratories, responsible for research and graduate<br />
education in their respective areas:<br />
1. Biologically Inspired Systems Laboratory (BIS)<br />
2. Mobile Robotics Laboratory (MR)<br />
3. Intelligent Control Laboratory (IC)<br />
4. Learning Systems Laboratory (LS)<br />
The common research focus for the four research laboratories is the subject of perception<br />
and autonomy in diverse un- and/or semi-structured environments. This subject is<br />
pursued using a common research methodology, which is strictly applied: all technologies<br />
under investigation should answer actual needs that emerge from an application, and their<br />
effectiveness is always validated on the application. Applications considered by AASS<br />
include mobile platforms, e.g., mobile robots, and immobile platforms, e.g., industrial plants<br />
and processes.<br />
This <strong>report</strong> presents AASS organization and management, developments in education, research<br />
and industrial co-operation, activities within the national/international research community, and<br />
various forms of societal interaction that have taken place in year <strong>2004</strong>. In this context, some<br />
important developments that characterize year <strong>2004</strong> are as follows:<br />
• Control and systems (Reglerteknik) was approved as a separate study program<br />
(forskarutbildningsämne) in graduate education. Prof. I. Kalaykov (IC Lab, AASS) is<br />
responsible for the new program and two Ph.D. students were already admitted in it.<br />
• AASS started an international cooperation under the framework of the "Ubiquitous robot<br />
companion" program, sponsored by the Korean government through its research agency<br />
ETRI. This is one of the most ambitious public programs in cognitive robotics in the world<br />
today.<br />
• S. Coradeschi has obtained a three-year grant from Vetenskapradet for the project<br />
"Anchoring Symbols to Sensor Data". This was the only 3-year grant awarded by<br />
Vetenskapsrådet to Örebro University this year.<br />
• During 2003/<strong>2004</strong> the BIS lab underwent re-organization, including changes in its staff<br />
and research directions. As a result, the BIS lab has now streamlined its activities within<br />
two related research directions: biologically inspired sensing and dexterous manipulation.
Annual Report <strong>2004</strong> 3<br />
Preface<br />
The Centre for Applied Autonomous Sensor Systems (AASS) was formally established in<br />
1996 at the Department of Technology with a grant from the KK-Foundation aimed at<br />
establishing the basis for a concentrated effort on interdisciplinary research in the area of<br />
Autonomous Systems with contributions to education. In the period 1996-<strong>2004</strong>, AASS has<br />
developed from a research group of 2 researchers and 2 PhD students to a full-fledged<br />
research centre with 4 professors, 2 associated professor (docent), 2 visiting professor (from<br />
industry), 4 researchers (PhD), 24 Ph.D. students, and technical and administrative personnel<br />
of 6. Now AASS plays an important educational role within the Department of Technology as<br />
well as has a leading position in the 4th strategic research profile of Örebro University –<br />
“Human senses, autonomous sensor systems, and industrial processes”.<br />
It also has achieved national/international recognition for its research results, established wellfunctioning<br />
industrial co-operation, and strong industrial presence with its participation in the<br />
Robotdalen - the largest Swedish 10-year innovation program in robotics funded by industry<br />
and the state innovation agency VINNOVA with the amount of 200 M SEK. In the context of<br />
these achievements, AASS has, during year <strong>2004</strong>, also had a measurable societal impact in a<br />
number of ways such as<br />
1. Industrial relevance: Partner in large-scale industrial projects with Atlas Copco Rock<br />
Drills AB (Örebro), ESAB AB (Laxå), Volvo Construction equipment AB (Eskilstuna),<br />
and Optab-Optronikinnovation AB (Karlskoga).<br />
2. European dimension: Co-operation within two EC research networks (EURON, and<br />
CLAWAR II) and a coordinator for EU FP5 Marie Curie Training Site.<br />
3. World dimension: AASS started an international cooperation under the framework of the<br />
"Ubiquitous robot companion" program, sponsored by the Korean government through its<br />
research agency ETRI. This is one of the most ambitious public programs in cognitive<br />
robotics in the world today.<br />
4. National dimension: Founding member of the VINNVÄXT/VINNOVA 10-year national<br />
innovation program "Robotdalen" together with MdH Mälardalen, and a large number of<br />
industrial and societal partners and public bodies.<br />
5. Public acceptance: responsible for the implementation of the Robotdalen project<br />
“Technology transfer and competence development (Teknikspridning och kompetenshöjning)''<br />
for the Örebro-node of Robotdalen.<br />
However, our most important contribution with long-term societal impact is our educational<br />
activity. Improving the content, quality, and degree-level of the undergraduate education in<br />
the Department of Technology in general and in Computer Engineering in particular is of<br />
highest priority. Thus undergraduate students with BSc, MSc, and Engineering degrees will<br />
remain our most important "output" - these students are to play important role in the<br />
development of regional and national industrial and business enterprises.
4 AASS – Center for Applied Autonomous Sensor Systems<br />
In this context, the preparatory work aimed at establishing a new engineering education (civing,<br />
180 p) in Mechatronics at the Dept. of Technology is completed and an application will<br />
be submitted to the Dept. of Higher Education (Högskoleverket) in the beginning of 2005. At<br />
the same time research and graduate education will be key factors in keeping with up-to-date<br />
technological developments, maintaining and further developing the scientific relevance and<br />
quality of undergraduate education, and last but not least, increasing the attractivity of Örebro<br />
University as an educational centre in a regional, national, and international perspective. On<br />
the other hand, our research and graduate education is of great value in itself – by doing<br />
research in the area of Autonomous Systems we contribute to the advancement of<br />
technologies at one of the frontiers of modern interdisciplinary science. A particular<br />
"practical" benefit is the reunification of Measurement, Control, and Computer Sciences into<br />
a disciplinary and technological continuum - a reunification that sadly is lacking today, to the<br />
growing discontent of industry. Thus, industrial co-operation will ensure that these<br />
technological advancements are adopted and their business potential is exploited.<br />
Certain "key" figures indicating that the development of the AASS research and educational<br />
profile is on the right track are:<br />
• Number of students in the Computer Engineering undergraduate program <strong>2004</strong>: 85<br />
• Number of MSc students in the Computer Engineering MSc program <strong>2004</strong>: 23.<br />
• Number of MSc theses completed under AASS supervision <strong>2004</strong>: 4.<br />
• Number of PhD students <strong>2004</strong>: 24 (1 PhD and 3 Licentiate degrees awarded in <strong>2004</strong>).<br />
• Number of ex-jobs completed under AASS supervision <strong>2004</strong>: 2.<br />
• Number of publications <strong>2004</strong>: 51<br />
• External funding <strong>2004</strong>: 54.2% of the total AASS budget.<br />
A continued strong support from our founders and academic/industrial partners shows that we<br />
have all reasons to be optimistic about our further development and contributions to<br />
education, industry, and society.
Annual Report <strong>2004</strong> 5<br />
1. Centre for Applied Autonomous Sensor Systems (AASS)<br />
The Applied Autonomous Sensor Systems Centre was formally established in 1996 with a<br />
grant from the KK-Foundation with the purpose of establishing the basis for a concentrated<br />
research effort in the interdisciplinary area of Autonomous Systems with expected<br />
contributions to education and industrial co-operation.<br />
Today AASS is nationally and internationally recognized for its research results and plays an<br />
important educational role within the Department of Technology and in the 4th strategic<br />
research profile of Örebro University – “Human senses, autonomous sensor systems, and<br />
industrial processes”. AASS has established well-functioning industrial co-operation - a<br />
number of industrial partners have developed a strong interest in AASS and support the<br />
research effort in terms of industrial PhD students, joint research projects, research-relevant<br />
equipment (hardware and software), and expertise (industrial employees acting as part-time<br />
AASS researchers).<br />
The industrial co-operation will be made even stronger as a result of our participation in the<br />
VINNOVA Robotdalen innovation program. The AASS research effort is organized on the<br />
basis of the following 4-pronged vision:<br />
1. Recognition by the international and national scientific community not only for AASS's<br />
active contributions to the state-of-the-art in core research areas, but also for its innovative<br />
role in establishing novel research topics that expand the frontiers of the science and<br />
technology for autonomous systems.<br />
2. Significant, long-term industrial interest in utilizing AASS's research results and<br />
educational capacity that will allow improvement of existing industrial technologies and<br />
products as well as, provide possibilities for exploring radically new solutions and future<br />
products.<br />
3. Significant contributions to educational programs at BSc, MSc and PhD-level of<br />
education.<br />
4. Leading role within the Örebro University's strategic research profile "Human Senses,<br />
autonomous sensor systems, and industrial processes''.<br />
In engineering terms, the fulfilment of the above vision will lead to:<br />
• Providing practitioners with methods for the design of engineering systems at all levels of<br />
control and sensing (low, supervisory and task-level) and whose needs are not met by<br />
existing conventional approaches. In educational terms, the fulfilment of the above vision<br />
will lead to:<br />
• The reunification of Measurement, Control, and Computer Sciences into an<br />
interdisciplinary disciplinary continuum - a reunification, which sadly is lacking today<br />
from existing educational programs.
6 AASS – Center for Applied Autonomous Sensor Systems<br />
Autonomous Systems<br />
Autonomous systems are mobile as well as immobile platforms that employ a vast array of<br />
sensors in order to analyze and/or influence highly dynamic environments. Examples of such<br />
systems include robotic systems, complex process control systems, flexible<br />
manufacturing/inspection systems, automotive systems, and unmanned underwater/land and<br />
air/space vehicles.<br />
In order to achieve an autonomous operation the system has to be supplied with the ability to:<br />
plan and schedule control/sensing actions at varying levels of detail and functionality; acquire<br />
and integrate sensory information at different levels of granularity and abstraction; learn how<br />
to adapt to initially unknown or changing environments; identify events that threaten the<br />
system's operation and react to these by reconfiguring its control and sensing routines.<br />
The design and analysis of autonomous systems has a pronounced interdisciplinary character<br />
being a fusion of a variety of disciplines from Systems and Control, Measurement<br />
Technology and Sensors, Computer Science and Artificial Intelligence, and Operations<br />
Research. This fusion is with emphasis on certain modern developments such as Fuzzy<br />
Systems, Intelligent Control and Sensors, Machine Learning, Planning and Automated<br />
Reasoning, and Biologically-inspired Systems.<br />
There are four major research areas that constitute the basis for autonomous systems research<br />
and development: Perception Science and Technology, Reasoning Science and Technology,<br />
Action Science and Technology, and Learning Science and Technology. These four research<br />
areas and the challenges posed by them are well recognized by the international research<br />
community and underpin the mainstream international research effort in the area of<br />
autonomous systems. Perception provides the means to gather information about the working<br />
environment - information that permits operations such as manufacturing, process control,<br />
navigation, monitoring, and manipulation to be accomplished safely and robustly. Reasoning<br />
is the "smarts" of an autonomous sensor system - it is the capacity to reason that provides the<br />
connection between perception and action.<br />
Action is ability to move in space and to manipulate objects in a safe and reliable manner - in<br />
case of robotic systems, or maintain certain desired behaviour in industrial plants/processes<br />
despite disturbances and limited knowledge of process/plant dynamics. Learning is needed to<br />
make technologies from the areas of Perception, Reasoning, and Action play a practical role<br />
in a variety of real-world dynamic, uncertain and unstructured environments.<br />
AASS research reflects these major research areas and - what is more important - aims at their<br />
integration in order to "produce" complete autonomous systems solutions. With the<br />
integration issues in mind <strong>2004</strong> is the starting year for a number of joint inter-lab projects.<br />
The integration projects are seen as central means for cross-fertilisation between the four<br />
laboratories and serve as a convincing demonstration platform towards industry and funding<br />
bodies. The joint projects address issues like: human-like motion control of robot arms;<br />
hybrid maps for mobile robots; Ready-to-eat-food assembly; and human-robot interaction.<br />
Their potential application is in a number of industrially relevant areas: inspection of<br />
industrial sites and installations, inspection of hazardous waste sites and waste manipulation,<br />
product and material monitoring in manufacturing, and rescue operations. Their industrial<br />
relevance is further reinforced by the present inadequacy of the predominant number of<br />
mobile robots/manipulators in industrial use: very limited autonomy, limited task range,
Annual Report <strong>2004</strong> 7<br />
predictability of behaviour only in well-structured and predictable environments, and limited<br />
sensing capabilities. AASS is organized around the following interrelated and mutually<br />
dependent permanent activities:<br />
1. Research projects, including technical support and pertaining to particular lab or "interlab"<br />
projects.<br />
2. Robotdalen projects, industrial projects defined within the Robotdalen framework.<br />
3. The AASS Graduate program, leading to both Licentiate and PhD degrees.<br />
4. The MSc program in Computer Engineering - an educational program at the Department<br />
of Technology reflecting AASS related research.<br />
5. Undergraduate studies in Computer Engineering at the Department of Technology.<br />
6. EU Marie Curie Training Program in advanced autonomous robotic systems - duration<br />
2002-2005.
8 AASS – Center for Applied Autonomous Sensor Systems<br />
Group picture, AASS Staff<br />
From the top left: Per Munkevik (PhD-student), Mikael Broström (Computer Support), Robert Lundh<br />
(PhD-student), Peter Wide (Professor), Anani Ananiev (Senior Researcher),<br />
Upper middle row: Ester Liljedahl (Administrative Manager), Abdelbaki Bouguerra (PhD-student),<br />
Henrik Andreasson (PhD-student), Lars Karlsson (Senior Researcher), Martin Magnusson (PhDstudent),<br />
Mikael Soron (PhD-student), Ivan Kalaykov (Lab leader, Professor), Kevin LeBlanc (PhDstudent),<br />
Lower middle row: Johan Larsson (PhD-student), Boyko Iliev (Lab leader, Senior Researcher),<br />
Mathias Broxvall (Senior Researcher), Grzegorz Cielniak (PhD-student), Malin Lindquist (PhDstudent),<br />
Linn Robertsson (PhD-student), Thorsten Michelfelder (PhD-student), Alexander Skoglund<br />
(PhD-student), Gustav Tolt (PhD-student), Per Sporrong (Research Engineer),<br />
Front row: Cipriano Andrades (Marie Curie-student), Jessica Karlsson (Information assistant), Silvia<br />
Coradeschi (Senior Researcher).<br />
Not present: Dimiter Driankov (Research Manager), Barbro Alvin (Administrative assistant), Pär<br />
Buschka (PhD-student), Tom Duckett (Lab leader), George Fodor (Adj. Professor), Lars Jennergren<br />
(PhD-student), Jun Li (PhD-student), Christer Lindkvist (PhD-student), Amy Loutfi (PhD-student),<br />
Jack Pencz (PhD-student), Martin Persson (PhD-student), Alessandro Saffiotti (Lab leader, Professor),<br />
Bo-Lennart Silverdahl (Research Engineer) Henrik Sturve (Economy assistant), Thomas Uppgård<br />
(PhD-student), Christoffer Wahlgren (PhD-student), Zbigniew Wasik (PhD-student).
Annual Report <strong>2004</strong> 9<br />
1.1 Organisation<br />
AASS is organized in matrix form, as shown in the figure below.<br />
AASS Management<br />
Prof. D. Driankov, Research Director<br />
E. Liljedahl, Administrative Manager<br />
Research Laboratories<br />
BIS Lab<br />
B.Iliev, PhD<br />
MR Lab<br />
Prof. A Saffiotti<br />
IC Lab<br />
Prof. I. Kalaykov<br />
LS Lab<br />
T. Duckett, Docent<br />
Research Projects<br />
Technical and Adm. Support Group: P.Sporrong, B-L.Silfverdal B. Alvin, J.Karlsson and H.Sturve<br />
Robotdalen Projects<br />
Project coordinators: D.Driankov and E.Liljedahl<br />
Graduate Program<br />
Director: L. Karlsson, PhD<br />
MSc Program in Computer Engineering<br />
Program Leader: L. Karlsson, PhD<br />
Undergraduate Studies at Division of Computer Engineering<br />
Director of Studies: S. Coradeschi, PhD<br />
EU Marie Curie Training Program in Autonomous Robotics (2002-2005)<br />
Program Coordinator Prof. D. Driankov<br />
The research labs reflect the four main directions in the research area of Autonomous<br />
Systems, i.e., BIS - Perception Science and Technology; ML - Reasoning Science and<br />
Technology; IC - Action Science and Technology; and LS - Learning Systems and<br />
Technology. Thus they represent competence areas within which basic research is conducted.<br />
According to their disciplinary competence, e.g., Computer Science, Computer Engineering,<br />
AI, Systems and Control, Machine Learning etc., they also provide resources - courses,<br />
teachers, and supervisors - for the graduate and undergraduate studies programs and the rest<br />
of the horizontal entries in the above figure:
10 AASS – Center for Applied Autonomous Sensor Systems<br />
1. Research projects are defined within labs (lab-specific projects), across labs (inter-lab<br />
projects), and/or cooperation with external partners (external projects). The lab leaders are<br />
responsible for the budget and project work on lab-specific projects and external projects.<br />
The AASS Research Director is also responsible for inter-lab projects. The technical<br />
support group provides technical assistance in the design and maintenance of robot<br />
platforms, sensor systems and the associated work with these software environments and<br />
programming tools:<br />
2. Robotdalen projects are industrial projects defined by the industrial partners from<br />
Robotdalen. These are typical “technology transfer” projects and at least one industrial<br />
PhD student is part of such a project while the scientific supervision is provided by AASS.<br />
At the current time there are three such projects. In addition AASS runs a project for<br />
dissemination of technology “Teknikspridning och Kompetenshöjning”, which aims to<br />
increase the interest, as well as the knowledge, for robotics and technology of youth and<br />
children.<br />
3. AASS Graduate program defines the PhD studies curriculum for all graduate students at<br />
AASS independent of their specific research area. The director of the program is<br />
responsible for its structure and contents, as well as the enrolment of graduate students<br />
and supervision of the formal aspects of progress in their PhD studies. The actual PhD<br />
thesis work and its supervision are done within the research labs. AASS graduate students<br />
have the possibility also to be enrolled in the Swedish National Graduate School in<br />
Computer Science (CUGS) where Örebro is one of the participating universities. The<br />
Director of the AASS Graduate program also is a member of the steering committee of<br />
CUGS.<br />
4. MSc program in Computer Engineering is a 4-year studies program, which upon its<br />
completion provides for 160 points of studies and leads to the degree “MSc in<br />
Technology, with profile in Computer Engineering”. The first two years of this program<br />
are common with the 3-year undergraduate program in Computer Engineering at the Dept.<br />
of Technology. The decision whether to join the MSc program is done upon the<br />
completion of the second year of the 3-year undergraduate program. The leader of the<br />
MSc program is responsible for the program's structure and courses’ content it’s<br />
monitoring and “marketing, contact with students, and BSc theses. In its current form the<br />
program contains courses directly related to the disciplinary and research competence at<br />
AASS.<br />
5. Undergraduate education in Computer Engineering is a 3-year studies program given<br />
within the Computer Engineering Division of the Department of Technology. The director<br />
of AASS also is director of the Computer Engineering Division, and Silvia Coradeschi, a<br />
researcher at AASS, is a director of studies for the Computer Engineering program who is<br />
responsible for both the three and four years programs. The responsibilities of the director<br />
include program teaching staff assignment and budget work etc. AASS research staff and<br />
PhD students are a natural part of the teaching staff.<br />
6. EU Marie Curie Training Program in Autonomous Robotics is a 4-year, EU-funded<br />
program, aimed at providing support for the training and mobility of PhD students<br />
throughout Europe. This scheme supports short stays by young researchers pursuing<br />
doctoral studies in the area of Autonomous Systems, providing them with the possibility<br />
of undertaking part of their doctoral studies in a country other than their own, and
Annual Report <strong>2004</strong> 11<br />
allowing them the benefit of working within an internationally recognized group - in this<br />
case AASS - in their specialized area of research - a particular AASS laboratory. The<br />
coordinator of the program is responsible for all organizational, management, and budget<br />
work as well as for contacts with the EU Commission, “marketing”, selection and<br />
enrolment of candidates. Actual research work supervision is done within the respective<br />
labs. In <strong>2004</strong> AASS has received 3 international Ph.D. students as Marie Curie fellows.
12 AASS – Center for Applied Autonomous Sensor Systems<br />
1.2 Management<br />
The management, evaluation, and monitoring of AASS activities are performed by the AASS<br />
Management Body, which consists of the AASS Research Director, Administrative Manager,<br />
and Lab-leaders. The major decisions made by the Management Body concern:<br />
1. Budget;<br />
2. Research strategies;<br />
3. Research/Education integration in the Computer Science (Datateknik) program;<br />
4. Long-term research/education planning and industrial cooperation;<br />
5. Recruitment;<br />
6. Personnel career development;<br />
7. AASS university/department role<br />
The AASS Research Director who chairs the steering committee is responsible for<br />
recruitment, career development, and interface with the department, the university and with<br />
industry and funding bodies. The Research Manager is also responsible for the formulation<br />
and progress of inter-lab projects, industrial projects, long-term research planning and<br />
recruitment needs, and planning and coordination of research grant applications. He also<br />
monitors the AASS Graduate Studies Program and prepares and organizes progress <strong>report</strong>s<br />
and evaluations concerning AASS activities. Two such <strong>report</strong>s, the AASS Activity Plan and<br />
AASS Annual Report, are each year submitted to the KK-Foundation (in January and March<br />
respectively).<br />
The AASS Administrative Manager is responsible for the budget preparation and the<br />
overview of the economy during the year. She also is responsible for agreements and our<br />
duties with <strong>report</strong>s and financial <strong>report</strong>ing towards the external partners. Marketing, external<br />
as well as internal information is some of the other duties. She is responsible for the AASS<br />
Support group, which also means recruitment and personnel planning for the long term as<br />
well as short-term work of the group.<br />
The Lab leaders are responsible for all issues pertaining to lab organization, management, and<br />
development. This includes, planning and coordination of lab-specific research projects as<br />
well as lab administration, e.g. budget handling, lab "marketing'' (internal and external), lab<br />
contributions to teaching, etc.<br />
The AASS Reference Group (RG) meets two times a year (December and June) and reviews<br />
AASS research and progress from both a scientific and industrial perspective. The RG can<br />
propose that certain corrections are made in order to keep AASS on the right track. At the RG<br />
December-meeting, the AASS Activity Plan is presented and approved. At the RG Junemeeting,<br />
the year after, the state of the AASS Activity Plan is reviewed.<br />
Currently the RG consists of:<br />
• Torbjörn Widmark, PhD, AssiDomän Frövi, Product Development & Technical Service,<br />
Frövi, Sweden - RG Chairman.<br />
• Thomas Christaller, Dr. Professor at Fraunhofer Institute for Autonomous Intelligent<br />
Systems, Germany.
Annual Report <strong>2004</strong> 13<br />
• Gu Chun-Yuan, Program manager Mechatronics, ABB Corporate Research, Västerås,<br />
Sweden.<br />
• Toshio Fukuda, Professor at Dept. of Micro System Engineering and Mechano-<br />
Informatics and Systems, Nagoya University, Japan.<br />
• Alexander Lauber, Professor in Measurement Technology, Department of Technology,<br />
Kalmar University, Kalmar, Sweden.<br />
• Emil M. Petriu, Dr. Eng., P. Eng., Professor, School of Information Technology and<br />
Engineering, University of Ottawa, Canada.<br />
• Giulio Sandini, Dr. Professor at LIRA-Lab, Dist-University of Genova, Italy.<br />
• Mel Siegel, Professor at Robotics Institute, Carnegie Mellon University, Pittsburgh, USA.
14 AASS – Center for Applied Autonomous Sensor Systems<br />
1.3 Funding<br />
AASS funding comes from a number of sources. The major ones are as follows:<br />
1. KK-Foundation grants<br />
In the year <strong>2004</strong> these grants amounted to a total of 7,3 MSEK (excl. VAT). 0,9MSEK of<br />
this amount consist of two grants, which two of our PhD students received from the KKfoundation.<br />
During the years 2002- 2008 the KK-Foundation stays for a grant of up to 36<br />
MSEK. This grant, won in a tough competition with other Swedish research centres and<br />
groups, is intended to help achieving internationally competitive research profile,<br />
establishing a long-term development potential and developing sufficient alternative<br />
(other than the KK-Foundation) funding sources. Furthermore the grant is to facilitate<br />
active industrial cooperation where the latter is ensured by requiring 1-to-1 match between<br />
the KK-Foundation grant and funding from industry. This yields a total of up to 72 MSEK<br />
for a period of 6 years. This requirement has had quite a positive effect regarding AASS<br />
industrial cooperation - existing one has been further strengthened and new industrial<br />
partners have been found. The matching funding provided by industry is mainly in the<br />
form of, industrial graduate students, part-time participation of industry personnel in<br />
external research projects, and expensive equipment.<br />
2. Faculty funding<br />
For the year <strong>2004</strong> it amounts to 9,2 MSEK. This funding allows AASS to conduct more<br />
basic research and for maintaining and developing the size and quality of AASS<br />
participation in undergraduate/graduate education.<br />
3. Vetenskapsrådet (VR) – Swedish Council of Research grants<br />
This is a traditional funding source though characterized by its extreme competitiveness.<br />
A VR grant of 1,2 MSEK covering a period of 3 years started in 2001 for research on the<br />
subject of signal-to-symbol conversion in mobile autonomous robots. Another VR grant<br />
of 1,813 MSEK and covering a period of 3 years was obtained in 2002 for research on the<br />
subject of Sensor-based planning for mobile robotics. A third grant of 1 824 000 is<br />
obtained for the period 2005-2008.<br />
4. Regional funding<br />
During <strong>2004</strong> regional industry has supported AASS with about 490 000 SEK for<br />
equipment.<br />
5. Robotdalen “funding”<br />
Currently there are three Robotdalen projects each with one industrial PhD student. The<br />
cost of these PhD students is covered by Robotdalen and the respective industrial partners<br />
involved. For the project “Teknikspridning och Kompetenshöjning” we received 363 600<br />
during <strong>2004</strong>. In January 2005 we received an additional 189 500 for <strong>2004</strong> as well. In total<br />
553 000 SEK.<br />
As a measure of having achieved the objectives set by the KK-Foundation AASS has adopted<br />
the ratio between internal (faculty/university) and external (KK-Foundation, industry,<br />
research funding agencies) funding. For year <strong>2004</strong> this ratio was 54,2% for external funding.<br />
According to the agreement the funding from the KK-Foundation profile should be not more<br />
than 38% of the total AASS budget. For <strong>2004</strong> this was 29%.
Annual Report <strong>2004</strong> 15<br />
The diagram from below summarizes the different funding sources in year <strong>2004</strong>.<br />
Funding <strong>2004</strong><br />
Internal income for teaching<br />
4,0%<br />
EU-networks<br />
0,9%<br />
Other income<br />
0,2%<br />
KK-foundation, Profile<br />
29,2%<br />
KK-foundation, IT<br />
4,1%<br />
Faculty<br />
41,8%<br />
ABB, Instr. & Control, KKrelated<br />
0,5%<br />
Regional companies<br />
2,2%<br />
ETRI<br />
0,5%<br />
NIROS<br />
4,5%<br />
CUGS<br />
3,3%<br />
Robotdalen<br />
3,0%<br />
Vetenskapsrådet<br />
5,4%<br />
Income from other universities<br />
0,4%<br />
The chart below shows the increasing funding levels for the years 1997-<strong>2004</strong>, which<br />
illustrates the rapid AASS development. (All amounts in thousand SEK.)<br />
AASS funding growth 1997-<strong>2004</strong><br />
25 000<br />
20 000<br />
15 000<br />
10 000<br />
5 000<br />
0<br />
1997 1998 1999 2000 2001 2002 2003 <strong>2004</strong>
16 AASS – Center for Applied Autonomous Sensor Systems<br />
1.4 Undergraduate Education<br />
AASS is responsible for the 3-year Computer Engineering Program and the 4-year MSc<br />
Program in Computer Engineering. AASS contributions are in terms of management,<br />
administration, program and course development, and teaching. Silvia Coradeschi, AASS, is<br />
the director of studies for the Computer Engineering Division including both the 3 and 4 years<br />
programs. Her responsibilities include budget and staff management for the undergraduate<br />
education within the division. Lars Karlsson is the leader for the MSc program. His<br />
responsibilities include development, information, course scheduling, and thesis<br />
administration.<br />
1.4.1 Computer engineering program<br />
The Computer Engineering Program is a study program consisting of 120 credit points<br />
(corresponding to three years of studies). The program can be characterized as a fixed study<br />
program with some options during year 3. It leads to a University Diploma in engineering (sv.<br />
"Högskoleingenjörsexamen"), 120 points, and/or a bachelor (BSc) degree. Details about the<br />
program's study plan can be found at:<br />
http://www.oru.se/templates/oruExtNormal.aspx?id=4690<br />
The following courses were taught in <strong>2004</strong> by AASS researchers:<br />
• Artificial Intelligence, Mathias Broxvall<br />
• Artificial Neural Networks, Tom Duckett<br />
• Real Time Programming, Mathias Broxvall<br />
• Artificial Intelligence for Mobile Robots, Alessandro Saffiotti.<br />
• Computer Graphic, Mathias Broxvall<br />
AASS PhD students have been teaching assistants for the following courses in year <strong>2004</strong>:<br />
• Numerical Methods, Li Jun<br />
• Artificial Intelligence for Mobile Robots, Kevin LeBlanc<br />
• Computer use, Linn Robertson<br />
• Computer Architecture, Pär Buschka<br />
• Computer Communication, Henrik Andreasson<br />
• Software System, Robert Lundh<br />
• Artificial Intelligence, Amy Loutfi<br />
• Artificial Neural Networks, Henrik Andreasson, Malin Lindquist<br />
• Java Programming, Zbigniew Wasik<br />
• Real Time programming, Malin Lindquist, Pär Buschka<br />
• Database, Abdelbaki Bouguerra<br />
BSc Theses<br />
• Göksu Gabriel och Demir Viktor “Röststyrning av robot via taligenkänning” Supervisors:<br />
Tom Duckett and Henrik Andreasson.<br />
• Pettersson Morgan, Arm Controller for Robot Waiter. Supervisor: I: Kalaykov (Started in<br />
2003).
Annual Report <strong>2004</strong> 17<br />
1.4.2 MSc in computer engineering<br />
The MSc Computer Engineering Program is a 4-year study program leading to a Master of<br />
Science with a major in Computer Engineering. The first 2 years of the program are in<br />
common with the 3-year Computer Engineering program, and students choose between the<br />
two programs at the end of the second year. The program belongs to the technological study<br />
sector. The program was started in the autumn of 2001 and the first class is graduated in 2002.<br />
Currently there are 40 students enrolled in the program. Details about the program's study<br />
plan can be found at www.oru.se, Department of technology's web pages.<br />
During the year, AASS members and PhD students have been involved in teaching related to<br />
the program as follows.<br />
Teaching<br />
The following courses were taught in <strong>2004</strong> by AASS researchers:<br />
• Computer Graphics, Mathias Broxvall (lectures)<br />
• Artificial Intelligence in Mobile Robotics, Alessandro Saffiotti (lectures), Kevin LeBlanc<br />
(assistant)<br />
• Program Development and Project Management, Robert Lundh (assistant)<br />
• Pattern Recognition, Gustav Tolt (lectures).<br />
MSc Theses<br />
The following MSc theses in Computer Engineering were completed during year <strong>2004</strong> at<br />
AASS.<br />
• Andersson, Karin “Functionality test with the electronic tongue”.<br />
Supervisor: S.Eskiizmirliler (started in 2003)<br />
• Sivebratt, Mikael. "GUI for artificial sensory head".<br />
Supervisor: S. Eskiizmirliler (started in 2003).<br />
• Ellkvist, Tommy och Sheikh Mohammed, Omar “Implementation of an image processing<br />
server for a mobile robot”.<br />
Supervisor: M. Broxvall<br />
• Magnusson, Daniel och Nord, Lasse “Människa och ABB's FlexPicker robot spelar<br />
airhockey”.<br />
Supervisor: I. Kalaykov<br />
Two additional MSc.theses (20 points each) started during spring <strong>2004</strong> but await completion<br />
in 2005.<br />
1.4.3 Other study programs<br />
AASS members and PhD students were also involved in a number of courses for other study<br />
programs:<br />
• Course in Power Point for University Personnel, Martin Persson<br />
• Soft Computing for Control, Ivan Kalaykov.
18 AASS – Center for Applied Autonomous Sensor Systems<br />
1.5 Graduate Education<br />
An integrated vital part of research at AASS is its Graduate Program and perhaps the most<br />
important "output" of AASS is highly qualified PhD's and Licentiates whose contributions<br />
provide further strength to Swedish industry and academic community.<br />
AASS is performing interdisciplinary research in the field of autonomous embedded systems,<br />
integrating theories, technologies and tools from sensors and measurement technology,<br />
control, artificial intelligence and computer science. Therefore, the AASS graduate program<br />
aims at giving graduate students a strong interdisciplinary background in these different areas<br />
with emphasis on topics relevant to autonomous systems. It is assumed that the students<br />
already have adequate knowledge in the basics of engineering and/or computer science.<br />
Finally, the program prepares students for a career in academia or industry by including topics<br />
such as pedagogy, management and presentation techniques.<br />
60 study points are required for a PhD. Of these, 25 points (or more) should be from a core<br />
curriculum courses, an additional 25 points should be from other courses or self studies in<br />
research relevant topics, and 10 points can be chosen freely. The Director of the Graduate<br />
program is Lars Karlsson, PhD.<br />
1.5.1 Core curriculum<br />
There are five courses that are given on a regular basis. These courses constitute the AASS<br />
core curriculum. They cover the different fields that are researched in AASS. In order to<br />
ensure that students acquire the interdisciplinary knowledge that characterizes AASS, the core<br />
courses are compulsory. The core courses are as follows:<br />
• AI for embedded systems. 5 points + 3 optional points for advanced studies.<br />
Teacher: Alessandro Saffiotti, Mobile Robotics Lab.<br />
• Soft computing for control. 5 points + 3 optional points for advanced studies.<br />
Teacher: Ivan Kalaykov, Intelligent Control Lab.<br />
• Embodied learning. 5 points + 3 optional points for advanced studies.<br />
Teacher: Tom Duckett, Learning Systems Lab.<br />
• Research Methodology for Computer Science and Engineering, 5 points,<br />
Teacher: Jan Gustafsson, Mälardalen University.
Annual Report <strong>2004</strong> 19<br />
1.5.2 Occasional courses<br />
The core courses are complemented by courses that are provided on a more occasional basis -<br />
on request - when a visiting researcher provides for such an opportunity, or when a subject of<br />
interest is covered by a graduate course at another university. During <strong>2004</strong>, one occasional<br />
course was given:<br />
• Introduction to Markov Decision Processes. Teacher: Lars Karlsson.<br />
1.5.3 Self-study course work<br />
This type of course work is done within supervised self-study circles (smaller courses), or<br />
individual studies. There was one organized study circle:<br />
• Introduction to reinforcement learning. Teacher: Tom Duckett.<br />
1.5.4 Cooperation with other graduate programs<br />
As recognition of the research effort at AASS, Örebro University has become one of the<br />
participants in CUGS (the Swedish National Graduate School in Computer Science). CUGS is<br />
commissioned by the Swedish government and the Swedish Board of Education and Lars<br />
Karlsson is a member of the CUGS steering Committee.<br />
Because of CUGS, AASS students have now the additional possibility to get enrolled as<br />
CUGS students or to follow some courses of interest provided by the CUGS study program.<br />
Currently, 2 students from the Mobile Robotics Laboratory are enrolled in CUGS, receiving a<br />
total funding of 700,000 SEK:<br />
• Robert Lundh (topic: cooperative robotics, supervisor: Alessandro Saffiotti)<br />
• Kevin Leblanc (topic: cooperative anchoring, supervisor: Alessandro Saffiotti)<br />
The scientific scope of CUGS includes central parts of the core computer science (sv.<br />
datalogi) and computer engineering (sv. datorsystem). In this regard, CUGS puts an emphasis<br />
on programming languages, algorithms, software engineering, also including related areas of<br />
autonomous systems, real-time systems, embedded systems, knowledge-based systems and<br />
artificial intelligence. Other members of CUGS are the universities/university colleges in<br />
Linköping (host), Lund, Mälardalen, and Skövde.<br />
AASS offered one advanced graduate course for CUGS:<br />
• Introduction to Markov Decision Processes. Teacher: Lars Karlsson.<br />
Detailed information about CUGS can be found at:<br />
http://www.ida.liu.se: 9080/groups/cugs/FrontPage.<br />
1.5.5 European graduate programs<br />
As recognition for the quality of its graduate education and research The European<br />
Commission 2002 has granted AASS the status of a Marie Curie Training Site in the area of<br />
Autonomous Robotics. The Commission, during the next four years, will provide the funding<br />
necessary for accommodating PhD students from European countries for periods of stay<br />
between 3 and 12 months. During their stay at AASS the guest-students will participate in
20 AASS – Center for Applied Autonomous Sensor Systems<br />
projects related to AASS research and also take courses offered within the AASS Graduate<br />
Program. Prof. D. Driankov is the responsible coordinator for the program.<br />
During <strong>2004</strong> we have had 3 Marie Curie Fellows:<br />
• André Treptow, Tuebingen University, Department of Computer Science, Jul.-Oct. <strong>2004</strong>,<br />
Active Recognition of People by Mobile Robots.<br />
• Peter Biber, Tuebingen University, Department of Computer Science,<br />
August-November <strong>2004</strong>, Lifelong SLAM by Mobile Robots.<br />
• Cipriano Galindo. University of Malaga, Spain. Period: Sep-Nov <strong>2004</strong><br />
(3 months). Research projects: Hybrid Maps and Perceptual Anchoring.<br />
More information regarding the Marie Curie Training Programs can be found at:<br />
http://improving.cordis.lu/mc<br />
1.5.6 Graduate students<br />
Biologically Inspired Systems Lab<br />
PhD-student First advisor Second Employed at Enrolled at<br />
advisor<br />
Lindquist, Peter Wide Boyko Iliev ÖU ÖU<br />
Malin<br />
Robertsson, Peter Wide Boyko Iliev ÖU ÖU<br />
Linn<br />
Spännar , Jan Peter Wide George Fodor Högskolan<br />
Dalarna<br />
ÖU<br />
Mobile Robotics Lab<br />
PhD-student First advisor Second Employed at Enrolled at<br />
advisor<br />
Bouguerra, Alessandro Lars Karlsson ÖU ÖU<br />
Abdelbaki Saffiotti<br />
Buschka, Pär Alessandro Tom Duckett ÖU ÖU<br />
Saffiotti<br />
Loutfi, Amy Alessandro Silvia ÖU ÖU<br />
Saffiotti Coradeschi<br />
Larsson, Alessandro Mathias Atlas Copco ÖU<br />
Johan Saffiotti Broxvall<br />
Lundh,<br />
Robert<br />
Alessandro<br />
Saffiotti<br />
Lars Karlsson ÖU ÖU and<br />
CUGS<br />
LeBlanc,<br />
Kevin<br />
Alessandro<br />
Saffiotti<br />
Silvia<br />
Coradeschi<br />
ÖU ÖU and<br />
CUGS<br />
Pettersson, Alessandro Lars Karlsson ÖU ÖU<br />
Ola Saffiotti<br />
Wasik, Alessandro Dimiter ÖU ÖU
Annual Report <strong>2004</strong> 21<br />
Zbigniew Saffiotti Driankov<br />
Pencz, Jack Alessandro Silvia<br />
Saffiotti Coradeschi<br />
Intelligent Control Lab<br />
ÖU<br />
ÖU<br />
PhD-student First advisor Second Employed at Enrolled at<br />
advisor<br />
Jennergren, Ivan Anani SIK ÖU<br />
Lars Kalaykov Ananiev<br />
Thomas George Fodor Ivan ÖU ÖU<br />
Uppgård<br />
Kalaykov<br />
Lindkvist, George Fodor Peter Wide ÖU ÖU<br />
Christer<br />
Tolt, Gustav Ivan Dimiter ÖU ÖU<br />
Kalaykov Driankov<br />
Skoglund,<br />
Alexander<br />
(50%)<br />
Ivan<br />
Kalaykov<br />
Tom Duckett ÖU ÖU<br />
Soron, Mikael Ivan<br />
Kalaykov<br />
Learning Systems Lab<br />
Anani<br />
Ananiev<br />
Esab Welding<br />
Equip. AB<br />
PhD-student First advisor Second Employed at Enrolled at<br />
advisor<br />
Andreasson, Alessandro Tom Duckett ÖU ÖU<br />
Henrik Saffiotti<br />
Martin Dimiter Tom Duckett Aerotech ÖU<br />
Persson Driankov<br />
Telub AB<br />
Cielniak, Peter Wide Tom Duckett ÖU ÖU<br />
Grzegorz<br />
Jun, Li Peter Wide Tom Duckett ÖU ÖU<br />
Magnusson, Alessandro Tom Duckett Atlas Copco ÖU<br />
Martin Saffiotti<br />
Skoglund, Ivan Tom Duckett ÖU ÖU<br />
Alexander<br />
(50%)<br />
Kalaykov<br />
Munkevik,<br />
Per<br />
Peter Wide Tom Duckett SIK ÖU<br />
Officially registered as PhD-students by the end of February <strong>2004</strong>.<br />
ÖU
22 AASS – Center for Applied Autonomous Sensor Systems<br />
1.5.7 PhD theses<br />
During <strong>2004</strong> one PhD thesis was defended:<br />
• Ola Pettersson. Model-free Execution Monitoring in Behaviour-based Mobile Robots.<br />
PhD Thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />
1.5.8 Licentiate theses<br />
During <strong>2004</strong> the following licentiate theses were completed:<br />
• Jennergren, Lars. Flexible Assembly of Ready-to-eat Meals. Licentiate thesis, Örebro<br />
University Studies in Technology Series, <strong>2004</strong>.<br />
• Jun, Li. Towards Online Learning of Reactive Behaviours in Mobile Robotics. Licentiate<br />
thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />
• Lindquist, Malin, Electronic Tongue for Water Quality Assessment. Licentiate thesis,<br />
Örebro University Studies in Technology Series, <strong>2004</strong>.
Annual Report <strong>2004</strong> 23<br />
1.6 Co-operation<br />
The AASS research effort builds upon two types of co-operation: industrial and academic.<br />
The former one is of two types: 1) KK-Foundation related according to the 1-to-1 funding<br />
scheme and supports general research themes in autonomous systems and may, or may not<br />
include specific industrial projects; and 2) VINNOVA Robotdalen related, which involves<br />
specific industrial projects. The academic co-operation has both national and international<br />
dimension.<br />
1.6.1 Industrial cooperation: KK-Foundation related<br />
The following industrial companies and the related to those companies’ activities constitute<br />
the basis for the 1-to-1 funding required by the KK-Foundation:<br />
• ABB Automation Technology Products AB/Robotics: the company sponsors AASS with<br />
equipment (flex-picker robot and IRB140), software and software support and the main<br />
receiver is the Intelligent Control Systems lab:<br />
• ABB Automation Technology Products AB/Instrumentation and Control: i) a visiting<br />
professor (adjungerad prof. G. Fodor) from the company supervises 2 AASS PhD<br />
students, ii) one of those (Thomas Uppgård) being an industrial PhD student with AASS;<br />
iii) one of the company's engineers (with a PhD degree from AASS, P. Bergsten) works<br />
part time at AASS on the subject of fuzzy control. In addition they sponsor with<br />
equipment and licenses.<br />
• FFV Aerotech Telub AB, Örebro: an industrial PhD student (Martin Persson) works in the<br />
project Semi-Autonomous Mapping (SAM) by UAV-UGV Cooperation at the Learning<br />
Systems Lab. January 2005 another industrial PhD student (Christer Wahlgren) started his<br />
PhD studies at AASS.<br />
• DELFOI (Göteborg): the company has provided AASS with licences for the use of the<br />
software products related to digital 3D manufacturing solutions as well as the training<br />
courses needed for the use of those products. The software is used in the IC lab projects<br />
on flexible assembly of ready-to-use food, i.e., flexible food-cell and sensory analysis in<br />
the food-factory-of-the-future.<br />
• AssiDomän (Frövi): the company provided equipment (vision platform) for the project<br />
“Behaviour-based mobile manipulation'' at the MR Lab; Torbjörn Widmark, employed<br />
with the company, chairs the AASS Reference Group and is thus very much involved in<br />
the organization and the proceedings of the two <strong>annual</strong> meetings of the Reference group.<br />
• SIK, Göteborg, Sweden (a research organization in the area of automation in food<br />
manufacturing): 2 SIK/AASS PhD students (Lars Jennergren and Per Munkevik) work on<br />
projects in the IC Lab and LS Lab regarding robotics technologies for the food-factory-ofthe-future.<br />
Lars Jennergren finished his Lic. Thesis during <strong>2004</strong>.
24 AASS – Center for Applied Autonomous Sensor Systems<br />
1.6.2 Industrial cooperation: VINNOVA-Robotdalen related<br />
The following Robotdalen projects have been running at AASS during <strong>2004</strong>:<br />
• Robot station friction stir welding: the project involves a cluster of industrial companies in<br />
Laxå (Esab Welding Equipment AB, Specma Automation AB, ABB-Laxå) and the IC Lab<br />
at AASS represented by one industrial PhD student and Prof. I. Kalaykov.<br />
• Navigation system for automated loaders: the project involves Atlas Copco Rock Drills<br />
AB (Örebro), Volvo Construction Equipment (Eskilstuna), and the MR Lab at AASS<br />
represented by one industrial PhD student and Prof. A. Saffiotti.<br />
• Tunnel profile scanner: the project involves Atlas Copco Rock Drills AB (Örebro), Optab<br />
Optronikinnovation AB (Karlskoga), and the LS Lab at AASS represented by one<br />
industrial PhD student and Dr. T. Duckett.<br />
• Teknikspridning och kompetenshöjning: the focus of the project is on: i) the dissemination<br />
of knowledge about robotics and related technical systems aimed at schools in the Örebroregion;<br />
ii) further education of school teachers in the area of robotics; and iii) girls-intechnology<br />
efforts. The project involves KomTek (Örebro, Laxå and Karlskoga),<br />
industrial companies (ESAB, ABB, Lasertech) and AASS as a whole, where E. Liljedahl<br />
is the project co-ordinator.<br />
1.6.3 National Co-operation<br />
1.6.3.1 Scientific cooperation<br />
• WITAS-project (unmanned helicopter), Univ. of Linköping, Dept. of Computer Science:<br />
development of Takagi-Sugeno fuzzy model based visual servoing controllers for<br />
unmanned aerial vehicles.<br />
• Mälardalens högskola, Västerås: development of Vision on Chip system for robotic<br />
applications, funded by Robotdalen.<br />
• SIK, Göteborg: development of robotic technologies for the Food Factory of the Future.<br />
1.6.3.2 National networks, societies, programs<br />
• Founding member of the VINNOVA Robotdalen program<br />
• Coordinator of Team Sweden (team of 3 univ: Lund Univ., Blekinge Institute of<br />
Technology, Orebro Univ.).<br />
• Member of CUGS (participating with two PhD students).<br />
• Member of SLSS (Swedish Learning Systems Society).<br />
• Member of the Swedish IEEE chapter on Signal Processing.<br />
• Affiliated to LiFT (Livsmedelsproduktion med Framtidens Teknologier) - industryoriented<br />
Swedish programme for research and PhD education.<br />
• Member of SWIRA (Swedish Industrial Robotics Association)
Annual Report <strong>2004</strong> 25<br />
1.6.4 International Cooperation<br />
1.6.4.1 EC Networks/Programs<br />
AASS researchers are members and participate in the work of a number of EU networks and<br />
programs:<br />
• The European Community Network of Excellence on Robotics Research (EURON)<br />
Cooperative Robotics coordinator.<br />
• The European Community Thematic Network on Walking and Climbing Robots<br />
(CLAWAR II).<br />
• Marie Curie Training Site (coordinator).<br />
• SCIP Working Group (Soft Computing in Image Processing,<br />
http://fuzzy.rug.ac.be/SCIP/).<br />
1.6.4.2 Participation in scientific events (more info on participation to be found in the<br />
project descriptions from Section 2)<br />
• IASTED Conf. on Visualization, Imaging and Image Processing, Marbella, Spain, <strong>2004</strong>.<br />
• FUZZ-IEEE Conference, Budapest, 27-29 July <strong>2004</strong>.<br />
• IFAC Symposium on Intelligent Autonomous Vehicles, 5-7 July, Lisbon, Portugal, <strong>2004</strong>.<br />
• Second IEEE International Conference on Industrial Informatics, INDIN'04, 24-26 June,<br />
Berlin, Germany, <strong>2004</strong>.<br />
• The 30-th IEEE Annual Conference on Industrial Electronics IECON <strong>2004</strong> Conference,<br />
Nov. 2-6, <strong>2004</strong>, Busan, Korea.<br />
• ICEF9 International Conference on Engineering and Food, Montpellier, France, 7-11<br />
March, <strong>2004</strong>.<br />
• International Conference on Intelligent Manipulation and Grasping, Genoa, Italy, 1-2 July,<br />
<strong>2004</strong>.<br />
• Food Factory <strong>2004</strong> Conference, France, 6-8 October, <strong>2004</strong>.<br />
• International Conference on Mechatronics and Robotics ’04, Aachen, Germany, 13-15<br />
September <strong>2004</strong>. International Conference on Climbing and Walking Robots<br />
CLAWAR’04, Madrid, Spain<br />
1.6.4.3 Scientific cooperation<br />
AASS’s scientific partnerships are reflected in the project descriptions from Section 2. Each<br />
scientific partnership also includes visits from/to AASS.<br />
1.6.5 Services to the research community<br />
1.6.5.1 Membership in professional organizations/societies/management-bodies<br />
- The Board of Trustees of the RoboCup International Federation.<br />
- The Advisory Board of the International Conference on AI.<br />
- The European Coordinating Committee for Artificial Intelligence (ECCAI).
26 AASS – Center for Applied Autonomous Sensor Systems<br />
- The Scandinavian RoboCup Committee.<br />
- Executive committee of the International RoboCup Federation.<br />
- Membership in IEEE Computer Soc.; the IEEE Robotics and Automation Soc.; the IEEE<br />
System, Man and Cybernetics Soc.<br />
- The American Assoc. for Artificial Intelligence.<br />
- The Intelligent Autonomous Systems Soc.<br />
- IEEE CSS/SP societies; SPIE and EUSFLAT.<br />
- AAAI (American National Association for Artificial Intelligence).<br />
- SLSS member (Swedish Learning Systems Society).<br />
- EvoNet - The Network of Excellence in Evolutionary Computing.<br />
- International Association for Pattern Recognition.<br />
- IEEE - Institute of Electrical and Electronics Engineers.<br />
- SSAB - Swedish Society for Automated Image Analysis.<br />
- The Swedish Learning Systems Group.<br />
- The Board of SWIRA, Swedish Industrial Robot Association.<br />
- The Örebro University board.<br />
- The Faculty board (Natural Science, Technology and Medicine).<br />
- The Institutional board (Department of Technology) – two members.<br />
- IEEE Technical Committee on Intelligent Control, Section: Fuzzy Control.<br />
- Editorial Board International Journal of Uncertainty, Fuzziness, and Knowledge-Based<br />
Systems, World Scientific Publ.<br />
- Editorial Board Journal of Systems Architectures, The Euromicro Journal, Elsevier.<br />
- Advisory Board of the Electrical and Computer Science Department, Western Michigan<br />
University, USA.<br />
- IEEE Instrumentation & Measurement society - Chairman Technical Committee TC 27.
Annual Report <strong>2004</strong> 27<br />
1.6.5.2 Organization of scientific events<br />
AASS researchers have participated in at least a dozen Program/Organizing Committees,<br />
evaluation of EU FP6 projects and served as reviewers for numerous international journals<br />
and scientific events.
28 AASS – Center for Applied Autonomous Sensor Systems<br />
1.7 Dissemination of information<br />
The dissemination of information pertaining to AASS activities has the overriding goal to<br />
establish a firm and clear identity and acceptance of the AASS research profile, its industrial<br />
relevance, and societal contributions.<br />
To achieve the above goal our dissemination of information activities are towards the<br />
following three audiences:<br />
A. Industry, public authorities, and research funding bodies;<br />
B. Research community and university students; and<br />
C. General public<br />
Further information about our goals and philosophy regarding dissemination of information<br />
you can find in our Information Policy for 2005.<br />
1.7.1 Activities during March <strong>2004</strong>-February 2005<br />
FAIRS<br />
Activity Time Performance Target group<br />
Technical fair for<br />
women, Örebro<br />
AAAI-<strong>2004</strong><br />
Workshop<br />
Robotdalens dag,<br />
Örebro<br />
Technical fair,<br />
Stockholm<br />
040307-08 Presentation by Amy Loutfi “Putting<br />
A, C<br />
Olfaction into Action: Using electronic<br />
noses with artificial sensor systems.”<br />
040626 Arranged by A.Saffiotti and S.Coradeschi. B<br />
040909 Presentation of projects and co-operation<br />
that AASS is involved within the<br />
Robotdalen project. E. Liljedahl, A.<br />
Skoglund, B-L Silfverdal, P.Sporrong,<br />
B.Alvin<br />
041019-23 Participation in Robotdalens stand,<br />
demonstration of robot dogs and<br />
presentation of AASS and PhD-studies, by<br />
Mikael Soron and Kevin LeBlanc.<br />
A<br />
A, B
Annual Report <strong>2004</strong> 29<br />
VISITS<br />
Activity Time Performance Target group<br />
Study visit 040129 School class from Alléskolan åk 3,<br />
C<br />
Hallsberg. Introduction to AASS’ robots,<br />
research and education. Tom, Ivan, Henrik,<br />
Mathias, Gustav, Kevin<br />
Study visit 040202 Tullängsskolan, Elektro åk 3. Introduction C<br />
to AASS’ robots, research and education.<br />
Tom, Ivan, Henrik, Mathias, Gustav, Kevin<br />
Study visit 040205 Alléskolan åk 3, Hallsberg. Introduction to C<br />
AASS’ robots, research and education.<br />
Tom, Ivan, Henrik, Mathias, Gustav, Kevin<br />
Study visit 040209 Study visit by school class (Year 3,<br />
C<br />
Tullängsskolan, Örebro), Tom, Ivan,<br />
Henrik, Mathias, Gustav, Kevin<br />
Study visit 040212 Study visit by school class (Year 3,<br />
C<br />
Alléskolan, Hallsberg), Tom, Ivan, Henrik,<br />
Mathias, Gustav, Kevin<br />
Visit 040226 Presentation for representatives from the A<br />
KK-foundation<br />
Demonstration 040315 Presentation by Amy Loutfi for Susan<br />
A<br />
Kennarl from the Banft Centre,Canada<br />
Demonstration 040318 Lab demonstration for representatives from B, C<br />
Karlstads university (the Education and<br />
Research department), 35 people<br />
Study visit 040420 Study visit by school class (D8,<br />
C<br />
Vivallaskolan, Örebro), 20 pupils,<br />
Alexander Skoglund<br />
Presentation 040422 Presentation for Kristian Luuk by Amy C<br />
Loutfi<br />
Study visit 040503 Lab presentations for professor Jim Little, B<br />
Computer Science, UBC.<br />
Study visit 040505 Study visit by school class (Vivallaskolan, C<br />
Örebro), 40 pupils, Alexander Skoglund<br />
Study visit 040616 Study visit by Young Entrepreneurs, 25 C<br />
pupils from gymnasiums all over Sweden<br />
participation in an <strong>annual</strong> competition in<br />
Örebro, Henrik Andreasson<br />
Study visit June Study visit by KomTek Laxå summer<br />
C<br />
school for girls (7 pupils), Alexander<br />
Skoglund<br />
Study visit 040929 Study visit by school class from<br />
C<br />
Vivallaskolan, Örebro (20 pupils),<br />
Alexander Skoglund<br />
Visit at Örebro 041004 Presentation of AASS and Robotdalen by A
30 AASS – Center for Applied Autonomous Sensor Systems<br />
university by local<br />
Ester Liljedahl<br />
politicians<br />
Study visit 041018 Study visit by school class from<br />
Vivallaskolan, Örebro (20 pupils),<br />
Alexander Skoglund<br />
Study visit 041019 Study visit by school class from<br />
Vivallaskolan, Örebro (20 pupils),<br />
Alexander Skoglund<br />
Study visit 041021 Study visit by school class from<br />
Vivallaskolan, Örebro (15 pupils),<br />
Alexander Skoglund<br />
Visit 041105 NIROS-demonstration, Dimiter Driankov<br />
and Mathias Broxvall<br />
C<br />
C<br />
C<br />
A,C<br />
OTHER PRESENTATIONS<br />
Activity Time Performance Target group<br />
Annual graduate 040123 Presentation of research topics by graduate B<br />
symposium at AASS<br />
students<br />
Annual academic February Public lecture by Ivan Kalaykov C<br />
festivities, Örebro<br />
Annual Report March Annual Report 2003 was published on A and B<br />
AASS web and sent out to different<br />
contacts.<br />
RoboCup 040627- Competitions with the Robotic dogs and B,C<br />
040705 seminars. Alessandro, Kevin<br />
Doctoral dissertation 041001 Ola Peterssons doctoral dissertation<br />
A, B<br />
”Model-Free Execution Monitoring in<br />
Behaviour-Based Mobile Robotics” was<br />
presented<br />
Licentiate dissertation 041001 Lars Jennergrens licentiate dissertation A, B<br />
“Flexible Assembly of Ready-to-eat Meals”<br />
was presented<br />
Research folder October AASS research folder was updated (in time A, B<br />
for the Technical fair in Stockholm)<br />
Visit by Invest in<br />
Sweden Agency<br />
041012 Presentation of AASS and Robotdalen by<br />
Dimiter Driankov and Ester Liljedahl,<br />
arranged by Business Region Örebro at<br />
A<br />
Seminar “Roads to<br />
technology”, Örebro<br />
university<br />
No Limits<br />
Annual academic<br />
festivities (årshögtid)<br />
Atlas Copco, Örebro<br />
041021 Presentation of summer school for girls by<br />
Ester Liljedahl<br />
November Participation in First Lego Leaguecompetition,<br />
in co-operation with the<br />
Örebro community technical school<br />
February Public lecture by Ola Pettersson and<br />
received his doctor’s degree<br />
C<br />
A, B
Annual Report <strong>2004</strong> 31<br />
PRESS RELEASES<br />
During the year press releases were sent out and also published on Örebro universities web<br />
(http://www.oru.se/templates/oruExtNormal____19607.aspx).<br />
Time Subject Target group<br />
<strong>2004</strong>-09-08 Ola Petterssons doctoral dissertation *) (Robotar kan lära av A, B<br />
sina misstag)<br />
<strong>2004</strong>-09-06 Robotdalens dag (Robotar ökar tillväxten) A<br />
<strong>2004</strong>-08-02 Summer course for girls (Legorobotar lockar tjejer till<br />
teknikstudier)<br />
C<br />
*) The press release about Ola Petterssons dissertation was also translated into English by the<br />
Swedish Research Council (Vetenskapsrådet) and sent out internationally.<br />
MEDIA<br />
Activity Time Performance Target group<br />
Nerikes Allehanda March Article about Amy Loutfis research A, B<br />
Nerikes Allehanda March Article about KK-foundation supporting A, B, C<br />
research at Örebro university<br />
Örebrokuriren August Article about summer course for girls<br />
A, C<br />
(before the course)<br />
Örebrokuriren August Article about summer course for girls (after A, C<br />
the course)<br />
TV4 Bergslagen August News presentation about summer course for A, C<br />
girls<br />
OruMagasinet 12/<strong>2004</strong> Article about Amy Loutfi and her research A, B, C<br />
www.oru.se, Nyheter September Article about Robotdalens dag A, B, C<br />
Nerikes Allehanda September Article about an industrial co-operation A<br />
within Robotdalen (published the day before<br />
Robotdalens dag)<br />
Nerikes Allehanda September Robotdalens dag (from the day) A, C<br />
Örebrokuriren September Robotdalens dag (about the day) A, C<br />
The European<br />
Commissions<br />
Research website<br />
(http://europa.eu.int/c<br />
omm/research/headlin<br />
es/news/article_04_09<br />
_27_en.html<br />
September Article about Ola Petterssons doctoral<br />
dissertation ” Model-Free Execution<br />
Monitoring in Behaviour-Based Mobile<br />
Robotics”<br />
A, B<br />
Mobile Robotics news<br />
website<br />
(www.mobilerobotics.<br />
org/robots/)<br />
September Article about Ola Petterssons doctoral<br />
dissertation ” Model-Free Execution<br />
Monitoring in Behaviour-Based Mobile<br />
Robotics”<br />
www.oru.se/aass October Article and information about AASS<br />
participation at the Technical fair in<br />
Stockholm<br />
A, B<br />
A
32 AASS – Center for Applied Autonomous Sensor Systems<br />
www.robotdalen.org October Article and pictures from Robotdalens stand A<br />
at the Technical fair<br />
Nerikes Allehanda November Article from First Lego League-competition C<br />
Nerikes Allehanda, November Article about research funds from the<br />
A, B<br />
www.oru.se (som<br />
forskningsnyhet) and<br />
www.oru.se/aass<br />
Swedish Research council to a project at<br />
AASS run by Silvia Coradeshi.<br />
www.oru.se November Article about study visits for pupils at<br />
C<br />
AASS during October.<br />
Nerikes Allehanda February Article about public lecture by Ola<br />
C<br />
Pettersson at <strong>annual</strong> academic festivities<br />
Nerikes Allehanda February Article about Robotdalen co-operation A<br />
In September <strong>2004</strong> AASS new web (www.oru.se/aass) was published. From September <strong>2004</strong> –<br />
February 2005 17 articles were published covering seminars, research and activities that<br />
AASS participated in (http://www.oru.se/templates/oruExtNormal____21544.aspx).<br />
1.7.2 Industry, public authorities, and research funding bodies<br />
Well-established means for disseminating information about AASS research results and their<br />
industrial potential amongst these parts of the Swedish industry that can directly/indirectly<br />
benefit from it are:<br />
- Joint projects: See section 1.6.4.3<br />
- Industrial PhD students: See section 1.6.1<br />
- AASS Seminars: See section 1.7.5.1<br />
- Industrial fairs and exhibitions: See 1.7.1<br />
- Industrial associations and interest groups: Robotdalen, SWIRA, SIK,<br />
OIC (Orebro Innovation Centre), NIROS<br />
1.7.3 Research Community and university students<br />
Disseminating information about AASS research profile and its educational role and potential<br />
is done via the traditional dissemination channels, such as:<br />
- Publications<br />
- Conference participation<br />
- Organisation of scientific events<br />
- AASS guest-researchers, guest-students, and visits<br />
- National/international networks<br />
- Joint research projects<br />
1.7.4 General Public<br />
The general public and various civil authorities are informed via the web, public lectures, and<br />
media presence such as newspaper articles. AASS had several articles in the University's<br />
magazine, which is spread to more than 2000 companies and organizations. We also arranged<br />
several "open houses" with demos for the general public as well as public seminars that we<br />
have regularly see 1.7.1 and 1.7.5.1.
Annual Report <strong>2004</strong> 33<br />
Seminars<br />
1.7.5.1 Regular AASS Seminars<br />
Schedule for March <strong>2004</strong>- February 2005<br />
Date Speaker Title of seminar<br />
040301 Prof. Gurvinder S. Smelling mobile robots<br />
Virk, University of<br />
Leeds, UK<br />
040308 Mathias Broxvall,<br />
AASS<br />
Have another look: On Failures and Recovery Planning in<br />
Perceptual Anchoring<br />
041001 Joachim Hertzberg, Towards Cognitive Robotics in 7D<br />
Osnabrück University,<br />
Germany<br />
041011 André Treptow,<br />
Tübingen University,<br />
Germany<br />
Active People Recognition Using Thermal and Grey<br />
Images on Mobile Robots<br />
041011 Cipriano Galindo,<br />
University of Malaga,<br />
Spain<br />
Modelling robot environments through a multihierarchical<br />
fashion: the Multi-AH-graph model<br />
041012 Rainer Palm Multi-step-ahead prediction in control systems using<br />
Gaussian Processes and TS-Fuzzy Models<br />
041122 Peter Biber, Tübingen<br />
university, Germany<br />
Dynamic Maps for Long-Term Operation of Mobile<br />
Service Robots<br />
041213 Tom Ziemke, Skövde Agent-environment state machines<br />
university, Sweden<br />
050110 Abdelbaki Bouguerra Execution failure recovery in mobile robotics: a survey<br />
050214 Henrik Andreasson,<br />
PhD-student AASS<br />
Improving model extraction by fusing Vision and 3D<br />
laser data
34 AASS – Center for Applied Autonomous Sensor Systems<br />
2. Research Labs<br />
At the present time AASS consists of four research laboratories that have joined their<br />
expertise to cover and integrate the broad spectrum of scientific disciplines needed for the<br />
design and implementation of industrially relevant autonomous systems. This would be<br />
practically impossible for any individual laboratory, but is achievable by a joint effort, which<br />
is organized in the form of AASS. This joint effort is aimed not only at expanding the<br />
frontiers of the science of autonomous sensor systems, but also gradually incorporating it in<br />
the graduate and undergraduate curriculum, and producing physical demonstrators of<br />
autonomous sensor systems with industrial and educational relevance.<br />
The common scientific denominator for the four research laboratories is the subject of<br />
"perception and autonomy in diverse un- and/or semi-structured environments''. We<br />
pursue this subject using a common research methodology, which is strictly applied: all<br />
technologies that we investigate should answer actual needs that emerge from an application,<br />
and their effectiveness is always validated on the application.<br />
Note that under each research project funding by KK-Foundation implies corresponding<br />
amount of support from the following companies:<br />
• ABB Automation Technology Products AB/Robotics,<br />
• ABB Automation Technology Products AB/Instrumentation and control<br />
• FFV Aerotech Telub AB<br />
• DELFOI<br />
• AssiDomän<br />
• SIK
Annual Report <strong>2004</strong> 35<br />
2.1 Biologically Inspired Systems Lab<br />
Our objective is to advance the state-of-the-art in the area of biologically inspired sensing,<br />
perception and control systems. That is, the development of sensors, actuators and methods<br />
for sensory information perception and fusion that mimic the structure and capabilities of<br />
biological systems. Achieving this objective would provide, on one hand, more reliable and<br />
accurate measurement and quality assessment devices. On the other hand, it contributes to the<br />
development of artificial intelligent systems, helping humans to avoid repetitive, unskilful,<br />
and hazardous tasks. Our current research activities are focused in two major directions:<br />
biologically inspired sensing and information fusion, and dexterous manipulation.<br />
2.1.1 Research directions<br />
• Sensing and information fusion<br />
We design robust and compact sensors, which are able to<br />
perform human-like smell- and taste sensing in a variety of<br />
real world environments. To complement the sensors<br />
systems, we also investigate methods for pattern recognition,<br />
sensory information fusion and active perception.<br />
The projects in this direction include electronic tongues for<br />
online quality assessment of water and food products. A<br />
further extension of this concept is the artificial sensory head<br />
which is equipped with sensors, related to the five primary<br />
human senses (taste, smell, sound, vision and touch).<br />
• Dexterous manipulation<br />
This research direction addresses different aspects of the control of a five-fingered artificial<br />
hand, ranging from actuator control to grasping and manipulation. The objective of the project<br />
is to develop new methods for dexterous manipulation in complex, unstructured environments<br />
by mimicking the way humans use their hands. To deal with the high complexity of the<br />
problem, we will employ a biologically inspired motor control scheme, tightly integrated with<br />
the sensing and perception part of the system. The artificial hand can be used as a research<br />
platform for advanced robotic applications or as a test bed for development of prosthetic<br />
devices.
36 AASS – Center for Applied Autonomous Sensor Systems<br />
2.1.2 Research Projects in <strong>2004</strong><br />
Project: Electronic tongue for water quality assessment, J413.<br />
Project leader: Peter Wide<br />
Staff: Malin Lindquist, Boyko Iliev<br />
Funding: KK-foundation and Faculty<br />
Partners: HVR Water Purification<br />
Synopsis:<br />
The project belongs to the research area of Sensing and Information Fusion. The objective is<br />
to build up a new integrated, robust, reliable, low mass/power, electronic tongue for water<br />
quality assessment. It can be used in an under water vehicle (or robot) in order to provide real<br />
time water quality monitoring in drinking water reservoir. Previous version of the electronic<br />
tongue included four electrodes: gold, platinum, iridium and rhodium and a reference<br />
electrode. Relays are used to switch between the different electrodes. Since the reference<br />
electrode was made of fragile glass, it was not suitable for use in mobile platforms. The new<br />
tongue will be made of a stainless steel tube including two gold and platinum electrodes<br />
placed on its inner part. To measure a sample, the water must fill up the tube. A second<br />
prototype of the tongue will be adapted for continuous quality monitoring of streaming water.<br />
In this version, the complementing electronic unit will perform all necessary data processing<br />
and inform the user about the quality with the help of light signals. The project will end in<br />
2005.<br />
Results in <strong>2004</strong>:<br />
- Licentiate thesis of Malin Lindquist;<br />
- A more robust version of the electronic tongue for water quality assessment is developed<br />
and tested.<br />
- One article presented on Sensors for Industry Conference, SICON’04, New Orleans,<br />
USA, Feb <strong>2004</strong>.<br />
- One article presented on International Measurement Technology Conference IMTC’04,<br />
Como, Italy, July <strong>2004</strong>.<br />
Future developments:<br />
- Extensive reliability testing and evaluation in different working conditions, including<br />
measurements of streaming water.<br />
- Water quality assessment application in real environment.<br />
- Completion of the doctoral thesis of Malin Lindquist.
Annual Report <strong>2004</strong> 37<br />
Project: Electronic tongue for food quality assessment, J423<br />
Project leader: Boyko Iliev<br />
Staff: Malin Lindquist, Peter Wide<br />
Funding: Faculty and KK-foundation<br />
Partners: None<br />
Synopsis:<br />
The project belongs to the research area of Sensing and Information Fusion. The objective is<br />
to build up an electronic tongue, which could be adaptable to the structural and functional<br />
constraints of the new artificial sensory head. This tongue will also be used to test the mixture<br />
of tastes. Therefore its output will be separately subjected to the wavelet transform based<br />
feature extraction and to the hybrid ANN based classification method. Study and<br />
implementation of the human-like cognitive perspective to the linguistic descriptions of the<br />
taste is envisaged. This project is closely connected to the development of the electronic<br />
tongue for water quality assessment since the projects share certain hardware and software<br />
components. The main difference between the projects come from the fact that the variation<br />
in the content of food samples is much higher than in water samples. This requires dedicated<br />
solutions for both the measurement procedure and data analysis. Currently, the focus of the<br />
project has shifted towards the more general problem of food quality assessment and is no<br />
longer restricted to the artificial head platform. Therefore, the work will continue during<br />
2005.<br />
Results in <strong>2004</strong>:<br />
- A methodology for testing solid food samples is under development. Initial experiments<br />
with baby food were performed.<br />
- An algorithm for online quality assessment based on fuzzy logic.<br />
- One article submitted.<br />
Future developments:<br />
- Refinement of the methodology for measurements of solid food products.<br />
- Feature extraction technique based on wavelet transform, which is able to deal with the<br />
high variations in content of the food samples.
38 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Artificial sensory head, J439<br />
Project leader: Boyko Iliev<br />
Staff: Linn Robertsson, Peter Wide<br />
Funding: Faculty and KK-foundation<br />
Partners: Intelligent Control Lab<br />
Synopsis:<br />
The project belongs to the Sensing and Information Fusion research direction. The objective<br />
is to complete the artificial sensory head by equipping it with sensors, dedicated to the five<br />
primaries human-like senses, so it can be used for food quality assessment. However, the<br />
whole system should also be considered as a common application platform for any sensory<br />
and/or data fusion based research activities. Our main goal is to bring the second version (2G)<br />
of the previous electronic head closer to its biological counterpart in the sense of sensation<br />
and perception processes. Furthermore, the sensing and clustering/classification algorithms<br />
will also be associated with facial expression by means of 3D facial animation software from<br />
Cambridge Research Laboratory. The project will be completed in 2005.<br />
Results in <strong>2004</strong>:<br />
- One conference article presented on Information Processing and Management of<br />
Uncertainty in Knowledge Based Systems, IPMU’04, Perugia, Italy, July <strong>2004</strong>.<br />
- Completed motion control and data acquisition modules.<br />
Future developments:<br />
- Experiments on food quality assessment and development of appropriate sensor fusion<br />
methods.<br />
- Experimental evaluation of perception and sensor fusion models.
Annual Report <strong>2004</strong> 39<br />
Project: Artificial Hand, J444<br />
Project leader: Boyko Iliev<br />
Staff: Rainer Palm<br />
Funding: Faculty<br />
Partners: Elumotion Ltd. UK, INSERM 483-Paris 6<br />
Synopsis:<br />
The project mainly belongs to the Dexterous Manipulation research area. The objective is to<br />
supply dexterous grasp capabilities for a 5-fingered anthropomorphic hand. The prototype<br />
hand has 15 joints (5DIP+5PIP+5MCP) and is equipped with force (tactile) and joint angle<br />
sensors. To achieve higher degree of anthropomorphism, electrically active polymer (EAP)<br />
artificial muscles will actuate the hand. Our goal is to implement intelligent sensory-motor<br />
control schemes for visually guided reach and grasp, which incorporates biological constraints<br />
in terms of architecture and behaviour. The work will be based on the interaction of four<br />
fundamental elements of movement control: 1) Task related anticipatory information<br />
concerning goal selection (Motion planning), 2) Visual information, 3) Tactile information,<br />
and 4) Execution related information. The hand design is such that it can be mounted on both<br />
already existing 6 degrees of freedom lightweight robot arms of the Intelligent Control Lab.<br />
Due to the serious technical problems of the currently available EAP muscles, the hand was<br />
actuated with electrical motors. However, if the capabilities of the future EAP muscles satisfy<br />
the performance requirements, they will be considered in an alternative actuation scheme. The<br />
project will continue in 2005.<br />
Results in <strong>2004</strong>:<br />
- New design specification of the hand, based on DC motors.<br />
- According to the new design, the hand has now 11 individually actuated degrees of<br />
freedom. Elumotion Ltd. Designed and installed the actuation stage.<br />
- Hand simulation environment and low-level control programs are developed.<br />
Future developments:<br />
- Completion of the control system of the hand.<br />
- Applications in sensor-based dexterous manipulation.
40 AASS – Center for Applied Autonomous Sensor Systems<br />
2.1.3 Staff<br />
Prof. Peter Wide received his MSc. Eng. and Licentiate-of-Technology degrees in 1984 and<br />
1987 from the Dept. of Measurement Technology, University of Linköping, Sweden. In<br />
parallel to his academic career he has worked in different electronic industries for more than<br />
15 years as test engineer, development manager, and technical consultant. He received his<br />
PhD in Measurement Science and Technology from Linköping University in 1996. Peter<br />
Wide has been a visiting researcher at the Siemens Corporate R & D Fuzzy Research<br />
Laboratory in Munich, Germany in 1994 and at the School of Information Technology and<br />
Engineering (SITE), University of Ottawa, Canada, in 1997.<br />
Peter Wide is one of the founders of the Centre for Applied Autonomous Sensor System,<br />
where he is now the director. During the last four years he has authored and co-authored<br />
about 60 conference/journal papers. He serves in the program committees of several<br />
international conferences and as a reviewer for IEEE-journals. He is an active member of the<br />
IEEE Instrumentation and Measurement (IM) Society. His professional interests are mainly<br />
related to the fields of sensors, feature extraction, sensor data fusion and quality<br />
measurements.<br />
Rainer Palm is Adjunct Professor at the Department of Technology (AASS), University<br />
Örebro since <strong>2004</strong>. Until <strong>2004</strong> he was a Principal Research Scientist in the Neural<br />
Computation Department of the Siemens Corporate Research Technology in Munich,<br />
Germany, working both in research projects and industrial applications of Automatic Control,<br />
Fuzzy Control, Modelling of Dynamic Systems, and Distributed Systems.<br />
He has been active as a control engineer since 1972 doing research and development in the<br />
field of testing machines for electronic devices. He received his Dipl. Ing. Degree from the<br />
Technical University of Dresden, Germany, in 1975. From 1982 on he worked in the robotic<br />
research area in particular in the field of sensor-guided robots. He received the Dr. Ing.<br />
Degree from the Humboldt-University Berlin, Germany, in 1981, and the Dr. sc. tech. degree<br />
from the Academy of Sciences, Germany, in 1989.<br />
Since 1991 Rainer Palm has held a position at the a fuzzy logic task force group at Siemens<br />
AG in which he developed several fuzzy control methods used in industrial prototypes and<br />
applications. Since 1992 he had a close co-operation with the Department of Computer<br />
Science, Linköping University, and since 1998 with the Department of Technology (AASS),<br />
University Örebro. He is author /co-author, editor/co-editor of 15 books or chapters in books,<br />
author/ co-author of 15 articles in journals, and author /co-author of 30 articles in Conference<br />
proceedings. He is also author / co-author of 14 patents. His research interests include<br />
automatic control, fuzzy control, and robotics.<br />
Boyko Iliev is a research associate at the Department of Technology (AASS), Örebro<br />
University. He received his M.Sc. in Control Systems Engineering from the Technical<br />
University, Sofia, Bulgaria in 1997. During the period 1997-1998 he worked as a research<br />
assistant at the Central Laboratory for Parallel Processing, Bulgarian Academy of Sciences. In<br />
October 1998 he became a graduate student at the Centre for Applied Autonomous Sensor<br />
Systems (AASS), Örebro University and received a Licentiate of Technology degree in 2002.<br />
He received the Ph.D. degree from Örebro University in <strong>2004</strong> in the area of Industrial<br />
Measurement Technology. Since March <strong>2004</strong> he is with the Centre for Applied Autonomous
Annual Report <strong>2004</strong> 41<br />
Sensors Systems and a leader of the Biologically Inspired Systems Lab. He is an author/coauthor<br />
of over 15 conference and journal publications.<br />
His research interests include fuzzy and sliding mode control, and biologically inspired<br />
systems and dexterous manipulation.<br />
Malin Lindquist was born in Örebro, Sweden on November 5, 1975. She received her MSc<br />
degree in automation engineering in 2001 from Örebro University. She has been a graduate<br />
student at the Centre for Applied Autonomous Sensor Systems, Örebro University, Sweden<br />
since 2000. Her current research interests are in biologically inspired sensors and specifically<br />
electronic tongues. She received a Licentiate of Technology degree from Örebro University in<br />
<strong>2004</strong>.<br />
Jan Spännar was born in Smedjebacken, Sweden on March 23, 1964. He received a Master<br />
degree in Applied Physics and Electrical Engineering at Linköping Institute of Technology,<br />
Sweden in 1989. Since fall 1999 he has been a graduate student at the Centre for Applied<br />
Autonomous Sensor Systems, Örebro University. He received his licentiate-of-technology<br />
degree from AASS, Örebro Univ. in 2002. His current research interests include modelling<br />
and identification with applications to process measurement.<br />
Linn Robertsson was born in Örebro in 1979. She was awarded the degree of Master of<br />
Science in Engineering with the specialization on aerospace technology at Luleå University of<br />
Technology in 2001. Since fall 2002 she has been a graduate student at the Centre of Applied<br />
Autonomous Sensor Systems, Örebro University, Örebro, Sweden. Her current research<br />
interests are biologically inspired Sensory Information Fusion Systems and feature extraction<br />
methods.
42 AASS – Center for Applied Autonomous Sensor Systems<br />
2.2. Mobile Robotics Lab<br />
The main project structure in this Lab in <strong>2004</strong> was the same as the one in 2003. All the work<br />
done by this Lab in <strong>2004</strong> concentrated around three vertical research lines, plus one horizontal<br />
line. The project structure is described in the next subsection. The following sub-section<br />
<strong>report</strong>s the activities within each individual project.<br />
2.2.1. Research directions<br />
The general objective of the AASS Mobile Robotics Lab is the development of autonomous<br />
mobile robots that can operate without the need human intervention in unmodified<br />
environments. Our specific research focus is the crucial problem of the integration of higherlevel<br />
cognitive processes into a physically embedded system. The intended scientific<br />
breakthrough of this focus is to provide the "missing link" between the field of Artificial<br />
Intelligence, especially in the area of knowledge representation and reasoning, and the field of<br />
Autonomous Robotics, especially in the area of sensor-based control of autonomous systems.<br />
We address in particular three facets of the integration problem: (i) integration between<br />
reasoning about goals and performance of actions, (ii) integration between models of the<br />
world at different levels of abstraction, and (iii) integration between symbols and sensor data.<br />
In all cases, we study the above problems both in the case of a single robot, and in the case of<br />
multiple cooperating robots.<br />
These facets are reflected in our four research lines:<br />
1. Behavioural plans<br />
We study how a robot can form plans for actions, and then execute them in the face of<br />
uncertainty and changing conditions in the environment.<br />
2. Hybrid maps<br />
The environment of the robot can be represented at different levels of abstraction, like the<br />
geometry of a room, the topology of a building, or the roadmap of a city. We study the<br />
problem of how to integrate these representations, and how to exploit the synergies<br />
between them.<br />
3. Perceptual anchoring<br />
Humans often use symbolic names to refer to objects, like "Room-22", when<br />
programming a robot or interacting with it. The robot, however, can only access sensor<br />
data, like an image from a camera. We have pioneered the field of "perceptual anchoring",<br />
that is, the connection between symbols and sensor data that refer to the same physical<br />
objects.<br />
4. Cooperation<br />
We study how to deal with the previous issues in the case of a team consisting of multiple<br />
robots and possibly humans. This research line is "horizontal" in the sense that it considers<br />
all the above issues, adding the additional dimension of cooperation.
Annual Report <strong>2004</strong> 43<br />
2.2.2. Projects in <strong>2004</strong><br />
Project: Model-free execution monitoring, J412<br />
Project leader: Ola Pettersson<br />
Staff: Alessandro Saffiotti, Lars Karlsson<br />
Funding: Faculty<br />
Synopsis:<br />
Intelligent mobile robots need the ability to integrate robust navigation facilities with higher<br />
level reasoning. This project aims at combining results and techniques from the areas of robot<br />
navigation and of intelligent agency. In particular, we investigate techniques that allow the<br />
robot to decide when to go on with execution, and when to stop and ponder about a new<br />
situation. Our current efforts are directed towards the monitoring of the current execution of a<br />
B-Plan (Behavioural Plan) in order to detect and identify possible failures. We focus on the<br />
use of pattern recognition techniques that avoid the need for a predictive model of the system.<br />
This project belongs to the research line "Behavioural plans". The objective is to investigate<br />
the use of model-free techniques for execution monitoring. The main "pull" is academic.<br />
Results in <strong>2004</strong>:<br />
- PhD thesis by Ola Pettersson, titled “Model-Free Execution Monitoring in Behaviour-<br />
Based Mobile Robots”. The thesis was defended on October 1, <strong>2004</strong>.<br />
- Submission of a journal paper summarizing part of the PhD thesis. A second journal<br />
submission is in preparation.<br />
Partners: None.<br />
Future developments:<br />
- The project was completed in <strong>2004</strong> and it will not be continued in 2005.
44 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Hybrid maps, J415<br />
Project leader: Pär Buschka<br />
Staff: Alessandro Saffiotti<br />
Funding: KK-foundation - IT and Faculty.<br />
Synopsis:<br />
Autonomous mobile robots need to use spatial information about the environment in order to<br />
effectively plan and execute navigation tasks. This information can be represented at different<br />
level of abstractions and of locality. Each level is adequate for some sub-tasks, but not for<br />
others. In this project we study hybrid maps, representations of the space that integrate<br />
different levels of locality and abstraction. Hybrid maps are expected to provide a way for<br />
robots to scale up to much larger environments, which cannot be modelled using metric maps.<br />
This project belongs to research direction "Hybrid Maps". The objective is to define H-Maps,<br />
and the processes needed to build them and to use them in autonomous agents. The main<br />
"pull" is academic.<br />
Results in <strong>2004</strong>:<br />
- Presented a paper on the analysis and definition of the concept of "hybrid maps" at the Int.<br />
Conf. on Intelligent Autonomous Systems (IAS, Amsterdam, NL, April <strong>2004</strong>).<br />
- Presented a paper on fuzzy maps at the Int. Robocup Symposium (Lisbon, PT, July <strong>2004</strong>).<br />
Joint work with project J-448.<br />
- Paper on the survey and classification of hybrid maps submitted to a journal.<br />
- Implemented experimental system to build hybrid maps, and used for extensive<br />
experimentation.<br />
- Started the integration between hybrid maps and multi-hierarchical maps, joint work with<br />
University of Malaga.<br />
Partners:<br />
- University of Malaga, Spain.<br />
- AASS Learning Systems Lab.<br />
Future developments:<br />
- Submission of journal paper on the integration between hybrid maps and multihierarchical<br />
maps.<br />
- PhD Thesis of Pär Buschka expected to be completed during the first half of 2005.
Annual Report <strong>2004</strong> 45<br />
Project: Behaviour-based control of a mobile manipulator, J416<br />
Project leader: Zbigniew Wasik<br />
Staff: Alessandro Saffiotti<br />
Funding: Faculty and KK-foundation<br />
Synopsis:<br />
In this project, we investigate new solutions to the mobile manipulation problem. The<br />
investigation proceeds along two lines: (i) to develop a behaviour-based approach to real-time<br />
visual serving of a manipulator; and (ii) to extend the "Thinking Cap" architecture to cope<br />
with the simultaneous control of the manipulator and of the mobile platform on which the arm<br />
is mounted. The target tasks will include the ability to grasp and move objects in an<br />
unmodified indoor environment. This project belongs to the research line "Behavioural<br />
plans". The objective is to investigate the use of behaviour-based plans to control more<br />
complex plants than a mobile platform, e.g., a mobile manipulator. The main "pull" is<br />
academic, but flexible mobile manipulation is also expected to have industrial relevance in the<br />
future.<br />
Results in <strong>2004</strong>:<br />
- Extension of the behaviour-based manipulation system to perform combined mobility and<br />
manipulation.<br />
- The writing of the PhD thesis of Zbigniew Wasik has been completed.<br />
Partners:<br />
- University of Rome-3, Italy.<br />
Future developments:<br />
- The project will be completed with the defence of the PhD thesis of Zbigniew Wasik, in<br />
Spring 2005.
46 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Symbolic reasoning for perception, J424<br />
Project leader: Amy Loufti<br />
Staff: Silvia Coradeschi, Alessandro Saffiotti<br />
Funding: KK-foundation and Faculty<br />
Synopsis:<br />
In this research line we investigate the use of symbolic reasoning techniques for robot<br />
perception. We focus in particular on one challenging perception problem: the use of an<br />
electronic nose (e-nose). The e-nose is a type of sensor which is rapidly gaining popularity<br />
because of its many potential applications. We consider the problem of integrating the<br />
information provided by the e-nose with both prior information and information from other<br />
sensors (e.g., vision), as well as the problem of deciding when, how and where the e-nose<br />
should be activated. We will consider ideas developed in the field of AI for diagnosis and for<br />
planning of perceptual actions. We will also use, and possibly extend, the framework for<br />
"perceptual anchoring" developed in project J-445 to connect symbolic techniques to the<br />
sensor data provided by the e-nose. Experiments will be performed on a mobile robot<br />
equipped with an e-nose together with a variety of more conventional sensors, including<br />
vision. This project belongs to the research line "Perceptual anchoring". The general<br />
objective is to investigate the use of symbolic reasoning techniques for perception, with<br />
special focus on the use of e-noses. The main "pull" is academic.<br />
Results in <strong>2004</strong>:<br />
- Submission of journal paper summarizing the results of the Licentiate of Amy Loutfi.<br />
- Publication of a paper on forming odour categories (European Conf on AI, Valencia,<br />
Spain).<br />
- Publication of a paper on the use of sensor planning in olfaction (Int. Conf. on Intelligent<br />
Robots and Systems, Sendai, Japan). Joint work with project J-446.<br />
- Contributed a chapter on artificial perceptual systems to the Handbook of Sensor<br />
Networks (CRC Press).<br />
- Thesis plan for Amy Loutfi defined.<br />
- Integration of the software for the e-nose into the Thinking Cap platform.<br />
Partners:<br />
- BIS Lab at AASS.<br />
Future developments:<br />
- Submission of paper on perception management to IJCAI-05.<br />
- Extensive experimental evaluation of the integration between olfaction and other sensing<br />
modalities through anchoring.<br />
- Work toward the completion of the PhD thesis of Amy Loutfi, expected in 2006.
Annual Report <strong>2004</strong> 47<br />
Project: Perceptual anchoring, J445<br />
Project leader: Silvia Coradeschi<br />
Staff: Alessandro Saffiotti, Mathias Broxvall, Kevin LeBlanc<br />
Funding: Swedish Research Council (Vetenskapsrådet) and CUGS<br />
Synopsis:<br />
Intelligent agents embedded in physical environments need the ability to connect the symbols<br />
used to perform abstract reasoning to the physical entities to which these symbols refer.<br />
Anchoring is the process of creating and maintaining the correspondence between symbols<br />
and sensor data that refer to the same physical objects. Anchoring must deal with indexical<br />
and objective references, definite and indefinite identifiers, and temporary impossibility to<br />
perceive physical entities. Furthermore it needs to rely on sensor data which is inherently<br />
affected by uncertainty, and to deal with ambiguities. This project belongs to the research line<br />
"Perceptual anchoring". The objective is the definition and the in-depth study of the problem<br />
of anchoring, and of its use in autonomous agents. The main "pull" is academic: the problem<br />
of anchoring has been defined as such at AASS, and this project aims at maintaining the<br />
position of AASS as the leader of a new research community working around this problem.<br />
Results in <strong>2004</strong>:<br />
- A three year extension grant was awarded to this project by the Swedish Vetenskapsrådet.<br />
- Organized a Workshop on Anchoring at AAAI-04 (San Jose, CA, July <strong>2004</strong>). Chairs: S.<br />
Coradeschi and A. Saffiotti.<br />
- Publication of 2 papers on dealing with ambiguities in anchoring (Int. Conf. on Intelligent<br />
Autonomous Systems, Amsterdam, NL; and ECAI Workshop on Cognitive Robotics,<br />
Valencia, Spain). Joint work with project J-446.<br />
- Publication of 1 workshop papers on anchoring in conceptual spaces (AAAI Workshop on<br />
Anchoring, San Jose, CA).<br />
Partners:<br />
- University of Palermo, Italy<br />
Future developments:<br />
- A new PhD student will be enrolled on this project, supported by the above grant.<br />
- Continue work on the resolution of ambiguities in perceptual anchoring using planning<br />
techniques.<br />
- Continue joint work with Univ. of Palermo on anchoring in conceptual spaces.
48 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Sensor-based planning for mobile robots, J446<br />
Project leader: Lars Karlsson<br />
Staff: Abdelbaki Bouguerra, Mathias Broxvall, Silvia Coradeschi, Alessandro Saffiotti<br />
Funding: Swedish Research Council (Vetenskapsrådet) and KK-foundation.<br />
Synopsis:<br />
The problem we investigate is conditional planning under uncertainty for autonomous robots.<br />
A conditional planner is able to account for different contingencies, and to plan in advance for<br />
detecting when these contingencies occur. For this purpose, we intend to research both the<br />
issues of representation, search etc for a conditional planner, and the integration of the planner<br />
into an actual robotic system. The planning techniques used will be based on an existing<br />
planner, PTLplan, which generates conditional plans taking into account probabilistic or<br />
possibilistic uncertainty, but which so far (like its competitors) has a simplified treatment of<br />
sensing. This project belongs to the research line "Behavioural plans". The objective is to<br />
extend existing planning techniques to better suit the needs of autonomous robotic<br />
applications. The main "pull" is academic.<br />
Results in <strong>2004</strong>:<br />
- Paper on hierarchical task planning under uncertainty presented at the Italian Workshop<br />
on Planning and Scheduling (Perugia, Italy).<br />
- Defined plan for Licentiate by Abdelbaki Bouguerra.<br />
- Publication of 2 papers on the use of planning to solve perceptual ambiguities (Int. Conf.<br />
on Intelligent Autonomous Systems, Amsterdam, NL; and ECAI Workshop on Cognitive<br />
Robotics, Valencia, Spain). Joint work with project J-445.<br />
- Publication of a paper on the use of sensor planning in olfaction (Int. Conf. on Intelligent<br />
Robots and Systems, Sendai, Japan). Joint work with project J-424.<br />
Partners:<br />
EC Network of Excellence on Planning: PLANET.<br />
Future developments:<br />
- Continue the study on the generation of on-the-fly plans to recover from failures in<br />
execution.<br />
- Journal submission of the work on hierarchical planning under uncertainty.<br />
- Licentiate by Abdelbaki Bouguerra to be produced by the end of 2005.
Annual Report <strong>2004</strong> 49<br />
Project: Robot team-work, J447<br />
Project leader: Robert Lundh<br />
Staff: Lars Karlsson, Alessandro Saffiotti<br />
Funding: CUGS and Faculty<br />
Synopsis:<br />
The objective of this project is to develop models and techniques to dynamically configure<br />
and re-configure a team of collaborating physical agents to adapt to the current tasks,<br />
situations and resources. Agents may be homogeneous or heterogeneous robots, and human<br />
agents may also be included in the team. The point of view is to see the team as a unique<br />
system, and each agent as providing set of functionalities. The configuration of the team is<br />
defined in terms of which agent provides which functionalities, to whom, and how. This<br />
project belongs to research line "Behavioural Plans", to which it adds the special focus on<br />
cooperation. The main "pull" of this project is academic.<br />
Partners:<br />
- EURON, the European Research Network<br />
- University of Murcia, Spain<br />
Results in <strong>2004</strong>:<br />
- Defined a framework for team configurations and implemented it in the Thinking Cap.<br />
- Published a paper about this framework at a workshop (ECAI Workshop on Agents in<br />
Dynamic and Real-Time Environments. Valencia, Spain).<br />
- Licentiate plan of Robert Lundh defined.<br />
- Set-up of an experimental platform, based on the Thinking Cap, for robot planning,<br />
navigation, and cooperation.<br />
Future developments:<br />
- Paper submission on configuration planning to IROS-05.<br />
- Work toward the licentiate of Robert Lundh (expected late 2005 – early 2006).<br />
- There will be a 6 month pause in 2006 due to parental leave.
50 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: RoboCup, J448<br />
Project leader: Kevin LeBlanc<br />
Staff: Robert Lundh, Kevin LeBlanc, Alessandro Saffiotti.<br />
Funding: CUGS and Faculty<br />
Synopsis:<br />
RoboCup is an international robot soccer competition. AASS is the leader of Team Sweden, a<br />
multi-university team currently including three Swedish universities (Orebro Univ, Lund<br />
Univ, and Blekinge Institute of Technology) and a Spanish one (Univ. of Murcia). Team<br />
Sweden has participated in all competitions since 1999, using the Sony AIBO robots as its<br />
robotic platforms. The objective of this project was to develop a team of autonomous robots<br />
able to compete in the RoboCup 2003 competition. This project belongs to the research line<br />
"Behavioural Plans", with a strong emphasis on the cooperation aspect. It has a mainly<br />
academic pull.<br />
Results in <strong>2004</strong>:<br />
- Participation in the RoboCup <strong>2004</strong> international competition in Lisbon, Portugal.<br />
- Presented a paper on cooperative object localization at the Int. Robocup Symposium<br />
(Lisbon, PT, July <strong>2004</strong>). Joint work with project J-463.<br />
- Presented a paper on fuzzy maps at the Int. Robocup Symposium (Lisbon, PT, July <strong>2004</strong>).<br />
Joint work with project J-415.<br />
- Presented a paper on localization with natural landmarks at the Int. Conf. on Information<br />
Processing and Management of Uncertainty (Perugia, Italy). Joint work with project J-<br />
415.<br />
Partners:<br />
Team Sweden (Orebro Univ, Lund Univ, and Blekinge Institute of Technology in Sweden;<br />
plus Univ of Murcia in Spain).<br />
Future developments:<br />
- This project will be discontinued in 2005.
Annual Report <strong>2004</strong> 51<br />
Project: Navigation System for Automatic Loaders, J449<br />
Project leader: Johan Larsson<br />
Staff: Mathias Broxvall, Alessandro Saffiotti.<br />
Funding: Robotdalen, Atlas Copco and Faculty<br />
Synopsis:<br />
This project comprises development of a robust and flexible navigation system for<br />
underground mine loaders (LHD, Load Haul Dump) that has only modest requirements in<br />
terms of infrastructure. The goal is to enable autonomous operation of these vehicles. This is<br />
accomplished by combining the mobile robotics skills at the AASS Mobile Robotics Lab with<br />
the knowledge of “real-world” applications of Atlas Copco Rock Drills AB. The idea is to<br />
have a navigation system that supports collections of sensors sufficient for operation in both<br />
open and closed environments. This project belongs to the research line "Behavioural plans".<br />
The objective is to use the B-plan technology to develop an autonomous system for Load-<br />
Haul-Dump operation in underground mines. The main "pull" is industrial.<br />
Results in <strong>2004</strong>:<br />
- Analyzed the state of the art in autonomous mining<br />
vehicles.<br />
- Defined the main approach and technologies.<br />
- Defined the sensors to be used, analyzing data<br />
collected in a test mine.<br />
- Developed a first version of a laboratory demonstrator<br />
running at high speed.<br />
Partners:<br />
Atlas Copco Rock Drills AB.<br />
Future developments:<br />
- Integrate RFID-based localization in the laboratory<br />
demonstrator, and test it in a mining environment.<br />
- Paper submission to the IFR conference.<br />
- Start the porting of the technique to the real vehicle.
52 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Cooperative perceptual anchoring, J463<br />
Project leader: Kevin LeBlanc<br />
Staff: Silvia Coradeschi, Alessandro Saffiotti<br />
Funding: Faculty and CUGS<br />
Synopsis:<br />
The objective of this project is to extend the notion of anchoring to capture "cooperative<br />
anchoring". This is the problem of how to create and maintain inter-agent agreement about the<br />
meaning of the words used in the exchange of information about a common physical<br />
environment. A typical example is the problem of establishing the correspondence between<br />
the linguistic symbols used by two different robots to refer to the same physical object.<br />
Cooperative anchoring is also needed for efficient human-robot cooperation. This project<br />
belongs to research line "Perceptual Anchoring", with a strong emphasis on the cooperation<br />
aspect. The main "pull" of this project is academic.<br />
Results in <strong>2004</strong>:<br />
- Developed experimental tool for the systematic evaluation of multi-robot localization<br />
under uncertainty.<br />
- Presented a paper on cooperative object localization at the Int Robocup Symposium<br />
(Lisbon, PT, July <strong>2004</strong>). Joint work with project J-448.<br />
- Defined Licentiate plan for Kevin LeBlanc.<br />
Partners:<br />
University of Murcia, Spain.<br />
Future developments:<br />
- Systematic experimental evaluation of different techniques for fuzzy information sharing.<br />
- Licentiate thesis by Kevin LeBlanc expected during 2005.
Annual Report <strong>2004</strong> 53<br />
2.2.3. Staff<br />
Alessandro Saffiotti, PhD, is a professor of Computer Science at the Centre for Applied<br />
Autonomous Sensors Systems of Örebro University, Sweden, where he heads the Mobile<br />
Robotics Lab. He has previously been a researcher with the University of Pisa (Italy), with<br />
SRI International (USA), and with the Universite Libre de Bruxelles (Belgium). His research<br />
interests encompass autonomous robotics, soft computing, and non-standard logics for<br />
common-sense reasoning. He has published more than 80 research papers in international<br />
journals and conferences, and co-edited a book on fuzzy logic techniques for autonomous<br />
navigation.<br />
He was a chair of the 1999, 2001 and 2003 IJCAI workshops on ``Reasoning with uncertainty<br />
in robotics'', of two workshops on “Anchoring symbols to sensor data” (at AAAI 2001 fall<br />
symposium and at AAAI <strong>2004</strong>), and of two workshops on “Cooperative robotics” (at IROS<br />
2002 and at ICRA 2005). In 2002 he co-organized the First European Summer School on<br />
cooperative robotics. In 2003 he was the chair of the 4-legged league at the International<br />
Robocup Competition. He will serve as chair for the poster track of IJCAI 2005. He is a<br />
member of IEEE, AAAI, and IAS.<br />
Mathias Broxvall, PhD, is a lecturer of Computer Science at the Centre for Applied<br />
Autonomous Sensor Systems of Örebro University. He presented his thesis, A Study in the<br />
Computational Complexity of Temporal Reasoning, at Linköping University within the field<br />
of temporal reasoning and constraint solving. His current research interests are autonomous<br />
robotics and planning. He has journal publications and articles in several well established<br />
international conferences. For teaching he has given programming, database, logics and<br />
artificial intelligence courses. On the side he has also contributed to and authored several<br />
large open-source projects.<br />
Silvia Coradeschi is an assistant professor at the Centre for Applied Autonomous Sensor<br />
Systems at Örebro University. She has received a master degree in Philosophy at the<br />
University of Florence, a master degree in Computer Science at the University of Pisa, and a<br />
PhD in Computer science at Linköping University. She is a member of the board of trustees<br />
of the RoboCup Federation and was general chair of the Third Robot World Cup Soccer<br />
Games and Conferences (RoboCup-99). She is also a member of the Advisory Board for the<br />
Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01) and member<br />
of the board of the European Coordinating Committee for Artificial Intelligence.<br />
Silvia Coradeshi is director of the undergraduate studies for the Computer Engineering<br />
Division at Örebro University and she is vice-head of the Technology Department. She has<br />
published 18 conference/journal papers and her main research interest is in establishing the<br />
connection (anchoring) between the symbols used to perform abstract reasoning and the<br />
physical entities, which these symbols refer to. She also works in multi-agent systems and<br />
cooperative robotics.
54 AASS – Center for Applied Autonomous Sensor Systems<br />
Lars Karlsson is an assistant professor at the Centre for Applied Autonomous Sensor<br />
Systems at Örebro University. He received a MSc. degree in Computer Science at Linköping<br />
University in 1993, and a PhD in 1999. He was a co-chair of the Third Robot World Cup<br />
Soccer Games and Conferences (RoboCup-99). He is the coordinator for the MSc program in<br />
Computer Engineering at Örebro University, and he is the director for graduate education in<br />
AASS. He has 18 conference/journal publications and his research interests include planning<br />
under uncertainty, reasoning about actions and integration between reasoning and<br />
action/perception in autonomous systems.<br />
Pär Buschka was born in Gothenburg, Sweden on April 22, 1966. He received the MSc<br />
degree in computer science and engineering in 1996 from Chalmers University of Technology<br />
in Gothenburg, Sweden. Since autumn 1999 he has been a graduate student at the Centre for<br />
Applied Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current<br />
research interests include mobile robot localization and navigation using hybrid maps.<br />
Ola Pettersson was born in Falkenberg, Sweden on March 7, 1972. He received the BSc<br />
degree in electrical engineering in 1994, and the MSc degree in electrical engineering in 1995<br />
(specialization in photonics and image analysis), both from Halmstad University, Halmstad,<br />
Sweden. In 2000 he received a Licentiate of Technology in computer science from Linköping<br />
University, Linköping, Sweden. Since fall 1996 he has been a graduate student at the Centre<br />
for Applied Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current<br />
research interests include mobile robot action control, planning, and execution monitoring.<br />
Zbigniew Wasik was born in Nowy Dwor Mazowiecki, Poland on October 13, 1973. He<br />
received both the BSc degree and the MSc degree in electrical engineering in 1998<br />
(specialization in Automation and Robotics) from Wroclaw University of Technology,<br />
Wroclaw, Poland. Since fall 1998 he has been a graduate student at the Centre for Applied<br />
Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current research<br />
includes a behaviour-based approach to real-time visual servoing of a mobile manipulator.<br />
Kevin LeBlanc was born in Moncton, New Brunswick, Canada, on November 11, 1977. He<br />
received his B.Sc. in Electrical Engineering with a Computer Engineering Option at the<br />
University of New Brunswick in May 2001. In the fall of 2002 he began graduate studies at<br />
the Centre for Applied Autonomous Sensor Systems, Orebro University, Orebro, Sweden. His<br />
research falls within the cooperative perception area; his primary focus deals with cooperative<br />
perceptual anchoring.<br />
Robert Lundh was born in Jämshög, Sweden on September 17, 1978. He received the MSc<br />
degree in Computer Technology in 2002 from Örebro University, Örebro, Sweden. Since late<br />
spring 2002 he has been a graduate student at the Centre for Applied Autonomous Sensor<br />
Systems, Orebro University, Orebro, Sweden. His current research is within the field of<br />
cooperative robotics.<br />
Abdelbaki Bouguerra was born in M'sila, Algeria on October 10, 1974. He received an<br />
Engineering degree in Computer Science in 1997 (in Computer Systems) from The National<br />
Institute of Computer Science, Algiers, Algeria, and a Master degree in Computer Science in<br />
2001 (specialization Industrial Computer Science) from the National Military Polytechnics<br />
School, Algiers, Algeria. He joined Schlumberger-Geoquest as a data management Engineer<br />
in the same year where he worked for approximately one year, and then he joined the<br />
department of computer science at Linköping University as a visiting scholar for six months.
Annual Report <strong>2004</strong> 55<br />
Since January 2003, he has been a graduate student at the Centre for Applied Autonomous<br />
Sensor Systems, Orebro University, Orebro, Sweden. His current research includes planning<br />
and execution for mobile robots.<br />
Johan Larsson was born in Norrköping Sweden, in July 1970. He received the MSc degree<br />
in mechanical engineering (specialization in mechatronics) in 1996, from the Royal Institute<br />
of Technology, Stockholm, Sweden. In 1998 he joined Atlas Copco Rock Drills, Örebro,<br />
where he has developed software for the underground drill rig control systems. Since<br />
February <strong>2004</strong> he has been a graduate student at the Centre for Applied Autonomous Sensor<br />
Systems, Örebro University, Örebro, Sweden. His current research focuses on the<br />
autonomous navigation of industrial vehicles in underground mines.
56 AASS – Center for Applied Autonomous Sensor Systems<br />
2.3 Intelligent Control Lab<br />
The objective of the lab is to build perception-based control systems able to perform humanlike<br />
motions and operations by bringing together the sensation and the control in mechatronic<br />
systems. We emphasize on two types of activities:<br />
• Development of new methodologies,<br />
technologies and equipment for<br />
implementing complex control systems.<br />
• Integrating above with soft computing<br />
methods, control algorithms and sensing<br />
technology to achieve high-speed motion<br />
control systems with embedded intelligence.<br />
2.3.1 Research directions<br />
Our work and expertise is concentrated in three major research directions:<br />
• Advanced Mechatronic Systems: we design, develop and prototype specific robotic<br />
constructions for performing dedicated stand-alone desktop operations or for integration<br />
with a mobile platform. Desired dynamic properties, balanced kinematics, minimum<br />
energy consumption, higher flexibility and compliance are combined for accomplishing<br />
maximum performance. Various interfacing and integration types of problems are<br />
addressed for achieving properties that outperform existing systems.<br />
• Advanced Control and Industrial Applications: we develop methods to control robots that<br />
are designed at our lab for performing complex behaviour like executing a motion for a<br />
minimum time, studying human arms motions for transferring them to a robot for given<br />
task. Another aspect is the industrial orientation of our work aimed at the transfer of the<br />
advanced technologies developed in the lab to industry.<br />
• Vision, Image and Signal Processing Systems: we apply, in a novel way, fuzzy similarity<br />
ideas to the development of new methods and algorithms for very efficient real-time<br />
vision and image processing, operating at high speed, and needed for any high speed<br />
motion control system. The concept of fired-rules-hyper-cube was introduced by us and<br />
implemented on FPGA-chips for fuzzy logic based control, high frequency signal and<br />
real-time image processing.<br />
In what follows we describe the work done during <strong>2004</strong> on specific projects from the above<br />
three research directions.
Annual Report <strong>2004</strong> 57<br />
2.3.2 Projects in <strong>2004</strong><br />
Project: Fast fuzzy logic image processing and fast vision system, J432<br />
Project leader: Ivan Kalaykov<br />
Staff: Gustav Tolt<br />
Funding: KK-foundation - IT and Faculty<br />
Synopsis:<br />
The project belongs to the research direction "Vision, image and signal processing". The<br />
objective is to develop techniques for high-speed image processing and high-speed vision<br />
system able to provide over 50-60 frames per second for the low and medium levels of image<br />
processing. This performance is needed for real-time image processing systems such as fast<br />
vision systems in visual-servoing tasks when it is necessary to control high-speed motion.<br />
This project is based completely on the academic challenge to outperform the current<br />
industrial vision systems, which generally limit the frequency band of robot motion control.<br />
However, the fast image processing algorithms can be used in various applications where the<br />
processing time is an important factor.<br />
Partners: None<br />
Results in <strong>2004</strong>:<br />
- One publication, two others in final stage of preparation.<br />
- Simulated image processing functions in VHDL-based; development system.<br />
- Doctoral dissertation by Gustav Tolt draft available; planned for defence in April 2005.<br />
Major contributions include:<br />
- Unified approach to image processing based on the fuzzy similarity principle.<br />
- High performance algorithms both in terms of speed and quality of the processing.<br />
- Set of hardware structures for implementing the typical image processing algorithms.<br />
- Embedded high-speed image processing algorithms using fuzzy logic.<br />
Future developments:<br />
Short-term goals:<br />
- Development and completing the theoretical issues of the unified approach to low and<br />
medium level image processing based on fuzzy similarity principle.<br />
- Experimental tests of the developed concepts and algorithms on prototype hardware<br />
system, possibly for some industrial applications under Robotdalen.<br />
Long-term goals:<br />
- Further development of the fuzzy similarity concept for higher level of image processing<br />
and for higher complexity of image-based scenarios.<br />
- Expansion of the research by opening new PhD student position(s), as this direction is<br />
foreseen as fundamental for the IC lab.<br />
- Experimental hardware platform by cooperation with the Mälardalens högskolan under a<br />
joint Robotdalen project.<br />
- Performing tests in industrial environments.
58 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Redundant robots, J441<br />
Project leader: Anani Ananiev<br />
Staff: Thorsten Michelfelder, Ivan Kalaykov<br />
Funding: Faculty<br />
Synopsis:<br />
The project belongs to the research direction "Advanced Mechatronic Systems". The<br />
objective is to overcome problems with strength, navigation and locomotion that have<br />
restricted the use of snake-like robots. The mechanical and the electronic design of the snake<br />
will be based on minimalist approach with as simple as possible mechanical construction and<br />
simplest control system. The development of environment-specific movement strategies is<br />
currently a hot topic of research.<br />
Partners:<br />
Velox Devices, LLC, New York, USA<br />
Results in <strong>2004</strong>:<br />
- One publication.<br />
- Working prototype with basic modes of motion.<br />
- Demo is available, demonstrated at ISR’<strong>2004</strong>, Paris.<br />
Major contributions include:<br />
- Unique approach for motion transmission system embodied in the robot using only one<br />
irreversible motor.<br />
- Optimised ratio of weight and force.<br />
Future developments:<br />
Short-term goals:<br />
- To complete the snake-robot with the minimum set of sensors and functionalities for<br />
performing a pre-specified set of tasks in rescue-related scenarios.<br />
- To study the electromechanical properties of the innovative driving mechanism and the<br />
respective control approaches for obtaining certain dynamical properties.<br />
- To study the constraints of the driving mechanism and the limitations on the total<br />
construction of a hyper-redundant robot of this type.<br />
Long-term goals:<br />
- To extend the approach for building hyper-redundant robots of other configurations for<br />
performing high-complexity tasks in industrial environments. This goal will be coordinated<br />
with ABB Robotics, which expressed their interests to be active industrial<br />
partner.<br />
- To build complete dynamical model of the hyper-redundant robot with this kinematics<br />
structure and unique driving mechanism
Annual Report <strong>2004</strong> 59<br />
Learning Control of Robot Arms by Emulating Human Actions, J460<br />
Project leader: Tom Duckett<br />
Staff: Alexander Skoglund: a PhD student at the Intelligent Control Lab (50%) and at the<br />
Learning Systems Lab (50%), Rainer Palm, Ivan Kalaykov.<br />
Note:<br />
This is a common project with the Learning Systems lab. For detailed description look at<br />
Section 2.3 (J460).
60 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Cooperating arms, J465<br />
Project leader: Ivan Kalaykov<br />
Staff: Anani Ananiev, Thorsten Michelfelder<br />
Funding: Faculty<br />
Synopsis:<br />
The project belongs to the research direction "Advanced Mechatronic Systems". The<br />
objective is to develop techniques for performing cooperating actions of two (or more) robotic<br />
arms in executing common tasks where one arm is needed to do the main action and the other<br />
is complementing the first, for example providing support. The cooperative actions are based<br />
on embedded learned/pre-programmed behaviours and visual guidance. Additional sensory<br />
information will be used depending on the concrete application. This project is based on<br />
purely academic idea, however certain applications are envisioned.<br />
Partners: None<br />
Results in <strong>2004</strong>:<br />
- Preparation of an experimental set-up.<br />
Future developments:<br />
- Decision to discontinue the project was made due to limited manpower and absence of<br />
possibility to employ a PhD student. Some issues on cooperating arms are foreseen as part<br />
of the hyper-redundant robot project J441.
Annual Report <strong>2004</strong> 61<br />
Project: Flexible food cell, J466<br />
Project leader: Ivan Kalaykov<br />
Staff: Anani Ananiev, Lars Jennergren<br />
Funding: KK-foundation<br />
Synopsis:<br />
The project belongs to the research direction "Advanced Mechatronic systems". The objective<br />
is to create an intelligent assembly cell for ready to eat meals. The production has to be<br />
customer oriented, which leads to shorter and more irregular production series with an<br />
increased number of different products. During the entire project the hygienic aspects and<br />
mechanical and thermal restriction of food assembly are considered. The project is started in<br />
co-operation with SIK (The Swedish institute for food and biotechnology). The work is<br />
strongly related to the food factory of the future, which is one of the major projects at SIK.<br />
The results will hopefully improve its capacity.<br />
Partners:<br />
SIK, Göteborg<br />
Results in <strong>2004</strong>:<br />
- Three publications.<br />
- Licentiate thesis officially presented and defended in August <strong>2004</strong>.<br />
Major contributions include:<br />
- Hygienic and robust manipulation of specific food groups.<br />
- A flexible cell layout that is easy to reconfigure for new product variants.<br />
- A demonstration cell that can assemble a set of pre-specified products.<br />
Future developments:<br />
- Increasing the level of intelligence in all phases of preparing the execution plan.<br />
- Increasing the robustness of the entire system by introducing continuous visual feedback<br />
during the plan execution (assembly of meals).<br />
- The project is discontinued as the employment of Lars Jennergren at SIK has finished and<br />
no further funding is available.
62 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Friction Steer Welding (FSW) Robot Welding, J467<br />
Leader: Anani Ananiev<br />
Staff: Mikael Soron, Ivan Kalaykov<br />
Funding:<br />
Robotdalen, ESAB Welding Equipment AB, Specma Automation, ABB Robotics and Faculty<br />
Project synopsis<br />
Friction Stir Welding (FSW) is a relatively new welding method invented by the TWI<br />
Company in UK in 1991. It is used for welding mainly of aluminium, for example in airplane<br />
and space industry. There exists a need for developing a technology for three-dimensional<br />
welding of large and small objects for various other industries such as car manufacturing. The<br />
goal of this project, supported by Robotdalen, is to contribute to finding proper solution based<br />
on the competence at the Intelligent Control Laboratory in robot kinematics and dynamics,<br />
and visual-servoing and force feedback control as well.<br />
Duration<br />
Started in September 2003, ends in 2005.<br />
Collaborations<br />
ESAB, Laxå<br />
Specma Automation, Laxå<br />
ABB Robotics, Västerås<br />
Results achieved in <strong>2004</strong><br />
- Survey and analysis of publications.<br />
- Concept of a licentiate thesis.<br />
- Preliminary test of feasible methods<br />
- Development and test of force-feedback system for ABB robot.<br />
Expected results 2005<br />
- Completed primary tests for the functionality of the demonstration platform.<br />
- Completed licentiate thesis of M. Soron.<br />
Major contributions include:<br />
- Developing techniques for force-feedback control of industrial robot with compensation<br />
of gravity in 3D space.<br />
- Development of fully operational demonstration platform with ABB robot force sensor<br />
and FSW-tool.<br />
Future developments:<br />
- Development of user-friendly environment for off-line planning and verifying of 3Dwelding<br />
trajectories.<br />
- Development of integrated hardware/software in the loop system for increasing the<br />
effectiveness of the set-up operations.
Annual Report <strong>2004</strong> 63<br />
Project: Vision-Based Control of Continuous Webs and Flows, J468<br />
Project leader: George Fodor<br />
Staff: Thomas Uppgård, George Fodor, Ivan Kalaykov<br />
Funding: KK-foundation and Faculty.<br />
Project synopsis<br />
The project belongs to two research directions “Advanced control and industrial applications”<br />
and “Vision, image and signal processing”. The objective is to develop and test new<br />
techniques for quality monitoring and direct control of web/texture materials flowing with<br />
high speed. This is one form of direct application of the results of the “Fast vision system”<br />
project in industry wherever appropriate.<br />
Duration<br />
Started in October 2003, continues till end of 2008.<br />
Collaboration<br />
ABB Automation Technology Products, Instrumentation and Control<br />
Results achieved in <strong>2004</strong><br />
- Survey and analysis of publications.<br />
- Concept of a licentiate thesis.<br />
Expected results 2005<br />
- Preliminary test of feasible methods<br />
- Publications<br />
Milestones<br />
March-April 2006: licentiate thesis<br />
Major contributions include:<br />
- Developing new techniques for quality monitoring and direct control of web/texture<br />
materials and real-time control of the respective machines.<br />
Relation to other projects<br />
Input from J432 (Fast fuzzy logic image processing and fast vision system): the processing<br />
unit and the respective hardware structure.
64 AASS – Center for Applied Autonomous Sensor Systems<br />
The Robot Air-hockey Player, integration project, J4XX<br />
Project leader: Ivan Kalaykov<br />
Staff: Gustav Tolt, Mikael Soron, ex-job students Lasse Nord, Daniel Magnusson<br />
Funding: KK-foundation – IT, Robotdalen and Faculty.<br />
Project synopsis<br />
The goal is to make interactive demonstrations where humans and robots share the same<br />
space or perform a co-operative task in the form of playing a game between a human and<br />
robot. The challenging problem of fast eye-to-hand reaction is in: (i) evaluating the strike of<br />
the opponent; (ii) detecting the direction of puck’s motion; (iii) predicting its trajectory and<br />
(iv) activating arm-hand motion to intercept the puck and implement counter strike to the<br />
opponent’s field. The main difficulty is the extremely short time interval to complete all these<br />
actions. To be winning, the human players must train certain time otherwise only good luck<br />
can provide victory. The task is very advanced for robot players. Extremely fast image<br />
processing and fast robots are only prerequisites for achieving such performance.<br />
Duration<br />
Started in January <strong>2004</strong>, continued till June <strong>2004</strong>.<br />
Collaboration<br />
None<br />
Results achieved in <strong>2004</strong><br />
- Developed effective control system for rapidly changing and poorly modelled<br />
environment with sensor noise and error.<br />
- Developed an accurate prediction procedure of target motion with the least computational<br />
load.<br />
- Developed a switching planning and execution control strategy, based on the estimated<br />
and predicted trajectory of the puck, before entering the robot’s play field.<br />
- Integration of all components and achieving reasonable (within the limitations caused by<br />
the available hardware components) behaviour of the entire hybrid in nature high-speed<br />
two-dimensional ballistic manipulation system.<br />
- M.Sc. thesis presented and accepted.<br />
Future developments:<br />
- Topics are clarified, but not possible to be planned for implementation, as it will depend<br />
on available resources in the next years for eventual continuation of the project.
Annual Report <strong>2004</strong> 65<br />
2.3.3 Staff<br />
Prof. Ivan Kalaykov received his Dipl. Eng. in Electrical Engineering, Ph.D. in Control<br />
Engineering from the Technical University of Sofia, Bulgaria, 1972 and 1985 respectively. In<br />
January <strong>2004</strong> he became a professor at the Dept. of Technology, Örebro University. He has<br />
been an Associate Professor at: Dept. of Control and Systems Engineering, Technical<br />
University of Sofia, since 1987; Dept. of Physics, Trömsoe University, Norway, 1998-1999;<br />
and the Dept. of Technology, Örebro University since 2000, where he is now the head of the<br />
Intelligent Control Lab. He has been a visiting researcher at the Control Laboratory of Dept.<br />
of Electrical Engineering, Delft University of Technology, Netherlands and Institute for<br />
Peripheral Microelectronics, University of Kassel, Germany. He has been also Chairman and<br />
Vice-chairman of the Bulgarian Union of Automation and Informatics (UAI - the professional<br />
society of control engineers).<br />
Ivan Kalaykov served as IPC-member of many scientific events and has more than 60<br />
conference/journal publications. His research interests include adaptive control systems,<br />
intelligent control systems, fuzzy logic control, fuzzy logic hardware, and visual servoing for<br />
robot manipulation. He is a member of IEEE, SPIE and EUSFLAT.<br />
Prof. George Fodor received his M.Sc. degree in Electrical Engineering from the<br />
Polytechnic Institute of Cluj, Romania, in 1979, and the Ph.D. degree in Computer Sciences<br />
from the Linköping University, Sweden, in 1995. He is currently the head of the Systems<br />
Development Dept. for Force Measurement and Systems at ABB Automation Products,<br />
Sweden. He is an Adjunct Professor at Western Michigan University, Kalamazoo, USA, from<br />
1997 and member of the Advisory Board of the Electrical and Computer Engineering Faculty<br />
at the same university from 1998. He is an associated professor at Örebro University, Sweden,<br />
from 2000. His research interests include discrete control, control of complex industrial<br />
systems, discrete fault detection and isolation, ontological control, software architectures. He<br />
is the author of one book and some 30 conference and journal articles.<br />
Doc. Anani Ananiev is an Associate Professor at the Centre for Applied Autonomous Sensor<br />
Systems at Örebro University. He received his Dipl.Eng. in Mechanical Engineering and<br />
Ph.D. in Robotics and Automation from the Technical University of Sofia in 1987 and 1992<br />
respectively. He is an associate professor (on leave) at the Dept. of Robotics and<br />
Mechatronics, Institute of Mechanics, Bulgarian Academy of Science. He has been a visiting<br />
researcher at the Robotics Laboratory of the Wuppertal University, Germany, 1994 -1998;<br />
and Dept. of Robotics at the Institute Superior Technico, Lisbon, 1995-1997. He has 65<br />
conference/journal publications, 27 patents and has received 2 bronze medals at INPEX IX<br />
(US Invention New Product Trade Show) in 1993. His research interests include robotics,<br />
lightweight robot arms, and hyper-redundant robots.<br />
Prof. Dimiter Driankov received the BSc Math degree, the MSc degree in Computer Science<br />
from the University of Sofia, Faculty of Mathematics, Sofia, Bulgaria, and the PhD degree in<br />
Computer Science from the Univ. of Linköping, Linköping, Sweden in 1973, 1975, and 1988<br />
respectively. From 1985 to 2000 he was with the Dept. of Comp. Sci., Univ. of Linköping<br />
where he was heading the Autonomous Systems Lab (1996-1999). At present he is a visiting<br />
researcher with the Division for Artificial Intelligence and Integrated Computer Systems at<br />
this department and a member of the Wallenberg Lab for Information Technology and
66 AASS – Center for Applied Autonomous Sensor Systems<br />
Autonomous Systems. Since 2001 he is a professor at the Technology Dept., Örebro Univ.,<br />
Örebro, Sweden acting as a research coordinator for the Applied Autonomous Sensor Systems<br />
Centre. During the period 1990--1997 he has spent a total of three years as Visiting Scientist<br />
at Siemens Corporate R & D, Munich, Germany.<br />
Dimiter Driankov is a member of the IEEE Technical Committee on Intelligent Control and<br />
on the editorial board of the Int. Journal of Uncertainty, Fuzziness and Knowledge-based<br />
Systems. He has co-authored and authored more than 40 conference, journal articles, and<br />
book chapters, 2 books, and 3 edited volumes in the areas of fuzzy logic and fuzzy control. He<br />
is a coordinator for a EC Marie Curie Training Site in the area of autonomous robotic<br />
systems. His current research interests and activities are in the areas of model-based fuzzy<br />
control, computational theories of perception, and perception-based control of autonomous<br />
vehicles.<br />
Christer Lindkvist was born in Örebro, Sweden, on December 23, 1954. He received his<br />
BSc degree in 1988 from Örebro University. From July 1, 1989 he works as teacher in the<br />
Department of Technology, Örebro University. In the fall of 2001 he became a graduate<br />
student with AASS, Örebro University. His current research interests include distributed<br />
component-based systems.<br />
Gustav Tolt was born in Örebro, Sweden, on January 14, 1975. He received MSc degree in<br />
engineering physics (specialization in signal processing and image analysis) from Chalmers<br />
University of Technology, Gothenburg, Sweden. Since February 2000 he is a graduate student<br />
at AASS, Örebro University. His research interests include high-speed image processing and<br />
computer vision.<br />
Lars Jennergren received his MSc in Mechanical engineering at the Technical University of<br />
Luleå, Sweden in 2002. His main subject was production engineering; this was also the area<br />
of his thesis work conducted at SKF, Gothenburg, Sweden. Since April 2002 he is a graduate<br />
student within a project conducted in co-operation between SIK, Swedish institute for food<br />
and biotechnology, and AASS, Örebro University, Sweden. His research includes<br />
requirements and building of a flexible assembly cell for ready-to-eat meals including topics<br />
such as production strategies, flexible cell layout, grasping and manipulation of fragile items,<br />
such as food.<br />
Thorsten Michelfelder was born in Freiburg im Breisgau, Germany, in 1977. He received his<br />
BEng degree in mechatronics at FH Karlsruhe. Now he is completing his MSc at Örebro<br />
University and is a part-time research assistant at AASS. His research interests include<br />
mechatronics systems and robotics.<br />
Thomas Uppgård was born in Avesta, Sweden on Mars 8, 1978. He received the MSc degree<br />
in Computer Engineering from Örebro University, Örebro, Sweden 2002. He is since fall<br />
2003 an industrial PhD student at the Centre for Applied Autonomous Sensor Systems at<br />
Örebro University in cooperation with ABB Automation Technology Products. His research<br />
interests are visual based control of continuous webs and flows.
Annual Report <strong>2004</strong> 67<br />
Alexander Skoglund is a Ph.D. student at the Dept. of Technology, Örebro University<br />
between the Learning Systems and Intelligent Control Laboratories at AASS. He received the<br />
B.Sc. degree in Electrical and Electronic Engineering in 1998 and his M.Sc. degree in<br />
Electrical and Electronic Engineering in 2002, both from Örebro University. Between 2000-<br />
2001 he worked at AerotechTelub as a radio engineer, and from 2001-2003 at AASS, Dept. of<br />
Technology, Örebro University as a research engineer. Since February 2003 he has been a<br />
graduate student with research interests in robotic manipulation and learning.<br />
Mikael Soron was born in Motala, Sweden, on February 12, 1975. He received his MSc<br />
degree in Computer Technology in 2003 from Örebro University, Örebro, Sweden. Since<br />
June 2003 he is an industrial PhD student at AASS, Örebro University, in co-operation with<br />
Robotdalen. His research interests include robotic control for Friction Stir Welding.
68 AASS – Center for Applied Autonomous Sensor Systems<br />
2.4 Learning Systems Lab<br />
Our objective is to advance the state-of-the-art in the theory and practice of learning and<br />
adaptation in autonomous sensor systems. This will be achieved by developing strongly<br />
autonomous agents with the capacity to learn from experience and thus to adapt to highly<br />
dynamic and uncertain environments and working scenarios.<br />
These situations are very difficult to model by traditional methods of numerical analysis due<br />
to the highly unpredictable nature of both the agent's sensory perceptions and the effects of<br />
motor actions, and the presence of other agents such as humans. We therefore focus on<br />
learning and adaptation through interaction of the agent with the user and environment. The<br />
techniques that we apply include unsupervised, supervised and reinforcement learning<br />
algorithms, including artificial neural networks, genetic algorithms, self-organisation, etc.<br />
2.4.1 Research directions<br />
The research focus of the Learning Systems Lab is the development of robots and<br />
autonomous systems that can improve performance by learning from their own sensor<br />
information and/or sensor-motor experience. We concentrate on three major research<br />
directions in particular:<br />
1. Navigation systems<br />
This covers learning of spatial representations and behaviours in mobile robotic systems<br />
that have various levels of autonomy, by application of state-of-the-art in sensor and<br />
measurement technology.<br />
2. Learning control<br />
This covers learning of robotic skills and behaviours from human demonstration, selforganisation<br />
and reinforcement learning, including control of both mobile robots and<br />
robotic manipulators.<br />
3. Perception systems<br />
This covers pattern recognition and self-organisation in robotics and automation,<br />
including recognition of people, objects and places by autonomous robots, and automatic<br />
sensory analysis in the Future Food Factory.<br />
The research methodology of the Learning Systems Lab is based on developing theoretically<br />
sound solutions to real world problems, and places strong emphasis on empirical methods,<br />
including use of performance metrics, quantitative comparisons of actual systems, and<br />
statistical tests of significance.<br />
In what follows we describe the work done in <strong>2004</strong> on specific projects from the above three<br />
research directions.
Annual Report <strong>2004</strong> 69<br />
2.4.2 Projects in <strong>2004</strong><br />
Project: Hierarchical learning of robot behaviours, J450<br />
Project leader: Tom Duckett<br />
Staff: Li Jun<br />
Funding: KK-foundation, Faculty and regional funding<br />
Synopsis:<br />
The project belongs to the research direction Learning Control. The project will develop a<br />
generic architecture for learning sensor-motor behaviours in robotic systems, without<br />
requiring pre-programmed symbolic representations. Instead, the robot will develop its own<br />
internal representations through a process of incremental on-line learning. One application of<br />
this technology would be programming by demonstration, where the human operator simply<br />
shows the robot what to do (e.g., "water my plants", "clean my bathroom", etc.). The<br />
behaviours acquired will be complex, non-linear and non-achievable by a purely reactive<br />
system, so the learning system must incorporate representations, which encode the temporal<br />
and spatial context of the task and environment. A particular challenge will be to carry out all<br />
of the learning in real-time. The project investigates the implementation of a hierarchy of<br />
fast, on-line learning algorithms that are integrated by layered learning. The techniques<br />
investigated include, but are not limited to, embedded machine learning algorithms such as<br />
self-organisation, recurrent artificial neural networks and reinforcement learning.<br />
Partners:<br />
University of Alicante, Spain (Assoc. Prof. Tomas Martinez).<br />
Results in <strong>2004</strong>:<br />
Li Jun successfully defended his Licentiate thesis in November <strong>2004</strong> (previously planned for<br />
May <strong>2004</strong>), and a journal article has been submitted based on this work.<br />
Future developments:<br />
Li Jun should be ready to defend Ph.D. Thesis around November 2005. This will<br />
involve incorporating reinforcement learning into the architecture for teaching by<br />
demonstration, based on the earlier work using growing RBF networks for function<br />
approximation in perception-based robot control. More substantial results and several more<br />
publications are urgently required.
70 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Enabling robot-human cooperation, J451<br />
Project leader: Tom Duckett<br />
Staff: Grzegorz Cielniak, Andre Treptow (Marie Curie fellow, Tuebingen University).<br />
Funding: KK-foundation, Faculty, regional funding and EU.<br />
Synopsis:<br />
The project belongs to the research direction Perception Systems. The ability to interact with<br />
people is an important requirement for robots, which operate in populated environments. In<br />
tasks such as cleaning, housekeeping, rehabilitation, entertainment, inspection and<br />
surveillance, so-called service robots need to communicate and cooperate with people. To<br />
enable this interaction, the robot needs to know how many people there are in the<br />
neighbourhood, their position, and who they are (the three fundamental problems of people<br />
detection, localisation and identification).<br />
The platform for this research is a mobile robot equipped with vision, thermal, omnidirectional<br />
vision and laser sensors. In current work, we are integrating methods for detection,<br />
localisation and identification of persons by a mobile robot using vision, thermal and laser<br />
data. The eventual goal is to obtain 95% recognition performance within a few seconds by a<br />
moving mobile platform on a database comprising the members of AASS. Possible themes for<br />
future research include recognition, interpretation and prediction of human behaviour.<br />
Partners:<br />
Autonomous Intelligent Systems Group, Freiburg University, Germany (Prof. Wolfram<br />
Burgard).<br />
University of Tuebingen, Computer Science Dept., Germany. (Prof. Andreas Zell).<br />
Results in <strong>2004</strong>:<br />
Two journal articles accepted for publication: one appeared in <strong>2004</strong> (J. Intelligent and Fuzzy<br />
Systems) and one will appear in 2005 (Int. J. Robotics Research). Paper presented at<br />
SAIS/SLSS Workshop in Lund, Sweden, April 15-16, <strong>2004</strong>. A major development was the<br />
visit of Andre Treptow, a Marie Curie fellow and Ph.D. student from Tuebingen University.<br />
This resulted in a working system for tracking of people in thermal images and then tracking<br />
of the face region in a greyscale image using Particle Filters, and some first results in<br />
identification using Eigenfaces.<br />
Future developments:<br />
Grzegorz Cielniak to defend Ph.D. Thesis around December 2005. Subsequent work for the<br />
Ph.D. will include person identification, e.g., by improved face recognition, integration of the<br />
two previous works on high-level/global tracking with Abstract Hidden Markov Models (with<br />
Freiburg Univ.) and lower-level/local tracking with Particle Filters (with Tuebingen Univ.),<br />
and final evaluation of the complete system with respect to the project goals.
Annual Report <strong>2004</strong> 71<br />
Project: Simultaneous localisation and mapping, J452<br />
Project leader: Tom Duckett<br />
Staff: Peter Biber (Marie Curie fellow, Tuebingen University).<br />
Funding: Faculty and EU (Marie Curie programme)<br />
Synopsis:<br />
The project belongs to the research direction Navigation Systems. Maps are essential for<br />
mobile robots navigating in non-trivial environments, being needed for tasks such as path<br />
planning, manipulation of objects, and communication with humans. To navigate in unknown<br />
environments, an autonomous robot requires the ability to build its own map while<br />
simultaneously maintaining an estimate of its own position. This is a hard problem because<br />
the same, noisy sensor data must be used for both mapping and self-localisation.<br />
Most existing solutions to the problem of simultaneous localisation and mapping (SLAM)<br />
work by decoupling the localisation and mapping processes, assuming that the data<br />
association problem (i.e., landmark identification) is already solved when measurements are<br />
updated into the map. However, this assumption is bound to fail eventually for robots<br />
operating in difficult or populated environments. This project investigates robust SLAM<br />
algorithms that take into account both the measurement uncertainty (e.g., due to sensor noise)<br />
and identification uncertainty (e.g., due to perceptual aliasing).<br />
Partners:<br />
BISS, University of Bremen, Germany (Dr. Udo Frese).<br />
WSI-GRIS, Tuebingen University, Germany (Prof. Wolfgang Strasser)<br />
Results in 2003:<br />
Journal article (IEEE Trans. Robotics) on multi-level relaxation accepted for publication (with<br />
Bremen Univ.). Paper on 3D modelling presented at IROS’04, Japan (with Tuebingen Univ.<br />
and Henrik Andreasson, AASS). A major development was the visit of Peter Biber, a Marie<br />
Curie fellow and Ph.D. student from Tuebingen University. This resulted in the development<br />
of a new approach for lifelong learning in dynamic environments, so that the robot’s map is<br />
adapted perpetually over time.<br />
Future developments:<br />
Future work will include further theoretical and practical developments, including more work<br />
on evolutionary algorithms for handling the data association problem in SLAM, and<br />
experiments in outdoor mapping.
72 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Navigation by smell, J453<br />
Project leader: Tom Duckett<br />
Staff: none yet.<br />
Funding: Faculty<br />
Synopsis:<br />
The project belongs to the research direction Navigation Systems. Smell is perhaps the least<br />
studied sense in robotic applications. Gas sensor systems known as "electronic noses" have<br />
been widely used under laboratory conditions, e.g., for food analysis, but so far there have<br />
been few applications on mobile platforms in real world environments, e.g., for use by<br />
intelligent service robots. There are a number of reasons why this should be so, including the<br />
complexity of the sample handling process and environmental influences such as air<br />
turbulence.<br />
This project investigates mechanisms for navigation using olfaction, especially concerning the<br />
problem of gas source localisation in indoor environments that are not artificially ventilated<br />
(thus a strong constant airflow cannot be assumed, as in other works). Several different<br />
approaches are considered, including gas concentration mapping, reactive sensor-motor<br />
behaviours, and re-implementation of the navigation strategies used by biological systems.<br />
Partners:<br />
Computer Science Dept., University of Tuebingen, Germany (Dr. Achim Lilienthal).<br />
Results in <strong>2004</strong>:<br />
Two journal articles were published in <strong>2004</strong> (RSJ J. Advanced Robotics, Robotics and<br />
Autonomous Systems) with Achim Lilienthal (Tuebingen Univ.)<br />
Future developments:<br />
Depends on whether an additional full time researcher can be recruited to the Learning<br />
Systems Lab.
Annual Report <strong>2004</strong> 73<br />
Project: Sensory analysis in the future food factory, J455<br />
Project leader: Tom Duckett<br />
Staff: Per Munkevik Gunnar Hall (SIK, Gothenburg).<br />
Funding: Faculty, regional funding, SIK, Gothenburg and Delfoi AB.<br />
Synopsis:<br />
The project belongs to the research direction Perception Systems. The most common way<br />
today to make descriptions, analyses and inspections of food products is to use people, either<br />
in the production line or in sensory evaluation panels. In the production line they discriminate<br />
invalid products from valid ones but they are also a possible source for contamination of the<br />
food. There are two kinds of sensory evaluation panels; one is a customer panel and the other<br />
is an expert panel used to describe the properties of the evaluated food product.<br />
This project tries to find a solution to make inspections, descriptions and sensory evaluations<br />
of food, especially ready meals, without using people. The main approach at the moment is to<br />
use a sensor system consisting of a digital camera and an electronic nose to get samples of<br />
meals. A segmentation algorithm is used to extract the contents of the meal. Several features<br />
are extracted for each component, e.g., concerning its shape and position on the plate and its<br />
sensory properties. A pattern recognition system is then used to make a quality evaluation of<br />
the meal.<br />
Partners:<br />
SIK (The Swedish Institute for Food and Biotechnology), Gothenburg.<br />
Results in <strong>2004</strong>:<br />
Paper presented at International Conference on Engineering and Food (ICEF9), Montpellier,<br />
France, March 7-11, <strong>2004</strong>. All research work completed for Lic. Thesis.<br />
Future developments:<br />
Per Munkevik to defend Lic. Thesis in March. 2005. Project ends unless further funding to<br />
Ph.D. can be found. Two journal articles to be submitted.
74 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Learning control of robot arms, J460<br />
Project leader: Tom Duckett<br />
Staff: Alexander Skoglund, Rainer Palm (AASS Intelligent Control Lab).<br />
Funding: KK-foundation, Faculty. In addition the three month stay of a student financed by<br />
EU (Marie Curie programme).<br />
Synopsis:<br />
The project belongs to the research direction Learning Control. To manually program a robot<br />
is a tedious job for anyone. It would be much more convenient to just show the robot what to<br />
do, and for the robot to learn the required behaviour automatically (this type of learning is<br />
often known as "teaching by demonstration" or "teaching by showing"). How to capture and<br />
apply a human's control abilities for driving a robot arm to perform human-like actions is the<br />
main objective of this research. Moreover, the goal is to create a solution such that the<br />
developed techniques are embedded in the control system of an actual robot arm.<br />
Our approach is to measure and model the human behaviour, without restricting the motion of<br />
the human. The eventual aim of the project is to substitute the human subject (e.g., an<br />
operator at a machine) with the robot arm. The platform for this project incorporates a<br />
"shapetape" sensor for human motion capture, which measures bend and twist at 16 sensor<br />
locations along the human arm, and a lightweight robot arm PANDI-1 developed in-house<br />
within the Intelligent Control Laboratory at AASS. Future work will investigate other sensors<br />
mounted on the robot arm to enable autonomous operation.<br />
Partners:<br />
Parma University, Italy (previous Marie Curie student, Jacopo Aleotti).<br />
Siemens AG, Munich, Germany. (Dr. Rainer Palm).<br />
Results in <strong>2004</strong>:<br />
Paper presented at International Conf. on Manipulation and Grasping (IMG’04), Genoa, Italy,<br />
July 1-2, <strong>2004</strong> (with Parma University). Initial experiments in reinforcement learning and<br />
development of a demonstration system based on a human arm model.<br />
Future developments:<br />
Integration of human arm demonstration system within the framework of supervised<br />
reinforcement learning, as a general methodology for teaching by showing. Specific<br />
experimental work on robotic manipulators. More substantial results and further publications<br />
are needed.
Annual Report <strong>2004</strong> 75<br />
Project: Object recognition by autonomous robots, J457<br />
Project leader: Tom Duckett<br />
Staff: Henrik Andreasson<br />
Funding: KK-foundation, Faculty and regional funding.<br />
Synopsis:<br />
The project belongs to the research direction Perception Systems. Object recognition has been<br />
a topic of interest for researchers in computer vision, artificial intelligence, the cognitive<br />
sciences and robotics. Without this ability, the possibilities for robots to carry out useful tasks<br />
remains limited. The object recognition systems that exist today are usually solved on a<br />
system-by-system basis, using recognition techniques that are hand-crafted for a small class<br />
of objects in one particular application.<br />
This project tries to find a more general way of doing object recognition without requiring<br />
pre-installed specifications or models of the object to be recognised. The main approach<br />
investigated in current work is using the motion of a robot to acquire an internal<br />
representation of a given object using structure from motion or optic flow. The main sensor<br />
used for current experiments is an Omni-directional camera.<br />
Partners:<br />
Autonomous Intelligent Systems Group, Freiburg University, Germany (Prof. Wolfram<br />
Burgard).<br />
University of Tuebingen, Computer Science Dept., Germany. (Prof. Andreas Zell).<br />
Results in <strong>2004</strong>:<br />
Paper on place recognition using local features presented at Symposium on Intelligent<br />
Autonomous, Portugal, July 5-7, <strong>2004</strong>, and extension of this work to the global localisation<br />
problem with Particle Filters accepted for ICRA’05, Barcelona, April 18-22 (with Tuebingen<br />
Univ.). A major development was the visit of Henrik Andreasson to Freiburg University as a<br />
Marie Curie fellow. This resulted in a new approach for fusing 3D-laser and colour<br />
information for environment modelling.<br />
Future developments:<br />
Fusion of 3D range-finder data and colour information for object recognition by mobile<br />
robots, focussing on this topic for the Ph.D. Thesis, and eventual defence around 2007.
76 AASS – Center for Applied Autonomous Sensor Systems<br />
Project: Semi-autonomous mapping by UAV-UGV cooperation, J417<br />
Project leader: Tom Duckett<br />
Staff: Martin Persson<br />
Funding: KK-foundation, AerotechTelub AB and Faculty.<br />
Synopsis:<br />
This project belongs to the research direction Navigation Systems. Mapping an outdoor<br />
environment implies new challenges for mobile robots. This project investigates the use of<br />
Semi-autonomous mapping, SAM, in this context. The basic idea is to use some a priori<br />
information in the form of a sketch map to assist the mapping process. The sensor<br />
measurements of the robot are used to add information to the map and to correct the sketch<br />
map where it is wrong. The sketch map may contain information extracted from an aerial<br />
image, hand-drawn map, geographic information system, etc. It may have low resolution,<br />
incorrect scale, and contain errors.<br />
The platform for this research is an integrated robotic system comprising an unmanned aerial<br />
vehicle, UAV, and its commands to an unmanned ground vehicle, UGV. The UAV is<br />
simulated in a simulation environment for aerial visual servoing (SEAVS) that uses<br />
orthographic satellite and aerial images. These are draped on an elevation grid giving realistic<br />
3D images from a nadir view. The UGV is a real ATRV-Jr mobile robot equipped with an<br />
array of positioning, vision and range finder sensors for autonomous outdoor navigation.<br />
Applications of this technology would include terrain and urban mapping, search and rescue<br />
operations, and planetary exploration.<br />
Partners:<br />
Aerotech Telub, AB.<br />
Results in <strong>2004</strong>:<br />
Research project on extraction of man-made structures from aerial images, paper submitted to<br />
forthcoming CIRA’05 workshop in Finland.<br />
Future developments:<br />
Investigate detection of the same structures by an outdoors-mobile robot using on-board<br />
sensors, extraction of relevant features from a hand-drawn sketch, and data fusion in a single<br />
map representation. More substantial results and further publications are needed.
Annual Report <strong>2004</strong> 77<br />
Project: Learning Optimal Control, J456<br />
Project leader: Tom Duckett<br />
Staff: none.<br />
Funding: Faculty<br />
Synopsis:<br />
This project documents the work carried out by Assoc. Prof. Tomas Martinez of Alicante<br />
University, Spain, on his research visits to AASS in 2003 and <strong>2004</strong>. The work concerns a<br />
visual servoing approach for a mobile manipulation task, in which the Peoplebot mobile robot<br />
has to move towards an object located on a table (docking) and then pick up that object with<br />
its gripper (grasping). The approach belongs to the family of techniques known as imagebased<br />
visual servoing. A novel reinforcement learning algorithm incorporating planning is<br />
used to learn a time-optimal control policy.<br />
Partners:<br />
University of Alicante, Spain (Assoc. Prof. Tomas Martinez).<br />
Results in <strong>2004</strong>:<br />
Paper published in proceedings of IEEE Int. Conf. Robotics, Automation and Mechatronics<br />
(RAM’04), Singapore, December 1-3, <strong>2004</strong>. Paper accepted for IEEE Int. Conf. Robotics and<br />
Automation (ICRA’05), Spain, April 18-22, 2005.<br />
Future developments:<br />
Further experiments and submit journal article.
78 AASS – Center for Applied Autonomous Sensor Systems<br />
2.4.3 Staff<br />
Tom Duckett is a Docent (Associate Professor) at the Dept. of Technology, Örebro<br />
University and leader of the AASS Learning Systems Lab. He received the B.Sc.(Hons)<br />
degree in Computer and Management Sciences from Warwick University, U.K., in 1991.<br />
After working in industry as an Analyst/Programmer for several years, he was awarded an<br />
M.Sc. with distinction in Knowledge Based Systems by Heriot-Watt University, U.K., in<br />
1995. His M.Sc. dissertation was carried out as an ERASMUS exchange student at Karlsruhe<br />
University, Germany.<br />
Tom Duckett received his Ph.D. on concurrent map building and self-localisation for mobile<br />
robot navigation from Manchester University, U.K., in 2000, including a research visit to<br />
Bremen University, Germany, on landmark selection for mobile robot navigation. He has<br />
authored 8 journal articles and 33 full paper refereed conference papers, and is a regular<br />
reviewer for many international conferences and journals. He also has 9 years of teaching<br />
experience at university level. His research interests include mobile robotics, navigation,<br />
SLAM, machine learning, AI, learning control, robotic olfaction, and recognition systems for<br />
autonomous robots.<br />
Li Jun is a Ph.D. student at the Dept. of Technology, Örebro University in the AASS<br />
Learning Systems Lab. He received the B.S. and M.S. degree from Gui Zhou University of<br />
Technology, Gui Zhou, China, in 1982 and 1985 respectively. His current research interests<br />
include theory and application of artificial neural network learning, specifically for<br />
autonomous mobile robotic systems.<br />
Grzegorz Cielniak is a Ph.D. student at the Dept. of Technology,<br />
Örebro University in the AASS Learning Systems Lab. He was born<br />
in Krapkowice, Poland in 1975. He received his MSc degree in<br />
robotics in 2000 at the Wroclaw University of Technology, Wroclaw,<br />
Poland. Since January 2001 he has been a graduate student at AASS.<br />
His current research interests include artificial intelligence, robot<br />
learning and vision systems.<br />
Henrik Andreasson is a Ph.D. Student at the Dept. of Technology,<br />
Örebro University in the AASS Learning System Lab since October<br />
2002. He received his M.Sc. degree in Mechatronics at the Royal<br />
Institute of Technology, Stockholm, Sweden in 2001. Since October<br />
2002 he has been a graduate student at AASS. His current research<br />
interests include robotic vision and learning.<br />
Per Munkevik is a joint Ph.D. student between the AASS Learning<br />
Systems Lab at the Dept. of Technology, Örebro University, and SIK,<br />
Gothenburg since November 2002. He received the M.Sc. degree in<br />
Computer Science in 2002 at Luleå University of Technology. His<br />
current research includes pattern recognition, artificial neural<br />
networks, sensory science and learning algorithms for food quality<br />
evaluation. The objective is to perform automatic sensory evaluations<br />
of food products, especially ready meals.
Annual Report <strong>2004</strong> 79<br />
Martin Persson was born in Lund, Sweden, on June 1, 1970. He received his M.Sc. in<br />
Applied Physics and Electronic Engineering from the University of Linköping, Sweden, in<br />
1994. AerotechTelub has employed him since 1994 as a system engineer working mainly with<br />
guidance, control and simulation models for dispenser weapon systems and stand-off missiles.<br />
Since 1999 he has been an industrial PhD student with AASS at Örebro University. He<br />
received his Licentiate degree from AASS, Örebro University in 2002. His research interests<br />
include visual servoing in aerial applications and semi-autonomous mapping for mobile<br />
robots.<br />
Alexander Skoglund is a Ph.D. student at the Dept. of Technology, Örebro University<br />
between the Learning Systems and Intelligent Control Laboratories at AASS. He received the<br />
B.Sc. degree in Electrical and Electronic Engineering in 1998 and his M.Sc. degree in<br />
Electrical and Electronic Engineering in 2002, both from Örebro University. Between 2000-<br />
2001 he worked at AerotechTelub as a radio engineer, and from 2001-2003 at AASS, Dept. of<br />
Technology, Örebro University as a research engineer. Since February 2003 he has been a<br />
graduate student with research interests in robotic manipulation and learning.
80 AASS – Center for Applied Autonomous Sensor Systems<br />
3. Publications<br />
3.1 Books (incl. PhD/Lic theses) and edited volumes<br />
1. Lindquist, Malin. Electronic Tongue for Water Quality Assessment, Licentiate thesis,<br />
Örebro University Studies in Technology 15, <strong>2004</strong>.<br />
2. B. Iliev. Minimum-time Sliding Mode Control of Robot Manipulators. Doctoral<br />
Dissertation, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />
3. L. Jennergren. Flexible Assembly of Ready-to-eat Meals, Licentiate thesis, Örebro<br />
University Studies in Technology Series, <strong>2004</strong>.<br />
4. Pettersson, O. Model-Free Execution Monitoring in Behaviour-Based Mobile Robots.<br />
PhD thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />
5. S. Coradeschi and A. Saffiotti (Eds.) Proceedings of the AAAI-04 Workshop on<br />
Anchoring Symbols to Sensor Data. AAAI Press (Menlo Park, CA, <strong>2004</strong>).<br />
3.2 Chapters in edited volumes<br />
1. Loutfi, A., Lindquist M. and Wide P. Artificial Perceptual Systems, Book chapter, In<br />
Handbook of Sensor Networks, CRC Press, <strong>2004</strong><br />
3.3 Journals<br />
1. R. Palm. Synchronization of Decentralized Multiple-Model Systems by Market-Based<br />
Optimization. IEEE Trans. SMC B, Vol. 34, No 1 Feb. <strong>2004</strong>, pp. 665-672<br />
2. G. Cielniak and Tom Duckett. People Recognition by Mobile Robots. Journal of<br />
Intelligent and Fuzzy Systems, Vol. 15, No. 1, pp. 21-27, <strong>2004</strong><br />
3. Achim Lilienthal and Tom Duckett, Experimental Analysis of Gas-Sensitive Braitenburg<br />
Vehicles. RSJ Journal of Advanced Robotics, Vol. 18, No. 8, pp. 817-834, <strong>2004</strong>.<br />
4. Achim Lilienthal and Tom Duckett, Building Gas Concentration Gridmaps with a Mobile<br />
Robot. Robotics and Autonomous Systems, Vol. 48, No. 1, pp. 3-16, <strong>2004</strong>.<br />
5. E. Pagello, E. Menegatti, A. Bredenfel, P. Costa, T. Christaller, A. Jacoff, D. Polani, M.<br />
Riedmiller, A. Saffiotti, E. Sklar, T. Tomoichi. RoboCup-2003: New Scientific and<br />
Technical Advances. AI Magazine 25(2):81-98, <strong>2004</strong><br />
6. B. Kadmiry, Pr. D. Driankov: Fuzzy Gain Scheduler for Attitude Control of an<br />
Unmanned Helicopter (*) (Special issue) on IEEE Transactions on Fuzzy Systems<br />
Journal (TFS), ISSN: 0163-6706, Vol.12 /4, pp. 502-515, August <strong>2004</strong>
Annual Report <strong>2004</strong> 81<br />
3.4 Conference papers<br />
1. M. Lindquist, P. Wide, New Sensor System for Drinking Water Quality. In Sensors for<br />
Industry Conference, New Orleans, USA, Feb <strong>2004</strong>.<br />
2. B. Iliev, I. Kalaykov. Minimum-time sliding mode control for second-order systems.<br />
In Proc. American Control Conference, ACC'04, June 30-July 3, <strong>2004</strong>, Boston, USA.<br />
3. I. Hristozov, B. Iliev and S. Eskiizmirler. A combined feature extraction method for an<br />
electronic nose, In Proc. of Information Processing and Management of Uncertainty<br />
IPMU’ 04, Perugia, Italy, July <strong>2004</strong>.<br />
4. L. Robertsson and P. Wide. Analysis bacteriological growth using wavelet transform. In<br />
Proceedings IMTC’04, Como, Italy <strong>2004</strong><br />
5. I. Hristozov, B. Iliev and S. Eskiizmirler. A combined feature extraction method for an<br />
electronic nose, In Proc. of Information Processing and Management of Uncertainty<br />
IPMU’ 04, Perugia, Italy, July <strong>2004</strong>.<br />
6. Tolt, G. A Fuzzy Approach for Detecting Multi-junctions in Edgeness Images. Proc. of<br />
IASTED Conf. on Visualization, Imaging and Image Processing, pages 420-424,<br />
Marbella, Spain, <strong>2004</strong>.<br />
7. J. L. Granter, R. Gottipati, G. A Fodor, Fuzzy Logic Enabled Software Agents for<br />
Supervisory Control. Proc. of the FUZZ-IEEE Conference, Budapest, 27-29 July <strong>2004</strong>.<br />
8. T. Martínez-Marín and T. Duckett, Reinforcement Learning in a Visual Servoing<br />
Framework. Proc. IEEE Int. Conference on Robotics, Automation and Mechatronics<br />
(RAM'04), Singapore, December 1-3, <strong>2004</strong>.<br />
9. Peter Biber, Henrik Andreasson, Tom Duckett and Andreas Schilling. 3D Modelling of<br />
Indoor Environments by a Mobile Robot with a Laser Scanner and Panoramic Camera.<br />
Proc. IEEE/RSJ Int. Conference on Intelligent Robots and Systems (IROS <strong>2004</strong>), Sendai,<br />
Japan, September 28 - October 2, <strong>2004</strong>.<br />
10. Jacopo Aleotti, Alexander Skoglund and Tom Duckett. Teaching Position Control of a<br />
Robot Arm by Demonstration with a Wearable Input Device. Proc. IMG04, International<br />
Conference on Intelligent Manipulation and Grasping, Genoa, Italy, July 1-2, <strong>2004</strong>.<br />
11. Per Munkevik, Tom Duckett and Gunnar Hall. Vision System Learning for Ready Meal<br />
Characterisation Proc. International Conference on Engineering and Food (ICEF9),<br />
Montpellier, France, March 7-11, <strong>2004</strong>.<br />
12. Grzegorz Cielniak and Tom Duckett. People Recognition by Mobile Robots. Proc. AILS-<br />
<strong>2004</strong>, 2nd Joint SAIS/SSLS Workshop Lund, Sweden, April 15-16, <strong>2004</strong>.
82 AASS – Center for Applied Autonomous Sensor Systems<br />
13. Tom Duckett, Grzegorz Cielniak, Henrik Andreasson, Li Jun, Achim Lilienthal and Peter<br />
Biber. An Electronic Watchman for Safety, Security and Rescue Operations (abstract).<br />
Proc. SIMSafe <strong>2004</strong>, Improving Public Safety through Modelling and Simulation,<br />
Karlskoga, Sweden, June 15-17, <strong>2004</strong>.<br />
14. P. Buschka and A. Saffiotti. Some Notes on the Use of Hybrid Maps for Mobile Robots.<br />
Proc. of the 8th Int. Conf. on Intelligent Autonomous Systems (IAS) pp. 547-556.<br />
Amsterdam, NL, <strong>2004</strong>.<br />
15. M. Broxvall, L. Karlsson and A. Saffiotti. Steps Towards Detecting and Recovering from<br />
Perceptual Failures. Proc. of the 8th Int. Conf on Intelligent Autonomous Systems (IAS)<br />
pp. 793-800. Amsterdam, NL, <strong>2004</strong>.<br />
16. A. Loutfi and S. Coradeschi. Forming Odour Categories Using an Electronic Nose. Proc.<br />
of the European Conf. on Artificial Intelligence (ECAI) 119-124. Valencia, Spain, <strong>2004</strong>.<br />
17. R. Lundh, L. Karlsson and A. Saffiotti. Dynamic Configuration of a Team of Robots.<br />
Proc. of the ECAI-04 Workshop on Agents in Dynamic and Real-Time Environments.<br />
Valencia, Spain, <strong>2004</strong>.<br />
18. A. Loutfi, S. Coradeschi, L. Karlsson and M. Broxvall. Putting Olfaction into Action:<br />
Using an Electronic Nose on an Multi-Sensing Mobile Robot Proc. of the IEEE/RSJ Int.<br />
Conf. on Intelligent Robots and Systems (IROS). Sendai, Japan, <strong>2004</strong>.<br />
19. Janos L. Grantner, R. Gottipati, G.A. Fodor, Intelligent Fuzzy Controllers Laboratory,<br />
Proceedings of the <strong>2004</strong> ASEE Annual Conference.<br />
20. G. A. Fodor, The Case for Hierarchy-Mobile Agents in Industrial Informatics. Keynote<br />
talk. Proc. of the second IEEE International Conference on Industrial Informatics,<br />
INDIN'04, 24-26 June, Berlin, Germany, <strong>2004</strong>.<br />
21. G. A. Fodor, Formal and Architectural Competitive Factors in Industrial Informatics,<br />
Proc. of the second IEEE International Conference on Industrial Informatics, INDIN'04,<br />
24-26 June, Berlin, Germany, <strong>2004</strong>.<br />
22. L. Jennergren, I. Kalaykov, L. Ahrne. Requirements for assembly of ready-to-eat meals.<br />
Proc. of ICEF9 International Conference on Engineering and Food, Montpellier, France,<br />
7-11 March, <strong>2004</strong>.<br />
23. L. Jennergren, Optimizing the flexible assembly of ready-to-eat meals. Proc. of<br />
International Conference on Intelligent Manipulation and Grasping, Genoa, Italy, 1-2<br />
July, <strong>2004</strong>.<br />
24. L. Jennergren, I. Kalaykov. Human-free flexible assembly of ready-to-eat meals using<br />
visual feedback. Proc. of Food Factory <strong>2004</strong> Conference, France, 6-8 October, <strong>2004</strong>.
Annual Report <strong>2004</strong> 83<br />
25. A. Ananiev, I. Kalaykov, E. Petrov, B. Hadjiyski. Single-motor driven construction of<br />
hyper-redundant robot. Proc. of International Conference on Mechatronics and Robotics<br />
’04, Aachen, Germany, 13-15 September, <strong>2004</strong>, vol. 2, p. 543-547.<br />
3.5 Workshop and Symposium papers<br />
26. R. Palm. Multi-Step-Ahead Prediction in Control Systems using Gaussian Processes and<br />
TS-Fuzzy Models. In Proceedings 14th Workshop Fuzzy Systeme und Computational<br />
Intelligence. Schriftenreihe d. Inst. f. Angew. Informatik/ Automatisierungstechnik Univ.<br />
Karlsruhe (TH) Band 6, <strong>2004</strong>, Universitätsverlag Karlsruhe, pp. 42-54.<br />
27. Henrik Andreasson and Tom Duckett. Topological Localization for Mobile Robots using<br />
Omni-directional Vision and Local Features. Proc. IAV<strong>2004</strong>, The 5th Symposium on<br />
Intelligent Autonomous Vehicles, Lisbon, Portugal, July 5-7, <strong>2004</strong>.<br />
28. Tom Duckett, Grzegorz Cielniak, Henrik Andreasson, Li Jun, Achim Lilienthal, Peter<br />
Biber and Tomás Martínez. Robotic Security Guard - Autonomous Surveillance and<br />
Remote Perception (abstract). Proc. IEEE International Workshop on Safety, Security,<br />
and Rescue Robotics, Bonn, Germany, May 24-26, <strong>2004</strong>.<br />
29. Dimiter Driankov, Tom Duckett and Alessandro Saffiotti. A System for Vision Based<br />
Human-Robot Interaction (short paper). Proc. IEEE International Workshop on Safety,<br />
Security, and Rescue Robotics, Bonn, Germany, May 24-26, <strong>2004</strong>.<br />
30. D. Herrero Pérez, H. Martínez Barberá and A. Saffiotti. Fuzzy Self-Localization using<br />
Natural Features on an AIBO Robot. Proc. of the Int. RoboCup Symposium. Lisbon,<br />
Portugal, <strong>2004</strong>.<br />
31. J.P Cánovas, K. LeBlanc and A. Saffiotti. Multi-Robot Object Localization by Fuzzy<br />
Logic. Proc. of the Int. RoboCup Symposium. Lisbon, Portugal, <strong>2004</strong>.<br />
32. A. Chella, S. Coradeschi, M. Frixione and A. Saffiotti. Perceptual Anchoring via<br />
Conceptual Spaces. Proc. of the AAAI-04 Workhsop on Anchoring. San Jose, CA, <strong>2004</strong>.<br />
33. R. Lundh, L. Karlsson and A. Saffiotti. Dynamic Configuration of a Team of Robots.<br />
Proc. of the ECAI-04 Workshop on Agents in Dynamic and Real-Time Environments.<br />
Valencia, Spain, <strong>2004</strong>.<br />
34. K. Bergstrand, K. Carlsson, P. Wide, B. Lindgren. Sound Detection in Noisy<br />
Environment – Location Drilling Sound by using an Artificial Ear. Proceedings of the<br />
<strong>2004</strong> International workshop on Robot Sensing. ROSE’<strong>2004</strong>. Graz, Austria, <strong>2004</strong>.<br />
35. M. Broxvall, S. Coradeschi, L. Karlsson and A. Saffiotti. Have Another Look: On<br />
failures and recovery planning in perceptual anchoring. Proc. Of the ECAI-04 Workshop<br />
on Cognitive Robotics. Valencia, Spain, <strong>2004</strong>.<br />
36. A. Bouguerra and L. Karlsson. Hierarchical Task Planning under Uncertainty. Proc. Of<br />
the 3 rd Italian Workshop on Planning and Scheduling. Perugia, Italy, <strong>2004</strong>.
84 AASS – Center for Applied Autonomous Sensor Systems<br />
37. Lucia Vacariu, B. P. Csaba, I. A. Letia, G. A. Fodor, O. Cret, A Multi-Agent Cooperative<br />
Mobile Robotics Approach for Search and Rescue Missions, IFAC Symposium on<br />
Intelligent Autonomous Vehicles, 5-7 July, Lisbon, Portugal, <strong>2004</strong>.<br />
38. G. Fodor, Information-Effective Industrial Architectures, Workshop paper, Proc of the<br />
IECON <strong>2004</strong> Conference (The 30-th Annual Conference of the IEEE Industrial<br />
Electronics Society), Nov. 2-6, <strong>2004</strong>, Busan, Korea.