10.05.2014 Views

annual report 2004 - Örebro universitet

annual report 2004 - Örebro universitet

annual report 2004 - Örebro universitet

SHOW MORE
SHOW LESS

Create successful ePaper yourself

Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.

Annual Report <strong>2004</strong><br />

Örebro <strong>universitet</strong> Örebro University<br />

Institutionen för teknik Department of technology<br />

701 82 Örebro SE-701 82 Örebro, Sweden


Annual Report <strong>2004</strong> 1<br />

Contents<br />

SUMMARY 2<br />

PREFACE 3<br />

1. CENTER FOR APPLIED AUTONOMOUS SENSOR SYSTEMS (AASS) 5<br />

1.1 ORGANISATION 9<br />

1.2 MANAGEMENT 12<br />

1.3 FUNDING 14<br />

1.4 UNDERGRADUATE EDUCATION 16<br />

1.5 GRADUATE EDUCATION 18<br />

1.6 CO-OPERATION 23<br />

1.7 DISSIMINATION OF INFORMATION 28<br />

2 RESEARCH LABS 34<br />

2.1 BIOLOGICAL INSPIRED SYSTEMS LAB 35<br />

2.2 MOBILE ROBOTICS LAB 42<br />

2.3 INTELLIGENT CONTROL LAB 56<br />

2.4. LEARNING SYSTEMS LAB 68<br />

3. PUBLICATIONS 80<br />

3.1 BOOKS (INCL. PHD/LIC THESIS) AND EDITED VOLUMES 80<br />

3.2 CHAPTERS IN EDITED VOLUMES 80<br />

3.3 JOURNALS 80<br />

3.4 CONFERENCE PAPERS 81<br />

3.5 WORKSHOP AND SYMPOSIUM PAPERS 82


2 AASS – Center for Applied Autonomous Sensor Systems<br />

Summary<br />

The Applied Autonomous Sensor Systems Centre (AASS) organizes all research and graduate<br />

education in the area of Autonomous Systems and also is responsible for the undergraduate<br />

and MSc programs in Computer Engineering (Datateknik) at the Dept. of Technology, at<br />

Örebro University, Örebro, Sweden. The research effort has a pronounced interdisciplinary<br />

character being a fusion of a variety of disciplines from Systems and Control, Measurement<br />

Technology and Sensors, Computer Science and Artificial Intelligence, and Operations<br />

Research but, with emphasis on Intelligent Control and Sensors, Machine Learning, Planning<br />

and Automated Reasoning, and Biologically Inspired Systems. The Applied Autonomous<br />

Sensor Systems Centre is organized in four laboratories, responsible for research and graduate<br />

education in their respective areas:<br />

1. Biologically Inspired Systems Laboratory (BIS)<br />

2. Mobile Robotics Laboratory (MR)<br />

3. Intelligent Control Laboratory (IC)<br />

4. Learning Systems Laboratory (LS)<br />

The common research focus for the four research laboratories is the subject of perception<br />

and autonomy in diverse un- and/or semi-structured environments. This subject is<br />

pursued using a common research methodology, which is strictly applied: all technologies<br />

under investigation should answer actual needs that emerge from an application, and their<br />

effectiveness is always validated on the application. Applications considered by AASS<br />

include mobile platforms, e.g., mobile robots, and immobile platforms, e.g., industrial plants<br />

and processes.<br />

This <strong>report</strong> presents AASS organization and management, developments in education, research<br />

and industrial co-operation, activities within the national/international research community, and<br />

various forms of societal interaction that have taken place in year <strong>2004</strong>. In this context, some<br />

important developments that characterize year <strong>2004</strong> are as follows:<br />

• Control and systems (Reglerteknik) was approved as a separate study program<br />

(forskarutbildningsämne) in graduate education. Prof. I. Kalaykov (IC Lab, AASS) is<br />

responsible for the new program and two Ph.D. students were already admitted in it.<br />

• AASS started an international cooperation under the framework of the "Ubiquitous robot<br />

companion" program, sponsored by the Korean government through its research agency<br />

ETRI. This is one of the most ambitious public programs in cognitive robotics in the world<br />

today.<br />

• S. Coradeschi has obtained a three-year grant from Vetenskapradet for the project<br />

"Anchoring Symbols to Sensor Data". This was the only 3-year grant awarded by<br />

Vetenskapsrådet to Örebro University this year.<br />

• During 2003/<strong>2004</strong> the BIS lab underwent re-organization, including changes in its staff<br />

and research directions. As a result, the BIS lab has now streamlined its activities within<br />

two related research directions: biologically inspired sensing and dexterous manipulation.


Annual Report <strong>2004</strong> 3<br />

Preface<br />

The Centre for Applied Autonomous Sensor Systems (AASS) was formally established in<br />

1996 at the Department of Technology with a grant from the KK-Foundation aimed at<br />

establishing the basis for a concentrated effort on interdisciplinary research in the area of<br />

Autonomous Systems with contributions to education. In the period 1996-<strong>2004</strong>, AASS has<br />

developed from a research group of 2 researchers and 2 PhD students to a full-fledged<br />

research centre with 4 professors, 2 associated professor (docent), 2 visiting professor (from<br />

industry), 4 researchers (PhD), 24 Ph.D. students, and technical and administrative personnel<br />

of 6. Now AASS plays an important educational role within the Department of Technology as<br />

well as has a leading position in the 4th strategic research profile of Örebro University –<br />

“Human senses, autonomous sensor systems, and industrial processes”.<br />

It also has achieved national/international recognition for its research results, established wellfunctioning<br />

industrial co-operation, and strong industrial presence with its participation in the<br />

Robotdalen - the largest Swedish 10-year innovation program in robotics funded by industry<br />

and the state innovation agency VINNOVA with the amount of 200 M SEK. In the context of<br />

these achievements, AASS has, during year <strong>2004</strong>, also had a measurable societal impact in a<br />

number of ways such as<br />

1. Industrial relevance: Partner in large-scale industrial projects with Atlas Copco Rock<br />

Drills AB (Örebro), ESAB AB (Laxå), Volvo Construction equipment AB (Eskilstuna),<br />

and Optab-Optronikinnovation AB (Karlskoga).<br />

2. European dimension: Co-operation within two EC research networks (EURON, and<br />

CLAWAR II) and a coordinator for EU FP5 Marie Curie Training Site.<br />

3. World dimension: AASS started an international cooperation under the framework of the<br />

"Ubiquitous robot companion" program, sponsored by the Korean government through its<br />

research agency ETRI. This is one of the most ambitious public programs in cognitive<br />

robotics in the world today.<br />

4. National dimension: Founding member of the VINNVÄXT/VINNOVA 10-year national<br />

innovation program "Robotdalen" together with MdH Mälardalen, and a large number of<br />

industrial and societal partners and public bodies.<br />

5. Public acceptance: responsible for the implementation of the Robotdalen project<br />

“Technology transfer and competence development (Teknikspridning och kompetenshöjning)''<br />

for the Örebro-node of Robotdalen.<br />

However, our most important contribution with long-term societal impact is our educational<br />

activity. Improving the content, quality, and degree-level of the undergraduate education in<br />

the Department of Technology in general and in Computer Engineering in particular is of<br />

highest priority. Thus undergraduate students with BSc, MSc, and Engineering degrees will<br />

remain our most important "output" - these students are to play important role in the<br />

development of regional and national industrial and business enterprises.


4 AASS – Center for Applied Autonomous Sensor Systems<br />

In this context, the preparatory work aimed at establishing a new engineering education (civing,<br />

180 p) in Mechatronics at the Dept. of Technology is completed and an application will<br />

be submitted to the Dept. of Higher Education (Högskoleverket) in the beginning of 2005. At<br />

the same time research and graduate education will be key factors in keeping with up-to-date<br />

technological developments, maintaining and further developing the scientific relevance and<br />

quality of undergraduate education, and last but not least, increasing the attractivity of Örebro<br />

University as an educational centre in a regional, national, and international perspective. On<br />

the other hand, our research and graduate education is of great value in itself – by doing<br />

research in the area of Autonomous Systems we contribute to the advancement of<br />

technologies at one of the frontiers of modern interdisciplinary science. A particular<br />

"practical" benefit is the reunification of Measurement, Control, and Computer Sciences into<br />

a disciplinary and technological continuum - a reunification that sadly is lacking today, to the<br />

growing discontent of industry. Thus, industrial co-operation will ensure that these<br />

technological advancements are adopted and their business potential is exploited.<br />

Certain "key" figures indicating that the development of the AASS research and educational<br />

profile is on the right track are:<br />

• Number of students in the Computer Engineering undergraduate program <strong>2004</strong>: 85<br />

• Number of MSc students in the Computer Engineering MSc program <strong>2004</strong>: 23.<br />

• Number of MSc theses completed under AASS supervision <strong>2004</strong>: 4.<br />

• Number of PhD students <strong>2004</strong>: 24 (1 PhD and 3 Licentiate degrees awarded in <strong>2004</strong>).<br />

• Number of ex-jobs completed under AASS supervision <strong>2004</strong>: 2.<br />

• Number of publications <strong>2004</strong>: 51<br />

• External funding <strong>2004</strong>: 54.2% of the total AASS budget.<br />

A continued strong support from our founders and academic/industrial partners shows that we<br />

have all reasons to be optimistic about our further development and contributions to<br />

education, industry, and society.


Annual Report <strong>2004</strong> 5<br />

1. Centre for Applied Autonomous Sensor Systems (AASS)<br />

The Applied Autonomous Sensor Systems Centre was formally established in 1996 with a<br />

grant from the KK-Foundation with the purpose of establishing the basis for a concentrated<br />

research effort in the interdisciplinary area of Autonomous Systems with expected<br />

contributions to education and industrial co-operation.<br />

Today AASS is nationally and internationally recognized for its research results and plays an<br />

important educational role within the Department of Technology and in the 4th strategic<br />

research profile of Örebro University – “Human senses, autonomous sensor systems, and<br />

industrial processes”. AASS has established well-functioning industrial co-operation - a<br />

number of industrial partners have developed a strong interest in AASS and support the<br />

research effort in terms of industrial PhD students, joint research projects, research-relevant<br />

equipment (hardware and software), and expertise (industrial employees acting as part-time<br />

AASS researchers).<br />

The industrial co-operation will be made even stronger as a result of our participation in the<br />

VINNOVA Robotdalen innovation program. The AASS research effort is organized on the<br />

basis of the following 4-pronged vision:<br />

1. Recognition by the international and national scientific community not only for AASS's<br />

active contributions to the state-of-the-art in core research areas, but also for its innovative<br />

role in establishing novel research topics that expand the frontiers of the science and<br />

technology for autonomous systems.<br />

2. Significant, long-term industrial interest in utilizing AASS's research results and<br />

educational capacity that will allow improvement of existing industrial technologies and<br />

products as well as, provide possibilities for exploring radically new solutions and future<br />

products.<br />

3. Significant contributions to educational programs at BSc, MSc and PhD-level of<br />

education.<br />

4. Leading role within the Örebro University's strategic research profile "Human Senses,<br />

autonomous sensor systems, and industrial processes''.<br />

In engineering terms, the fulfilment of the above vision will lead to:<br />

• Providing practitioners with methods for the design of engineering systems at all levels of<br />

control and sensing (low, supervisory and task-level) and whose needs are not met by<br />

existing conventional approaches. In educational terms, the fulfilment of the above vision<br />

will lead to:<br />

• The reunification of Measurement, Control, and Computer Sciences into an<br />

interdisciplinary disciplinary continuum - a reunification, which sadly is lacking today<br />

from existing educational programs.


6 AASS – Center for Applied Autonomous Sensor Systems<br />

Autonomous Systems<br />

Autonomous systems are mobile as well as immobile platforms that employ a vast array of<br />

sensors in order to analyze and/or influence highly dynamic environments. Examples of such<br />

systems include robotic systems, complex process control systems, flexible<br />

manufacturing/inspection systems, automotive systems, and unmanned underwater/land and<br />

air/space vehicles.<br />

In order to achieve an autonomous operation the system has to be supplied with the ability to:<br />

plan and schedule control/sensing actions at varying levels of detail and functionality; acquire<br />

and integrate sensory information at different levels of granularity and abstraction; learn how<br />

to adapt to initially unknown or changing environments; identify events that threaten the<br />

system's operation and react to these by reconfiguring its control and sensing routines.<br />

The design and analysis of autonomous systems has a pronounced interdisciplinary character<br />

being a fusion of a variety of disciplines from Systems and Control, Measurement<br />

Technology and Sensors, Computer Science and Artificial Intelligence, and Operations<br />

Research. This fusion is with emphasis on certain modern developments such as Fuzzy<br />

Systems, Intelligent Control and Sensors, Machine Learning, Planning and Automated<br />

Reasoning, and Biologically-inspired Systems.<br />

There are four major research areas that constitute the basis for autonomous systems research<br />

and development: Perception Science and Technology, Reasoning Science and Technology,<br />

Action Science and Technology, and Learning Science and Technology. These four research<br />

areas and the challenges posed by them are well recognized by the international research<br />

community and underpin the mainstream international research effort in the area of<br />

autonomous systems. Perception provides the means to gather information about the working<br />

environment - information that permits operations such as manufacturing, process control,<br />

navigation, monitoring, and manipulation to be accomplished safely and robustly. Reasoning<br />

is the "smarts" of an autonomous sensor system - it is the capacity to reason that provides the<br />

connection between perception and action.<br />

Action is ability to move in space and to manipulate objects in a safe and reliable manner - in<br />

case of robotic systems, or maintain certain desired behaviour in industrial plants/processes<br />

despite disturbances and limited knowledge of process/plant dynamics. Learning is needed to<br />

make technologies from the areas of Perception, Reasoning, and Action play a practical role<br />

in a variety of real-world dynamic, uncertain and unstructured environments.<br />

AASS research reflects these major research areas and - what is more important - aims at their<br />

integration in order to "produce" complete autonomous systems solutions. With the<br />

integration issues in mind <strong>2004</strong> is the starting year for a number of joint inter-lab projects.<br />

The integration projects are seen as central means for cross-fertilisation between the four<br />

laboratories and serve as a convincing demonstration platform towards industry and funding<br />

bodies. The joint projects address issues like: human-like motion control of robot arms;<br />

hybrid maps for mobile robots; Ready-to-eat-food assembly; and human-robot interaction.<br />

Their potential application is in a number of industrially relevant areas: inspection of<br />

industrial sites and installations, inspection of hazardous waste sites and waste manipulation,<br />

product and material monitoring in manufacturing, and rescue operations. Their industrial<br />

relevance is further reinforced by the present inadequacy of the predominant number of<br />

mobile robots/manipulators in industrial use: very limited autonomy, limited task range,


Annual Report <strong>2004</strong> 7<br />

predictability of behaviour only in well-structured and predictable environments, and limited<br />

sensing capabilities. AASS is organized around the following interrelated and mutually<br />

dependent permanent activities:<br />

1. Research projects, including technical support and pertaining to particular lab or "interlab"<br />

projects.<br />

2. Robotdalen projects, industrial projects defined within the Robotdalen framework.<br />

3. The AASS Graduate program, leading to both Licentiate and PhD degrees.<br />

4. The MSc program in Computer Engineering - an educational program at the Department<br />

of Technology reflecting AASS related research.<br />

5. Undergraduate studies in Computer Engineering at the Department of Technology.<br />

6. EU Marie Curie Training Program in advanced autonomous robotic systems - duration<br />

2002-2005.


8 AASS – Center for Applied Autonomous Sensor Systems<br />

Group picture, AASS Staff<br />

From the top left: Per Munkevik (PhD-student), Mikael Broström (Computer Support), Robert Lundh<br />

(PhD-student), Peter Wide (Professor), Anani Ananiev (Senior Researcher),<br />

Upper middle row: Ester Liljedahl (Administrative Manager), Abdelbaki Bouguerra (PhD-student),<br />

Henrik Andreasson (PhD-student), Lars Karlsson (Senior Researcher), Martin Magnusson (PhDstudent),<br />

Mikael Soron (PhD-student), Ivan Kalaykov (Lab leader, Professor), Kevin LeBlanc (PhDstudent),<br />

Lower middle row: Johan Larsson (PhD-student), Boyko Iliev (Lab leader, Senior Researcher),<br />

Mathias Broxvall (Senior Researcher), Grzegorz Cielniak (PhD-student), Malin Lindquist (PhDstudent),<br />

Linn Robertsson (PhD-student), Thorsten Michelfelder (PhD-student), Alexander Skoglund<br />

(PhD-student), Gustav Tolt (PhD-student), Per Sporrong (Research Engineer),<br />

Front row: Cipriano Andrades (Marie Curie-student), Jessica Karlsson (Information assistant), Silvia<br />

Coradeschi (Senior Researcher).<br />

Not present: Dimiter Driankov (Research Manager), Barbro Alvin (Administrative assistant), Pär<br />

Buschka (PhD-student), Tom Duckett (Lab leader), George Fodor (Adj. Professor), Lars Jennergren<br />

(PhD-student), Jun Li (PhD-student), Christer Lindkvist (PhD-student), Amy Loutfi (PhD-student),<br />

Jack Pencz (PhD-student), Martin Persson (PhD-student), Alessandro Saffiotti (Lab leader, Professor),<br />

Bo-Lennart Silverdahl (Research Engineer) Henrik Sturve (Economy assistant), Thomas Uppgård<br />

(PhD-student), Christoffer Wahlgren (PhD-student), Zbigniew Wasik (PhD-student).


Annual Report <strong>2004</strong> 9<br />

1.1 Organisation<br />

AASS is organized in matrix form, as shown in the figure below.<br />

AASS Management<br />

Prof. D. Driankov, Research Director<br />

E. Liljedahl, Administrative Manager<br />

Research Laboratories<br />

BIS Lab<br />

B.Iliev, PhD<br />

MR Lab<br />

Prof. A Saffiotti<br />

IC Lab<br />

Prof. I. Kalaykov<br />

LS Lab<br />

T. Duckett, Docent<br />

Research Projects<br />

Technical and Adm. Support Group: P.Sporrong, B-L.Silfverdal B. Alvin, J.Karlsson and H.Sturve<br />

Robotdalen Projects<br />

Project coordinators: D.Driankov and E.Liljedahl<br />

Graduate Program<br />

Director: L. Karlsson, PhD<br />

MSc Program in Computer Engineering<br />

Program Leader: L. Karlsson, PhD<br />

Undergraduate Studies at Division of Computer Engineering<br />

Director of Studies: S. Coradeschi, PhD<br />

EU Marie Curie Training Program in Autonomous Robotics (2002-2005)<br />

Program Coordinator Prof. D. Driankov<br />

The research labs reflect the four main directions in the research area of Autonomous<br />

Systems, i.e., BIS - Perception Science and Technology; ML - Reasoning Science and<br />

Technology; IC - Action Science and Technology; and LS - Learning Systems and<br />

Technology. Thus they represent competence areas within which basic research is conducted.<br />

According to their disciplinary competence, e.g., Computer Science, Computer Engineering,<br />

AI, Systems and Control, Machine Learning etc., they also provide resources - courses,<br />

teachers, and supervisors - for the graduate and undergraduate studies programs and the rest<br />

of the horizontal entries in the above figure:


10 AASS – Center for Applied Autonomous Sensor Systems<br />

1. Research projects are defined within labs (lab-specific projects), across labs (inter-lab<br />

projects), and/or cooperation with external partners (external projects). The lab leaders are<br />

responsible for the budget and project work on lab-specific projects and external projects.<br />

The AASS Research Director is also responsible for inter-lab projects. The technical<br />

support group provides technical assistance in the design and maintenance of robot<br />

platforms, sensor systems and the associated work with these software environments and<br />

programming tools:<br />

2. Robotdalen projects are industrial projects defined by the industrial partners from<br />

Robotdalen. These are typical “technology transfer” projects and at least one industrial<br />

PhD student is part of such a project while the scientific supervision is provided by AASS.<br />

At the current time there are three such projects. In addition AASS runs a project for<br />

dissemination of technology “Teknikspridning och Kompetenshöjning”, which aims to<br />

increase the interest, as well as the knowledge, for robotics and technology of youth and<br />

children.<br />

3. AASS Graduate program defines the PhD studies curriculum for all graduate students at<br />

AASS independent of their specific research area. The director of the program is<br />

responsible for its structure and contents, as well as the enrolment of graduate students<br />

and supervision of the formal aspects of progress in their PhD studies. The actual PhD<br />

thesis work and its supervision are done within the research labs. AASS graduate students<br />

have the possibility also to be enrolled in the Swedish National Graduate School in<br />

Computer Science (CUGS) where Örebro is one of the participating universities. The<br />

Director of the AASS Graduate program also is a member of the steering committee of<br />

CUGS.<br />

4. MSc program in Computer Engineering is a 4-year studies program, which upon its<br />

completion provides for 160 points of studies and leads to the degree “MSc in<br />

Technology, with profile in Computer Engineering”. The first two years of this program<br />

are common with the 3-year undergraduate program in Computer Engineering at the Dept.<br />

of Technology. The decision whether to join the MSc program is done upon the<br />

completion of the second year of the 3-year undergraduate program. The leader of the<br />

MSc program is responsible for the program's structure and courses’ content it’s<br />

monitoring and “marketing, contact with students, and BSc theses. In its current form the<br />

program contains courses directly related to the disciplinary and research competence at<br />

AASS.<br />

5. Undergraduate education in Computer Engineering is a 3-year studies program given<br />

within the Computer Engineering Division of the Department of Technology. The director<br />

of AASS also is director of the Computer Engineering Division, and Silvia Coradeschi, a<br />

researcher at AASS, is a director of studies for the Computer Engineering program who is<br />

responsible for both the three and four years programs. The responsibilities of the director<br />

include program teaching staff assignment and budget work etc. AASS research staff and<br />

PhD students are a natural part of the teaching staff.<br />

6. EU Marie Curie Training Program in Autonomous Robotics is a 4-year, EU-funded<br />

program, aimed at providing support for the training and mobility of PhD students<br />

throughout Europe. This scheme supports short stays by young researchers pursuing<br />

doctoral studies in the area of Autonomous Systems, providing them with the possibility<br />

of undertaking part of their doctoral studies in a country other than their own, and


Annual Report <strong>2004</strong> 11<br />

allowing them the benefit of working within an internationally recognized group - in this<br />

case AASS - in their specialized area of research - a particular AASS laboratory. The<br />

coordinator of the program is responsible for all organizational, management, and budget<br />

work as well as for contacts with the EU Commission, “marketing”, selection and<br />

enrolment of candidates. Actual research work supervision is done within the respective<br />

labs. In <strong>2004</strong> AASS has received 3 international Ph.D. students as Marie Curie fellows.


12 AASS – Center for Applied Autonomous Sensor Systems<br />

1.2 Management<br />

The management, evaluation, and monitoring of AASS activities are performed by the AASS<br />

Management Body, which consists of the AASS Research Director, Administrative Manager,<br />

and Lab-leaders. The major decisions made by the Management Body concern:<br />

1. Budget;<br />

2. Research strategies;<br />

3. Research/Education integration in the Computer Science (Datateknik) program;<br />

4. Long-term research/education planning and industrial cooperation;<br />

5. Recruitment;<br />

6. Personnel career development;<br />

7. AASS university/department role<br />

The AASS Research Director who chairs the steering committee is responsible for<br />

recruitment, career development, and interface with the department, the university and with<br />

industry and funding bodies. The Research Manager is also responsible for the formulation<br />

and progress of inter-lab projects, industrial projects, long-term research planning and<br />

recruitment needs, and planning and coordination of research grant applications. He also<br />

monitors the AASS Graduate Studies Program and prepares and organizes progress <strong>report</strong>s<br />

and evaluations concerning AASS activities. Two such <strong>report</strong>s, the AASS Activity Plan and<br />

AASS Annual Report, are each year submitted to the KK-Foundation (in January and March<br />

respectively).<br />

The AASS Administrative Manager is responsible for the budget preparation and the<br />

overview of the economy during the year. She also is responsible for agreements and our<br />

duties with <strong>report</strong>s and financial <strong>report</strong>ing towards the external partners. Marketing, external<br />

as well as internal information is some of the other duties. She is responsible for the AASS<br />

Support group, which also means recruitment and personnel planning for the long term as<br />

well as short-term work of the group.<br />

The Lab leaders are responsible for all issues pertaining to lab organization, management, and<br />

development. This includes, planning and coordination of lab-specific research projects as<br />

well as lab administration, e.g. budget handling, lab "marketing'' (internal and external), lab<br />

contributions to teaching, etc.<br />

The AASS Reference Group (RG) meets two times a year (December and June) and reviews<br />

AASS research and progress from both a scientific and industrial perspective. The RG can<br />

propose that certain corrections are made in order to keep AASS on the right track. At the RG<br />

December-meeting, the AASS Activity Plan is presented and approved. At the RG Junemeeting,<br />

the year after, the state of the AASS Activity Plan is reviewed.<br />

Currently the RG consists of:<br />

• Torbjörn Widmark, PhD, AssiDomän Frövi, Product Development & Technical Service,<br />

Frövi, Sweden - RG Chairman.<br />

• Thomas Christaller, Dr. Professor at Fraunhofer Institute for Autonomous Intelligent<br />

Systems, Germany.


Annual Report <strong>2004</strong> 13<br />

• Gu Chun-Yuan, Program manager Mechatronics, ABB Corporate Research, Västerås,<br />

Sweden.<br />

• Toshio Fukuda, Professor at Dept. of Micro System Engineering and Mechano-<br />

Informatics and Systems, Nagoya University, Japan.<br />

• Alexander Lauber, Professor in Measurement Technology, Department of Technology,<br />

Kalmar University, Kalmar, Sweden.<br />

• Emil M. Petriu, Dr. Eng., P. Eng., Professor, School of Information Technology and<br />

Engineering, University of Ottawa, Canada.<br />

• Giulio Sandini, Dr. Professor at LIRA-Lab, Dist-University of Genova, Italy.<br />

• Mel Siegel, Professor at Robotics Institute, Carnegie Mellon University, Pittsburgh, USA.


14 AASS – Center for Applied Autonomous Sensor Systems<br />

1.3 Funding<br />

AASS funding comes from a number of sources. The major ones are as follows:<br />

1. KK-Foundation grants<br />

In the year <strong>2004</strong> these grants amounted to a total of 7,3 MSEK (excl. VAT). 0,9MSEK of<br />

this amount consist of two grants, which two of our PhD students received from the KKfoundation.<br />

During the years 2002- 2008 the KK-Foundation stays for a grant of up to 36<br />

MSEK. This grant, won in a tough competition with other Swedish research centres and<br />

groups, is intended to help achieving internationally competitive research profile,<br />

establishing a long-term development potential and developing sufficient alternative<br />

(other than the KK-Foundation) funding sources. Furthermore the grant is to facilitate<br />

active industrial cooperation where the latter is ensured by requiring 1-to-1 match between<br />

the KK-Foundation grant and funding from industry. This yields a total of up to 72 MSEK<br />

for a period of 6 years. This requirement has had quite a positive effect regarding AASS<br />

industrial cooperation - existing one has been further strengthened and new industrial<br />

partners have been found. The matching funding provided by industry is mainly in the<br />

form of, industrial graduate students, part-time participation of industry personnel in<br />

external research projects, and expensive equipment.<br />

2. Faculty funding<br />

For the year <strong>2004</strong> it amounts to 9,2 MSEK. This funding allows AASS to conduct more<br />

basic research and for maintaining and developing the size and quality of AASS<br />

participation in undergraduate/graduate education.<br />

3. Vetenskapsrådet (VR) – Swedish Council of Research grants<br />

This is a traditional funding source though characterized by its extreme competitiveness.<br />

A VR grant of 1,2 MSEK covering a period of 3 years started in 2001 for research on the<br />

subject of signal-to-symbol conversion in mobile autonomous robots. Another VR grant<br />

of 1,813 MSEK and covering a period of 3 years was obtained in 2002 for research on the<br />

subject of Sensor-based planning for mobile robotics. A third grant of 1 824 000 is<br />

obtained for the period 2005-2008.<br />

4. Regional funding<br />

During <strong>2004</strong> regional industry has supported AASS with about 490 000 SEK for<br />

equipment.<br />

5. Robotdalen “funding”<br />

Currently there are three Robotdalen projects each with one industrial PhD student. The<br />

cost of these PhD students is covered by Robotdalen and the respective industrial partners<br />

involved. For the project “Teknikspridning och Kompetenshöjning” we received 363 600<br />

during <strong>2004</strong>. In January 2005 we received an additional 189 500 for <strong>2004</strong> as well. In total<br />

553 000 SEK.<br />

As a measure of having achieved the objectives set by the KK-Foundation AASS has adopted<br />

the ratio between internal (faculty/university) and external (KK-Foundation, industry,<br />

research funding agencies) funding. For year <strong>2004</strong> this ratio was 54,2% for external funding.<br />

According to the agreement the funding from the KK-Foundation profile should be not more<br />

than 38% of the total AASS budget. For <strong>2004</strong> this was 29%.


Annual Report <strong>2004</strong> 15<br />

The diagram from below summarizes the different funding sources in year <strong>2004</strong>.<br />

Funding <strong>2004</strong><br />

Internal income for teaching<br />

4,0%<br />

EU-networks<br />

0,9%<br />

Other income<br />

0,2%<br />

KK-foundation, Profile<br />

29,2%<br />

KK-foundation, IT<br />

4,1%<br />

Faculty<br />

41,8%<br />

ABB, Instr. & Control, KKrelated<br />

0,5%<br />

Regional companies<br />

2,2%<br />

ETRI<br />

0,5%<br />

NIROS<br />

4,5%<br />

CUGS<br />

3,3%<br />

Robotdalen<br />

3,0%<br />

Vetenskapsrådet<br />

5,4%<br />

Income from other universities<br />

0,4%<br />

The chart below shows the increasing funding levels for the years 1997-<strong>2004</strong>, which<br />

illustrates the rapid AASS development. (All amounts in thousand SEK.)<br />

AASS funding growth 1997-<strong>2004</strong><br />

25 000<br />

20 000<br />

15 000<br />

10 000<br />

5 000<br />

0<br />

1997 1998 1999 2000 2001 2002 2003 <strong>2004</strong>


16 AASS – Center for Applied Autonomous Sensor Systems<br />

1.4 Undergraduate Education<br />

AASS is responsible for the 3-year Computer Engineering Program and the 4-year MSc<br />

Program in Computer Engineering. AASS contributions are in terms of management,<br />

administration, program and course development, and teaching. Silvia Coradeschi, AASS, is<br />

the director of studies for the Computer Engineering Division including both the 3 and 4 years<br />

programs. Her responsibilities include budget and staff management for the undergraduate<br />

education within the division. Lars Karlsson is the leader for the MSc program. His<br />

responsibilities include development, information, course scheduling, and thesis<br />

administration.<br />

1.4.1 Computer engineering program<br />

The Computer Engineering Program is a study program consisting of 120 credit points<br />

(corresponding to three years of studies). The program can be characterized as a fixed study<br />

program with some options during year 3. It leads to a University Diploma in engineering (sv.<br />

"Högskoleingenjörsexamen"), 120 points, and/or a bachelor (BSc) degree. Details about the<br />

program's study plan can be found at:<br />

http://www.oru.se/templates/oruExtNormal.aspx?id=4690<br />

The following courses were taught in <strong>2004</strong> by AASS researchers:<br />

• Artificial Intelligence, Mathias Broxvall<br />

• Artificial Neural Networks, Tom Duckett<br />

• Real Time Programming, Mathias Broxvall<br />

• Artificial Intelligence for Mobile Robots, Alessandro Saffiotti.<br />

• Computer Graphic, Mathias Broxvall<br />

AASS PhD students have been teaching assistants for the following courses in year <strong>2004</strong>:<br />

• Numerical Methods, Li Jun<br />

• Artificial Intelligence for Mobile Robots, Kevin LeBlanc<br />

• Computer use, Linn Robertson<br />

• Computer Architecture, Pär Buschka<br />

• Computer Communication, Henrik Andreasson<br />

• Software System, Robert Lundh<br />

• Artificial Intelligence, Amy Loutfi<br />

• Artificial Neural Networks, Henrik Andreasson, Malin Lindquist<br />

• Java Programming, Zbigniew Wasik<br />

• Real Time programming, Malin Lindquist, Pär Buschka<br />

• Database, Abdelbaki Bouguerra<br />

BSc Theses<br />

• Göksu Gabriel och Demir Viktor “Röststyrning av robot via taligenkänning” Supervisors:<br />

Tom Duckett and Henrik Andreasson.<br />

• Pettersson Morgan, Arm Controller for Robot Waiter. Supervisor: I: Kalaykov (Started in<br />

2003).


Annual Report <strong>2004</strong> 17<br />

1.4.2 MSc in computer engineering<br />

The MSc Computer Engineering Program is a 4-year study program leading to a Master of<br />

Science with a major in Computer Engineering. The first 2 years of the program are in<br />

common with the 3-year Computer Engineering program, and students choose between the<br />

two programs at the end of the second year. The program belongs to the technological study<br />

sector. The program was started in the autumn of 2001 and the first class is graduated in 2002.<br />

Currently there are 40 students enrolled in the program. Details about the program's study<br />

plan can be found at www.oru.se, Department of technology's web pages.<br />

During the year, AASS members and PhD students have been involved in teaching related to<br />

the program as follows.<br />

Teaching<br />

The following courses were taught in <strong>2004</strong> by AASS researchers:<br />

• Computer Graphics, Mathias Broxvall (lectures)<br />

• Artificial Intelligence in Mobile Robotics, Alessandro Saffiotti (lectures), Kevin LeBlanc<br />

(assistant)<br />

• Program Development and Project Management, Robert Lundh (assistant)<br />

• Pattern Recognition, Gustav Tolt (lectures).<br />

MSc Theses<br />

The following MSc theses in Computer Engineering were completed during year <strong>2004</strong> at<br />

AASS.<br />

• Andersson, Karin “Functionality test with the electronic tongue”.<br />

Supervisor: S.Eskiizmirliler (started in 2003)<br />

• Sivebratt, Mikael. "GUI for artificial sensory head".<br />

Supervisor: S. Eskiizmirliler (started in 2003).<br />

• Ellkvist, Tommy och Sheikh Mohammed, Omar “Implementation of an image processing<br />

server for a mobile robot”.<br />

Supervisor: M. Broxvall<br />

• Magnusson, Daniel och Nord, Lasse “Människa och ABB's FlexPicker robot spelar<br />

airhockey”.<br />

Supervisor: I. Kalaykov<br />

Two additional MSc.theses (20 points each) started during spring <strong>2004</strong> but await completion<br />

in 2005.<br />

1.4.3 Other study programs<br />

AASS members and PhD students were also involved in a number of courses for other study<br />

programs:<br />

• Course in Power Point for University Personnel, Martin Persson<br />

• Soft Computing for Control, Ivan Kalaykov.


18 AASS – Center for Applied Autonomous Sensor Systems<br />

1.5 Graduate Education<br />

An integrated vital part of research at AASS is its Graduate Program and perhaps the most<br />

important "output" of AASS is highly qualified PhD's and Licentiates whose contributions<br />

provide further strength to Swedish industry and academic community.<br />

AASS is performing interdisciplinary research in the field of autonomous embedded systems,<br />

integrating theories, technologies and tools from sensors and measurement technology,<br />

control, artificial intelligence and computer science. Therefore, the AASS graduate program<br />

aims at giving graduate students a strong interdisciplinary background in these different areas<br />

with emphasis on topics relevant to autonomous systems. It is assumed that the students<br />

already have adequate knowledge in the basics of engineering and/or computer science.<br />

Finally, the program prepares students for a career in academia or industry by including topics<br />

such as pedagogy, management and presentation techniques.<br />

60 study points are required for a PhD. Of these, 25 points (or more) should be from a core<br />

curriculum courses, an additional 25 points should be from other courses or self studies in<br />

research relevant topics, and 10 points can be chosen freely. The Director of the Graduate<br />

program is Lars Karlsson, PhD.<br />

1.5.1 Core curriculum<br />

There are five courses that are given on a regular basis. These courses constitute the AASS<br />

core curriculum. They cover the different fields that are researched in AASS. In order to<br />

ensure that students acquire the interdisciplinary knowledge that characterizes AASS, the core<br />

courses are compulsory. The core courses are as follows:<br />

• AI for embedded systems. 5 points + 3 optional points for advanced studies.<br />

Teacher: Alessandro Saffiotti, Mobile Robotics Lab.<br />

• Soft computing for control. 5 points + 3 optional points for advanced studies.<br />

Teacher: Ivan Kalaykov, Intelligent Control Lab.<br />

• Embodied learning. 5 points + 3 optional points for advanced studies.<br />

Teacher: Tom Duckett, Learning Systems Lab.<br />

• Research Methodology for Computer Science and Engineering, 5 points,<br />

Teacher: Jan Gustafsson, Mälardalen University.


Annual Report <strong>2004</strong> 19<br />

1.5.2 Occasional courses<br />

The core courses are complemented by courses that are provided on a more occasional basis -<br />

on request - when a visiting researcher provides for such an opportunity, or when a subject of<br />

interest is covered by a graduate course at another university. During <strong>2004</strong>, one occasional<br />

course was given:<br />

• Introduction to Markov Decision Processes. Teacher: Lars Karlsson.<br />

1.5.3 Self-study course work<br />

This type of course work is done within supervised self-study circles (smaller courses), or<br />

individual studies. There was one organized study circle:<br />

• Introduction to reinforcement learning. Teacher: Tom Duckett.<br />

1.5.4 Cooperation with other graduate programs<br />

As recognition of the research effort at AASS, Örebro University has become one of the<br />

participants in CUGS (the Swedish National Graduate School in Computer Science). CUGS is<br />

commissioned by the Swedish government and the Swedish Board of Education and Lars<br />

Karlsson is a member of the CUGS steering Committee.<br />

Because of CUGS, AASS students have now the additional possibility to get enrolled as<br />

CUGS students or to follow some courses of interest provided by the CUGS study program.<br />

Currently, 2 students from the Mobile Robotics Laboratory are enrolled in CUGS, receiving a<br />

total funding of 700,000 SEK:<br />

• Robert Lundh (topic: cooperative robotics, supervisor: Alessandro Saffiotti)<br />

• Kevin Leblanc (topic: cooperative anchoring, supervisor: Alessandro Saffiotti)<br />

The scientific scope of CUGS includes central parts of the core computer science (sv.<br />

datalogi) and computer engineering (sv. datorsystem). In this regard, CUGS puts an emphasis<br />

on programming languages, algorithms, software engineering, also including related areas of<br />

autonomous systems, real-time systems, embedded systems, knowledge-based systems and<br />

artificial intelligence. Other members of CUGS are the universities/university colleges in<br />

Linköping (host), Lund, Mälardalen, and Skövde.<br />

AASS offered one advanced graduate course for CUGS:<br />

• Introduction to Markov Decision Processes. Teacher: Lars Karlsson.<br />

Detailed information about CUGS can be found at:<br />

http://www.ida.liu.se: 9080/groups/cugs/FrontPage.<br />

1.5.5 European graduate programs<br />

As recognition for the quality of its graduate education and research The European<br />

Commission 2002 has granted AASS the status of a Marie Curie Training Site in the area of<br />

Autonomous Robotics. The Commission, during the next four years, will provide the funding<br />

necessary for accommodating PhD students from European countries for periods of stay<br />

between 3 and 12 months. During their stay at AASS the guest-students will participate in


20 AASS – Center for Applied Autonomous Sensor Systems<br />

projects related to AASS research and also take courses offered within the AASS Graduate<br />

Program. Prof. D. Driankov is the responsible coordinator for the program.<br />

During <strong>2004</strong> we have had 3 Marie Curie Fellows:<br />

• André Treptow, Tuebingen University, Department of Computer Science, Jul.-Oct. <strong>2004</strong>,<br />

Active Recognition of People by Mobile Robots.<br />

• Peter Biber, Tuebingen University, Department of Computer Science,<br />

August-November <strong>2004</strong>, Lifelong SLAM by Mobile Robots.<br />

• Cipriano Galindo. University of Malaga, Spain. Period: Sep-Nov <strong>2004</strong><br />

(3 months). Research projects: Hybrid Maps and Perceptual Anchoring.<br />

More information regarding the Marie Curie Training Programs can be found at:<br />

http://improving.cordis.lu/mc<br />

1.5.6 Graduate students<br />

Biologically Inspired Systems Lab<br />

PhD-student First advisor Second Employed at Enrolled at<br />

advisor<br />

Lindquist, Peter Wide Boyko Iliev ÖU ÖU<br />

Malin<br />

Robertsson, Peter Wide Boyko Iliev ÖU ÖU<br />

Linn<br />

Spännar , Jan Peter Wide George Fodor Högskolan<br />

Dalarna<br />

ÖU<br />

Mobile Robotics Lab<br />

PhD-student First advisor Second Employed at Enrolled at<br />

advisor<br />

Bouguerra, Alessandro Lars Karlsson ÖU ÖU<br />

Abdelbaki Saffiotti<br />

Buschka, Pär Alessandro Tom Duckett ÖU ÖU<br />

Saffiotti<br />

Loutfi, Amy Alessandro Silvia ÖU ÖU<br />

Saffiotti Coradeschi<br />

Larsson, Alessandro Mathias Atlas Copco ÖU<br />

Johan Saffiotti Broxvall<br />

Lundh,<br />

Robert<br />

Alessandro<br />

Saffiotti<br />

Lars Karlsson ÖU ÖU and<br />

CUGS<br />

LeBlanc,<br />

Kevin<br />

Alessandro<br />

Saffiotti<br />

Silvia<br />

Coradeschi<br />

ÖU ÖU and<br />

CUGS<br />

Pettersson, Alessandro Lars Karlsson ÖU ÖU<br />

Ola Saffiotti<br />

Wasik, Alessandro Dimiter ÖU ÖU


Annual Report <strong>2004</strong> 21<br />

Zbigniew Saffiotti Driankov<br />

Pencz, Jack Alessandro Silvia<br />

Saffiotti Coradeschi<br />

Intelligent Control Lab<br />

ÖU<br />

ÖU<br />

PhD-student First advisor Second Employed at Enrolled at<br />

advisor<br />

Jennergren, Ivan Anani SIK ÖU<br />

Lars Kalaykov Ananiev<br />

Thomas George Fodor Ivan ÖU ÖU<br />

Uppgård<br />

Kalaykov<br />

Lindkvist, George Fodor Peter Wide ÖU ÖU<br />

Christer<br />

Tolt, Gustav Ivan Dimiter ÖU ÖU<br />

Kalaykov Driankov<br />

Skoglund,<br />

Alexander<br />

(50%)<br />

Ivan<br />

Kalaykov<br />

Tom Duckett ÖU ÖU<br />

Soron, Mikael Ivan<br />

Kalaykov<br />

Learning Systems Lab<br />

Anani<br />

Ananiev<br />

Esab Welding<br />

Equip. AB<br />

PhD-student First advisor Second Employed at Enrolled at<br />

advisor<br />

Andreasson, Alessandro Tom Duckett ÖU ÖU<br />

Henrik Saffiotti<br />

Martin Dimiter Tom Duckett Aerotech ÖU<br />

Persson Driankov<br />

Telub AB<br />

Cielniak, Peter Wide Tom Duckett ÖU ÖU<br />

Grzegorz<br />

Jun, Li Peter Wide Tom Duckett ÖU ÖU<br />

Magnusson, Alessandro Tom Duckett Atlas Copco ÖU<br />

Martin Saffiotti<br />

Skoglund, Ivan Tom Duckett ÖU ÖU<br />

Alexander<br />

(50%)<br />

Kalaykov<br />

Munkevik,<br />

Per<br />

Peter Wide Tom Duckett SIK ÖU<br />

Officially registered as PhD-students by the end of February <strong>2004</strong>.<br />

ÖU


22 AASS – Center for Applied Autonomous Sensor Systems<br />

1.5.7 PhD theses<br />

During <strong>2004</strong> one PhD thesis was defended:<br />

• Ola Pettersson. Model-free Execution Monitoring in Behaviour-based Mobile Robots.<br />

PhD Thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />

1.5.8 Licentiate theses<br />

During <strong>2004</strong> the following licentiate theses were completed:<br />

• Jennergren, Lars. Flexible Assembly of Ready-to-eat Meals. Licentiate thesis, Örebro<br />

University Studies in Technology Series, <strong>2004</strong>.<br />

• Jun, Li. Towards Online Learning of Reactive Behaviours in Mobile Robotics. Licentiate<br />

thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />

• Lindquist, Malin, Electronic Tongue for Water Quality Assessment. Licentiate thesis,<br />

Örebro University Studies in Technology Series, <strong>2004</strong>.


Annual Report <strong>2004</strong> 23<br />

1.6 Co-operation<br />

The AASS research effort builds upon two types of co-operation: industrial and academic.<br />

The former one is of two types: 1) KK-Foundation related according to the 1-to-1 funding<br />

scheme and supports general research themes in autonomous systems and may, or may not<br />

include specific industrial projects; and 2) VINNOVA Robotdalen related, which involves<br />

specific industrial projects. The academic co-operation has both national and international<br />

dimension.<br />

1.6.1 Industrial cooperation: KK-Foundation related<br />

The following industrial companies and the related to those companies’ activities constitute<br />

the basis for the 1-to-1 funding required by the KK-Foundation:<br />

• ABB Automation Technology Products AB/Robotics: the company sponsors AASS with<br />

equipment (flex-picker robot and IRB140), software and software support and the main<br />

receiver is the Intelligent Control Systems lab:<br />

• ABB Automation Technology Products AB/Instrumentation and Control: i) a visiting<br />

professor (adjungerad prof. G. Fodor) from the company supervises 2 AASS PhD<br />

students, ii) one of those (Thomas Uppgård) being an industrial PhD student with AASS;<br />

iii) one of the company's engineers (with a PhD degree from AASS, P. Bergsten) works<br />

part time at AASS on the subject of fuzzy control. In addition they sponsor with<br />

equipment and licenses.<br />

• FFV Aerotech Telub AB, Örebro: an industrial PhD student (Martin Persson) works in the<br />

project Semi-Autonomous Mapping (SAM) by UAV-UGV Cooperation at the Learning<br />

Systems Lab. January 2005 another industrial PhD student (Christer Wahlgren) started his<br />

PhD studies at AASS.<br />

• DELFOI (Göteborg): the company has provided AASS with licences for the use of the<br />

software products related to digital 3D manufacturing solutions as well as the training<br />

courses needed for the use of those products. The software is used in the IC lab projects<br />

on flexible assembly of ready-to-use food, i.e., flexible food-cell and sensory analysis in<br />

the food-factory-of-the-future.<br />

• AssiDomän (Frövi): the company provided equipment (vision platform) for the project<br />

“Behaviour-based mobile manipulation'' at the MR Lab; Torbjörn Widmark, employed<br />

with the company, chairs the AASS Reference Group and is thus very much involved in<br />

the organization and the proceedings of the two <strong>annual</strong> meetings of the Reference group.<br />

• SIK, Göteborg, Sweden (a research organization in the area of automation in food<br />

manufacturing): 2 SIK/AASS PhD students (Lars Jennergren and Per Munkevik) work on<br />

projects in the IC Lab and LS Lab regarding robotics technologies for the food-factory-ofthe-future.<br />

Lars Jennergren finished his Lic. Thesis during <strong>2004</strong>.


24 AASS – Center for Applied Autonomous Sensor Systems<br />

1.6.2 Industrial cooperation: VINNOVA-Robotdalen related<br />

The following Robotdalen projects have been running at AASS during <strong>2004</strong>:<br />

• Robot station friction stir welding: the project involves a cluster of industrial companies in<br />

Laxå (Esab Welding Equipment AB, Specma Automation AB, ABB-Laxå) and the IC Lab<br />

at AASS represented by one industrial PhD student and Prof. I. Kalaykov.<br />

• Navigation system for automated loaders: the project involves Atlas Copco Rock Drills<br />

AB (Örebro), Volvo Construction Equipment (Eskilstuna), and the MR Lab at AASS<br />

represented by one industrial PhD student and Prof. A. Saffiotti.<br />

• Tunnel profile scanner: the project involves Atlas Copco Rock Drills AB (Örebro), Optab<br />

Optronikinnovation AB (Karlskoga), and the LS Lab at AASS represented by one<br />

industrial PhD student and Dr. T. Duckett.<br />

• Teknikspridning och kompetenshöjning: the focus of the project is on: i) the dissemination<br />

of knowledge about robotics and related technical systems aimed at schools in the Örebroregion;<br />

ii) further education of school teachers in the area of robotics; and iii) girls-intechnology<br />

efforts. The project involves KomTek (Örebro, Laxå and Karlskoga),<br />

industrial companies (ESAB, ABB, Lasertech) and AASS as a whole, where E. Liljedahl<br />

is the project co-ordinator.<br />

1.6.3 National Co-operation<br />

1.6.3.1 Scientific cooperation<br />

• WITAS-project (unmanned helicopter), Univ. of Linköping, Dept. of Computer Science:<br />

development of Takagi-Sugeno fuzzy model based visual servoing controllers for<br />

unmanned aerial vehicles.<br />

• Mälardalens högskola, Västerås: development of Vision on Chip system for robotic<br />

applications, funded by Robotdalen.<br />

• SIK, Göteborg: development of robotic technologies for the Food Factory of the Future.<br />

1.6.3.2 National networks, societies, programs<br />

• Founding member of the VINNOVA Robotdalen program<br />

• Coordinator of Team Sweden (team of 3 univ: Lund Univ., Blekinge Institute of<br />

Technology, Orebro Univ.).<br />

• Member of CUGS (participating with two PhD students).<br />

• Member of SLSS (Swedish Learning Systems Society).<br />

• Member of the Swedish IEEE chapter on Signal Processing.<br />

• Affiliated to LiFT (Livsmedelsproduktion med Framtidens Teknologier) - industryoriented<br />

Swedish programme for research and PhD education.<br />

• Member of SWIRA (Swedish Industrial Robotics Association)


Annual Report <strong>2004</strong> 25<br />

1.6.4 International Cooperation<br />

1.6.4.1 EC Networks/Programs<br />

AASS researchers are members and participate in the work of a number of EU networks and<br />

programs:<br />

• The European Community Network of Excellence on Robotics Research (EURON)<br />

Cooperative Robotics coordinator.<br />

• The European Community Thematic Network on Walking and Climbing Robots<br />

(CLAWAR II).<br />

• Marie Curie Training Site (coordinator).<br />

• SCIP Working Group (Soft Computing in Image Processing,<br />

http://fuzzy.rug.ac.be/SCIP/).<br />

1.6.4.2 Participation in scientific events (more info on participation to be found in the<br />

project descriptions from Section 2)<br />

• IASTED Conf. on Visualization, Imaging and Image Processing, Marbella, Spain, <strong>2004</strong>.<br />

• FUZZ-IEEE Conference, Budapest, 27-29 July <strong>2004</strong>.<br />

• IFAC Symposium on Intelligent Autonomous Vehicles, 5-7 July, Lisbon, Portugal, <strong>2004</strong>.<br />

• Second IEEE International Conference on Industrial Informatics, INDIN'04, 24-26 June,<br />

Berlin, Germany, <strong>2004</strong>.<br />

• The 30-th IEEE Annual Conference on Industrial Electronics IECON <strong>2004</strong> Conference,<br />

Nov. 2-6, <strong>2004</strong>, Busan, Korea.<br />

• ICEF9 International Conference on Engineering and Food, Montpellier, France, 7-11<br />

March, <strong>2004</strong>.<br />

• International Conference on Intelligent Manipulation and Grasping, Genoa, Italy, 1-2 July,<br />

<strong>2004</strong>.<br />

• Food Factory <strong>2004</strong> Conference, France, 6-8 October, <strong>2004</strong>.<br />

• International Conference on Mechatronics and Robotics ’04, Aachen, Germany, 13-15<br />

September <strong>2004</strong>. International Conference on Climbing and Walking Robots<br />

CLAWAR’04, Madrid, Spain<br />

1.6.4.3 Scientific cooperation<br />

AASS’s scientific partnerships are reflected in the project descriptions from Section 2. Each<br />

scientific partnership also includes visits from/to AASS.<br />

1.6.5 Services to the research community<br />

1.6.5.1 Membership in professional organizations/societies/management-bodies<br />

- The Board of Trustees of the RoboCup International Federation.<br />

- The Advisory Board of the International Conference on AI.<br />

- The European Coordinating Committee for Artificial Intelligence (ECCAI).


26 AASS – Center for Applied Autonomous Sensor Systems<br />

- The Scandinavian RoboCup Committee.<br />

- Executive committee of the International RoboCup Federation.<br />

- Membership in IEEE Computer Soc.; the IEEE Robotics and Automation Soc.; the IEEE<br />

System, Man and Cybernetics Soc.<br />

- The American Assoc. for Artificial Intelligence.<br />

- The Intelligent Autonomous Systems Soc.<br />

- IEEE CSS/SP societies; SPIE and EUSFLAT.<br />

- AAAI (American National Association for Artificial Intelligence).<br />

- SLSS member (Swedish Learning Systems Society).<br />

- EvoNet - The Network of Excellence in Evolutionary Computing.<br />

- International Association for Pattern Recognition.<br />

- IEEE - Institute of Electrical and Electronics Engineers.<br />

- SSAB - Swedish Society for Automated Image Analysis.<br />

- The Swedish Learning Systems Group.<br />

- The Board of SWIRA, Swedish Industrial Robot Association.<br />

- The Örebro University board.<br />

- The Faculty board (Natural Science, Technology and Medicine).<br />

- The Institutional board (Department of Technology) – two members.<br />

- IEEE Technical Committee on Intelligent Control, Section: Fuzzy Control.<br />

- Editorial Board International Journal of Uncertainty, Fuzziness, and Knowledge-Based<br />

Systems, World Scientific Publ.<br />

- Editorial Board Journal of Systems Architectures, The Euromicro Journal, Elsevier.<br />

- Advisory Board of the Electrical and Computer Science Department, Western Michigan<br />

University, USA.<br />

- IEEE Instrumentation & Measurement society - Chairman Technical Committee TC 27.


Annual Report <strong>2004</strong> 27<br />

1.6.5.2 Organization of scientific events<br />

AASS researchers have participated in at least a dozen Program/Organizing Committees,<br />

evaluation of EU FP6 projects and served as reviewers for numerous international journals<br />

and scientific events.


28 AASS – Center for Applied Autonomous Sensor Systems<br />

1.7 Dissemination of information<br />

The dissemination of information pertaining to AASS activities has the overriding goal to<br />

establish a firm and clear identity and acceptance of the AASS research profile, its industrial<br />

relevance, and societal contributions.<br />

To achieve the above goal our dissemination of information activities are towards the<br />

following three audiences:<br />

A. Industry, public authorities, and research funding bodies;<br />

B. Research community and university students; and<br />

C. General public<br />

Further information about our goals and philosophy regarding dissemination of information<br />

you can find in our Information Policy for 2005.<br />

1.7.1 Activities during March <strong>2004</strong>-February 2005<br />

FAIRS<br />

Activity Time Performance Target group<br />

Technical fair for<br />

women, Örebro<br />

AAAI-<strong>2004</strong><br />

Workshop<br />

Robotdalens dag,<br />

Örebro<br />

Technical fair,<br />

Stockholm<br />

040307-08 Presentation by Amy Loutfi “Putting<br />

A, C<br />

Olfaction into Action: Using electronic<br />

noses with artificial sensor systems.”<br />

040626 Arranged by A.Saffiotti and S.Coradeschi. B<br />

040909 Presentation of projects and co-operation<br />

that AASS is involved within the<br />

Robotdalen project. E. Liljedahl, A.<br />

Skoglund, B-L Silfverdal, P.Sporrong,<br />

B.Alvin<br />

041019-23 Participation in Robotdalens stand,<br />

demonstration of robot dogs and<br />

presentation of AASS and PhD-studies, by<br />

Mikael Soron and Kevin LeBlanc.<br />

A<br />

A, B


Annual Report <strong>2004</strong> 29<br />

VISITS<br />

Activity Time Performance Target group<br />

Study visit 040129 School class from Alléskolan åk 3,<br />

C<br />

Hallsberg. Introduction to AASS’ robots,<br />

research and education. Tom, Ivan, Henrik,<br />

Mathias, Gustav, Kevin<br />

Study visit 040202 Tullängsskolan, Elektro åk 3. Introduction C<br />

to AASS’ robots, research and education.<br />

Tom, Ivan, Henrik, Mathias, Gustav, Kevin<br />

Study visit 040205 Alléskolan åk 3, Hallsberg. Introduction to C<br />

AASS’ robots, research and education.<br />

Tom, Ivan, Henrik, Mathias, Gustav, Kevin<br />

Study visit 040209 Study visit by school class (Year 3,<br />

C<br />

Tullängsskolan, Örebro), Tom, Ivan,<br />

Henrik, Mathias, Gustav, Kevin<br />

Study visit 040212 Study visit by school class (Year 3,<br />

C<br />

Alléskolan, Hallsberg), Tom, Ivan, Henrik,<br />

Mathias, Gustav, Kevin<br />

Visit 040226 Presentation for representatives from the A<br />

KK-foundation<br />

Demonstration 040315 Presentation by Amy Loutfi for Susan<br />

A<br />

Kennarl from the Banft Centre,Canada<br />

Demonstration 040318 Lab demonstration for representatives from B, C<br />

Karlstads university (the Education and<br />

Research department), 35 people<br />

Study visit 040420 Study visit by school class (D8,<br />

C<br />

Vivallaskolan, Örebro), 20 pupils,<br />

Alexander Skoglund<br />

Presentation 040422 Presentation for Kristian Luuk by Amy C<br />

Loutfi<br />

Study visit 040503 Lab presentations for professor Jim Little, B<br />

Computer Science, UBC.<br />

Study visit 040505 Study visit by school class (Vivallaskolan, C<br />

Örebro), 40 pupils, Alexander Skoglund<br />

Study visit 040616 Study visit by Young Entrepreneurs, 25 C<br />

pupils from gymnasiums all over Sweden<br />

participation in an <strong>annual</strong> competition in<br />

Örebro, Henrik Andreasson<br />

Study visit June Study visit by KomTek Laxå summer<br />

C<br />

school for girls (7 pupils), Alexander<br />

Skoglund<br />

Study visit 040929 Study visit by school class from<br />

C<br />

Vivallaskolan, Örebro (20 pupils),<br />

Alexander Skoglund<br />

Visit at Örebro 041004 Presentation of AASS and Robotdalen by A


30 AASS – Center for Applied Autonomous Sensor Systems<br />

university by local<br />

Ester Liljedahl<br />

politicians<br />

Study visit 041018 Study visit by school class from<br />

Vivallaskolan, Örebro (20 pupils),<br />

Alexander Skoglund<br />

Study visit 041019 Study visit by school class from<br />

Vivallaskolan, Örebro (20 pupils),<br />

Alexander Skoglund<br />

Study visit 041021 Study visit by school class from<br />

Vivallaskolan, Örebro (15 pupils),<br />

Alexander Skoglund<br />

Visit 041105 NIROS-demonstration, Dimiter Driankov<br />

and Mathias Broxvall<br />

C<br />

C<br />

C<br />

A,C<br />

OTHER PRESENTATIONS<br />

Activity Time Performance Target group<br />

Annual graduate 040123 Presentation of research topics by graduate B<br />

symposium at AASS<br />

students<br />

Annual academic February Public lecture by Ivan Kalaykov C<br />

festivities, Örebro<br />

Annual Report March Annual Report 2003 was published on A and B<br />

AASS web and sent out to different<br />

contacts.<br />

RoboCup 040627- Competitions with the Robotic dogs and B,C<br />

040705 seminars. Alessandro, Kevin<br />

Doctoral dissertation 041001 Ola Peterssons doctoral dissertation<br />

A, B<br />

”Model-Free Execution Monitoring in<br />

Behaviour-Based Mobile Robotics” was<br />

presented<br />

Licentiate dissertation 041001 Lars Jennergrens licentiate dissertation A, B<br />

“Flexible Assembly of Ready-to-eat Meals”<br />

was presented<br />

Research folder October AASS research folder was updated (in time A, B<br />

for the Technical fair in Stockholm)<br />

Visit by Invest in<br />

Sweden Agency<br />

041012 Presentation of AASS and Robotdalen by<br />

Dimiter Driankov and Ester Liljedahl,<br />

arranged by Business Region Örebro at<br />

A<br />

Seminar “Roads to<br />

technology”, Örebro<br />

university<br />

No Limits<br />

Annual academic<br />

festivities (årshögtid)<br />

Atlas Copco, Örebro<br />

041021 Presentation of summer school for girls by<br />

Ester Liljedahl<br />

November Participation in First Lego Leaguecompetition,<br />

in co-operation with the<br />

Örebro community technical school<br />

February Public lecture by Ola Pettersson and<br />

received his doctor’s degree<br />

C<br />

A, B


Annual Report <strong>2004</strong> 31<br />

PRESS RELEASES<br />

During the year press releases were sent out and also published on Örebro universities web<br />

(http://www.oru.se/templates/oruExtNormal____19607.aspx).<br />

Time Subject Target group<br />

<strong>2004</strong>-09-08 Ola Petterssons doctoral dissertation *) (Robotar kan lära av A, B<br />

sina misstag)<br />

<strong>2004</strong>-09-06 Robotdalens dag (Robotar ökar tillväxten) A<br />

<strong>2004</strong>-08-02 Summer course for girls (Legorobotar lockar tjejer till<br />

teknikstudier)<br />

C<br />

*) The press release about Ola Petterssons dissertation was also translated into English by the<br />

Swedish Research Council (Vetenskapsrådet) and sent out internationally.<br />

MEDIA<br />

Activity Time Performance Target group<br />

Nerikes Allehanda March Article about Amy Loutfis research A, B<br />

Nerikes Allehanda March Article about KK-foundation supporting A, B, C<br />

research at Örebro university<br />

Örebrokuriren August Article about summer course for girls<br />

A, C<br />

(before the course)<br />

Örebrokuriren August Article about summer course for girls (after A, C<br />

the course)<br />

TV4 Bergslagen August News presentation about summer course for A, C<br />

girls<br />

OruMagasinet 12/<strong>2004</strong> Article about Amy Loutfi and her research A, B, C<br />

www.oru.se, Nyheter September Article about Robotdalens dag A, B, C<br />

Nerikes Allehanda September Article about an industrial co-operation A<br />

within Robotdalen (published the day before<br />

Robotdalens dag)<br />

Nerikes Allehanda September Robotdalens dag (from the day) A, C<br />

Örebrokuriren September Robotdalens dag (about the day) A, C<br />

The European<br />

Commissions<br />

Research website<br />

(http://europa.eu.int/c<br />

omm/research/headlin<br />

es/news/article_04_09<br />

_27_en.html<br />

September Article about Ola Petterssons doctoral<br />

dissertation ” Model-Free Execution<br />

Monitoring in Behaviour-Based Mobile<br />

Robotics”<br />

A, B<br />

Mobile Robotics news<br />

website<br />

(www.mobilerobotics.<br />

org/robots/)<br />

September Article about Ola Petterssons doctoral<br />

dissertation ” Model-Free Execution<br />

Monitoring in Behaviour-Based Mobile<br />

Robotics”<br />

www.oru.se/aass October Article and information about AASS<br />

participation at the Technical fair in<br />

Stockholm<br />

A, B<br />

A


32 AASS – Center for Applied Autonomous Sensor Systems<br />

www.robotdalen.org October Article and pictures from Robotdalens stand A<br />

at the Technical fair<br />

Nerikes Allehanda November Article from First Lego League-competition C<br />

Nerikes Allehanda, November Article about research funds from the<br />

A, B<br />

www.oru.se (som<br />

forskningsnyhet) and<br />

www.oru.se/aass<br />

Swedish Research council to a project at<br />

AASS run by Silvia Coradeshi.<br />

www.oru.se November Article about study visits for pupils at<br />

C<br />

AASS during October.<br />

Nerikes Allehanda February Article about public lecture by Ola<br />

C<br />

Pettersson at <strong>annual</strong> academic festivities<br />

Nerikes Allehanda February Article about Robotdalen co-operation A<br />

In September <strong>2004</strong> AASS new web (www.oru.se/aass) was published. From September <strong>2004</strong> –<br />

February 2005 17 articles were published covering seminars, research and activities that<br />

AASS participated in (http://www.oru.se/templates/oruExtNormal____21544.aspx).<br />

1.7.2 Industry, public authorities, and research funding bodies<br />

Well-established means for disseminating information about AASS research results and their<br />

industrial potential amongst these parts of the Swedish industry that can directly/indirectly<br />

benefit from it are:<br />

- Joint projects: See section 1.6.4.3<br />

- Industrial PhD students: See section 1.6.1<br />

- AASS Seminars: See section 1.7.5.1<br />

- Industrial fairs and exhibitions: See 1.7.1<br />

- Industrial associations and interest groups: Robotdalen, SWIRA, SIK,<br />

OIC (Orebro Innovation Centre), NIROS<br />

1.7.3 Research Community and university students<br />

Disseminating information about AASS research profile and its educational role and potential<br />

is done via the traditional dissemination channels, such as:<br />

- Publications<br />

- Conference participation<br />

- Organisation of scientific events<br />

- AASS guest-researchers, guest-students, and visits<br />

- National/international networks<br />

- Joint research projects<br />

1.7.4 General Public<br />

The general public and various civil authorities are informed via the web, public lectures, and<br />

media presence such as newspaper articles. AASS had several articles in the University's<br />

magazine, which is spread to more than 2000 companies and organizations. We also arranged<br />

several "open houses" with demos for the general public as well as public seminars that we<br />

have regularly see 1.7.1 and 1.7.5.1.


Annual Report <strong>2004</strong> 33<br />

Seminars<br />

1.7.5.1 Regular AASS Seminars<br />

Schedule for March <strong>2004</strong>- February 2005<br />

Date Speaker Title of seminar<br />

040301 Prof. Gurvinder S. Smelling mobile robots<br />

Virk, University of<br />

Leeds, UK<br />

040308 Mathias Broxvall,<br />

AASS<br />

Have another look: On Failures and Recovery Planning in<br />

Perceptual Anchoring<br />

041001 Joachim Hertzberg, Towards Cognitive Robotics in 7D<br />

Osnabrück University,<br />

Germany<br />

041011 André Treptow,<br />

Tübingen University,<br />

Germany<br />

Active People Recognition Using Thermal and Grey<br />

Images on Mobile Robots<br />

041011 Cipriano Galindo,<br />

University of Malaga,<br />

Spain<br />

Modelling robot environments through a multihierarchical<br />

fashion: the Multi-AH-graph model<br />

041012 Rainer Palm Multi-step-ahead prediction in control systems using<br />

Gaussian Processes and TS-Fuzzy Models<br />

041122 Peter Biber, Tübingen<br />

university, Germany<br />

Dynamic Maps for Long-Term Operation of Mobile<br />

Service Robots<br />

041213 Tom Ziemke, Skövde Agent-environment state machines<br />

university, Sweden<br />

050110 Abdelbaki Bouguerra Execution failure recovery in mobile robotics: a survey<br />

050214 Henrik Andreasson,<br />

PhD-student AASS<br />

Improving model extraction by fusing Vision and 3D<br />

laser data


34 AASS – Center for Applied Autonomous Sensor Systems<br />

2. Research Labs<br />

At the present time AASS consists of four research laboratories that have joined their<br />

expertise to cover and integrate the broad spectrum of scientific disciplines needed for the<br />

design and implementation of industrially relevant autonomous systems. This would be<br />

practically impossible for any individual laboratory, but is achievable by a joint effort, which<br />

is organized in the form of AASS. This joint effort is aimed not only at expanding the<br />

frontiers of the science of autonomous sensor systems, but also gradually incorporating it in<br />

the graduate and undergraduate curriculum, and producing physical demonstrators of<br />

autonomous sensor systems with industrial and educational relevance.<br />

The common scientific denominator for the four research laboratories is the subject of<br />

"perception and autonomy in diverse un- and/or semi-structured environments''. We<br />

pursue this subject using a common research methodology, which is strictly applied: all<br />

technologies that we investigate should answer actual needs that emerge from an application,<br />

and their effectiveness is always validated on the application.<br />

Note that under each research project funding by KK-Foundation implies corresponding<br />

amount of support from the following companies:<br />

• ABB Automation Technology Products AB/Robotics,<br />

• ABB Automation Technology Products AB/Instrumentation and control<br />

• FFV Aerotech Telub AB<br />

• DELFOI<br />

• AssiDomän<br />

• SIK


Annual Report <strong>2004</strong> 35<br />

2.1 Biologically Inspired Systems Lab<br />

Our objective is to advance the state-of-the-art in the area of biologically inspired sensing,<br />

perception and control systems. That is, the development of sensors, actuators and methods<br />

for sensory information perception and fusion that mimic the structure and capabilities of<br />

biological systems. Achieving this objective would provide, on one hand, more reliable and<br />

accurate measurement and quality assessment devices. On the other hand, it contributes to the<br />

development of artificial intelligent systems, helping humans to avoid repetitive, unskilful,<br />

and hazardous tasks. Our current research activities are focused in two major directions:<br />

biologically inspired sensing and information fusion, and dexterous manipulation.<br />

2.1.1 Research directions<br />

• Sensing and information fusion<br />

We design robust and compact sensors, which are able to<br />

perform human-like smell- and taste sensing in a variety of<br />

real world environments. To complement the sensors<br />

systems, we also investigate methods for pattern recognition,<br />

sensory information fusion and active perception.<br />

The projects in this direction include electronic tongues for<br />

online quality assessment of water and food products. A<br />

further extension of this concept is the artificial sensory head<br />

which is equipped with sensors, related to the five primary<br />

human senses (taste, smell, sound, vision and touch).<br />

• Dexterous manipulation<br />

This research direction addresses different aspects of the control of a five-fingered artificial<br />

hand, ranging from actuator control to grasping and manipulation. The objective of the project<br />

is to develop new methods for dexterous manipulation in complex, unstructured environments<br />

by mimicking the way humans use their hands. To deal with the high complexity of the<br />

problem, we will employ a biologically inspired motor control scheme, tightly integrated with<br />

the sensing and perception part of the system. The artificial hand can be used as a research<br />

platform for advanced robotic applications or as a test bed for development of prosthetic<br />

devices.


36 AASS – Center for Applied Autonomous Sensor Systems<br />

2.1.2 Research Projects in <strong>2004</strong><br />

Project: Electronic tongue for water quality assessment, J413.<br />

Project leader: Peter Wide<br />

Staff: Malin Lindquist, Boyko Iliev<br />

Funding: KK-foundation and Faculty<br />

Partners: HVR Water Purification<br />

Synopsis:<br />

The project belongs to the research area of Sensing and Information Fusion. The objective is<br />

to build up a new integrated, robust, reliable, low mass/power, electronic tongue for water<br />

quality assessment. It can be used in an under water vehicle (or robot) in order to provide real<br />

time water quality monitoring in drinking water reservoir. Previous version of the electronic<br />

tongue included four electrodes: gold, platinum, iridium and rhodium and a reference<br />

electrode. Relays are used to switch between the different electrodes. Since the reference<br />

electrode was made of fragile glass, it was not suitable for use in mobile platforms. The new<br />

tongue will be made of a stainless steel tube including two gold and platinum electrodes<br />

placed on its inner part. To measure a sample, the water must fill up the tube. A second<br />

prototype of the tongue will be adapted for continuous quality monitoring of streaming water.<br />

In this version, the complementing electronic unit will perform all necessary data processing<br />

and inform the user about the quality with the help of light signals. The project will end in<br />

2005.<br />

Results in <strong>2004</strong>:<br />

- Licentiate thesis of Malin Lindquist;<br />

- A more robust version of the electronic tongue for water quality assessment is developed<br />

and tested.<br />

- One article presented on Sensors for Industry Conference, SICON’04, New Orleans,<br />

USA, Feb <strong>2004</strong>.<br />

- One article presented on International Measurement Technology Conference IMTC’04,<br />

Como, Italy, July <strong>2004</strong>.<br />

Future developments:<br />

- Extensive reliability testing and evaluation in different working conditions, including<br />

measurements of streaming water.<br />

- Water quality assessment application in real environment.<br />

- Completion of the doctoral thesis of Malin Lindquist.


Annual Report <strong>2004</strong> 37<br />

Project: Electronic tongue for food quality assessment, J423<br />

Project leader: Boyko Iliev<br />

Staff: Malin Lindquist, Peter Wide<br />

Funding: Faculty and KK-foundation<br />

Partners: None<br />

Synopsis:<br />

The project belongs to the research area of Sensing and Information Fusion. The objective is<br />

to build up an electronic tongue, which could be adaptable to the structural and functional<br />

constraints of the new artificial sensory head. This tongue will also be used to test the mixture<br />

of tastes. Therefore its output will be separately subjected to the wavelet transform based<br />

feature extraction and to the hybrid ANN based classification method. Study and<br />

implementation of the human-like cognitive perspective to the linguistic descriptions of the<br />

taste is envisaged. This project is closely connected to the development of the electronic<br />

tongue for water quality assessment since the projects share certain hardware and software<br />

components. The main difference between the projects come from the fact that the variation<br />

in the content of food samples is much higher than in water samples. This requires dedicated<br />

solutions for both the measurement procedure and data analysis. Currently, the focus of the<br />

project has shifted towards the more general problem of food quality assessment and is no<br />

longer restricted to the artificial head platform. Therefore, the work will continue during<br />

2005.<br />

Results in <strong>2004</strong>:<br />

- A methodology for testing solid food samples is under development. Initial experiments<br />

with baby food were performed.<br />

- An algorithm for online quality assessment based on fuzzy logic.<br />

- One article submitted.<br />

Future developments:<br />

- Refinement of the methodology for measurements of solid food products.<br />

- Feature extraction technique based on wavelet transform, which is able to deal with the<br />

high variations in content of the food samples.


38 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Artificial sensory head, J439<br />

Project leader: Boyko Iliev<br />

Staff: Linn Robertsson, Peter Wide<br />

Funding: Faculty and KK-foundation<br />

Partners: Intelligent Control Lab<br />

Synopsis:<br />

The project belongs to the Sensing and Information Fusion research direction. The objective<br />

is to complete the artificial sensory head by equipping it with sensors, dedicated to the five<br />

primaries human-like senses, so it can be used for food quality assessment. However, the<br />

whole system should also be considered as a common application platform for any sensory<br />

and/or data fusion based research activities. Our main goal is to bring the second version (2G)<br />

of the previous electronic head closer to its biological counterpart in the sense of sensation<br />

and perception processes. Furthermore, the sensing and clustering/classification algorithms<br />

will also be associated with facial expression by means of 3D facial animation software from<br />

Cambridge Research Laboratory. The project will be completed in 2005.<br />

Results in <strong>2004</strong>:<br />

- One conference article presented on Information Processing and Management of<br />

Uncertainty in Knowledge Based Systems, IPMU’04, Perugia, Italy, July <strong>2004</strong>.<br />

- Completed motion control and data acquisition modules.<br />

Future developments:<br />

- Experiments on food quality assessment and development of appropriate sensor fusion<br />

methods.<br />

- Experimental evaluation of perception and sensor fusion models.


Annual Report <strong>2004</strong> 39<br />

Project: Artificial Hand, J444<br />

Project leader: Boyko Iliev<br />

Staff: Rainer Palm<br />

Funding: Faculty<br />

Partners: Elumotion Ltd. UK, INSERM 483-Paris 6<br />

Synopsis:<br />

The project mainly belongs to the Dexterous Manipulation research area. The objective is to<br />

supply dexterous grasp capabilities for a 5-fingered anthropomorphic hand. The prototype<br />

hand has 15 joints (5DIP+5PIP+5MCP) and is equipped with force (tactile) and joint angle<br />

sensors. To achieve higher degree of anthropomorphism, electrically active polymer (EAP)<br />

artificial muscles will actuate the hand. Our goal is to implement intelligent sensory-motor<br />

control schemes for visually guided reach and grasp, which incorporates biological constraints<br />

in terms of architecture and behaviour. The work will be based on the interaction of four<br />

fundamental elements of movement control: 1) Task related anticipatory information<br />

concerning goal selection (Motion planning), 2) Visual information, 3) Tactile information,<br />

and 4) Execution related information. The hand design is such that it can be mounted on both<br />

already existing 6 degrees of freedom lightweight robot arms of the Intelligent Control Lab.<br />

Due to the serious technical problems of the currently available EAP muscles, the hand was<br />

actuated with electrical motors. However, if the capabilities of the future EAP muscles satisfy<br />

the performance requirements, they will be considered in an alternative actuation scheme. The<br />

project will continue in 2005.<br />

Results in <strong>2004</strong>:<br />

- New design specification of the hand, based on DC motors.<br />

- According to the new design, the hand has now 11 individually actuated degrees of<br />

freedom. Elumotion Ltd. Designed and installed the actuation stage.<br />

- Hand simulation environment and low-level control programs are developed.<br />

Future developments:<br />

- Completion of the control system of the hand.<br />

- Applications in sensor-based dexterous manipulation.


40 AASS – Center for Applied Autonomous Sensor Systems<br />

2.1.3 Staff<br />

Prof. Peter Wide received his MSc. Eng. and Licentiate-of-Technology degrees in 1984 and<br />

1987 from the Dept. of Measurement Technology, University of Linköping, Sweden. In<br />

parallel to his academic career he has worked in different electronic industries for more than<br />

15 years as test engineer, development manager, and technical consultant. He received his<br />

PhD in Measurement Science and Technology from Linköping University in 1996. Peter<br />

Wide has been a visiting researcher at the Siemens Corporate R & D Fuzzy Research<br />

Laboratory in Munich, Germany in 1994 and at the School of Information Technology and<br />

Engineering (SITE), University of Ottawa, Canada, in 1997.<br />

Peter Wide is one of the founders of the Centre for Applied Autonomous Sensor System,<br />

where he is now the director. During the last four years he has authored and co-authored<br />

about 60 conference/journal papers. He serves in the program committees of several<br />

international conferences and as a reviewer for IEEE-journals. He is an active member of the<br />

IEEE Instrumentation and Measurement (IM) Society. His professional interests are mainly<br />

related to the fields of sensors, feature extraction, sensor data fusion and quality<br />

measurements.<br />

Rainer Palm is Adjunct Professor at the Department of Technology (AASS), University<br />

Örebro since <strong>2004</strong>. Until <strong>2004</strong> he was a Principal Research Scientist in the Neural<br />

Computation Department of the Siemens Corporate Research Technology in Munich,<br />

Germany, working both in research projects and industrial applications of Automatic Control,<br />

Fuzzy Control, Modelling of Dynamic Systems, and Distributed Systems.<br />

He has been active as a control engineer since 1972 doing research and development in the<br />

field of testing machines for electronic devices. He received his Dipl. Ing. Degree from the<br />

Technical University of Dresden, Germany, in 1975. From 1982 on he worked in the robotic<br />

research area in particular in the field of sensor-guided robots. He received the Dr. Ing.<br />

Degree from the Humboldt-University Berlin, Germany, in 1981, and the Dr. sc. tech. degree<br />

from the Academy of Sciences, Germany, in 1989.<br />

Since 1991 Rainer Palm has held a position at the a fuzzy logic task force group at Siemens<br />

AG in which he developed several fuzzy control methods used in industrial prototypes and<br />

applications. Since 1992 he had a close co-operation with the Department of Computer<br />

Science, Linköping University, and since 1998 with the Department of Technology (AASS),<br />

University Örebro. He is author /co-author, editor/co-editor of 15 books or chapters in books,<br />

author/ co-author of 15 articles in journals, and author /co-author of 30 articles in Conference<br />

proceedings. He is also author / co-author of 14 patents. His research interests include<br />

automatic control, fuzzy control, and robotics.<br />

Boyko Iliev is a research associate at the Department of Technology (AASS), Örebro<br />

University. He received his M.Sc. in Control Systems Engineering from the Technical<br />

University, Sofia, Bulgaria in 1997. During the period 1997-1998 he worked as a research<br />

assistant at the Central Laboratory for Parallel Processing, Bulgarian Academy of Sciences. In<br />

October 1998 he became a graduate student at the Centre for Applied Autonomous Sensor<br />

Systems (AASS), Örebro University and received a Licentiate of Technology degree in 2002.<br />

He received the Ph.D. degree from Örebro University in <strong>2004</strong> in the area of Industrial<br />

Measurement Technology. Since March <strong>2004</strong> he is with the Centre for Applied Autonomous


Annual Report <strong>2004</strong> 41<br />

Sensors Systems and a leader of the Biologically Inspired Systems Lab. He is an author/coauthor<br />

of over 15 conference and journal publications.<br />

His research interests include fuzzy and sliding mode control, and biologically inspired<br />

systems and dexterous manipulation.<br />

Malin Lindquist was born in Örebro, Sweden on November 5, 1975. She received her MSc<br />

degree in automation engineering in 2001 from Örebro University. She has been a graduate<br />

student at the Centre for Applied Autonomous Sensor Systems, Örebro University, Sweden<br />

since 2000. Her current research interests are in biologically inspired sensors and specifically<br />

electronic tongues. She received a Licentiate of Technology degree from Örebro University in<br />

<strong>2004</strong>.<br />

Jan Spännar was born in Smedjebacken, Sweden on March 23, 1964. He received a Master<br />

degree in Applied Physics and Electrical Engineering at Linköping Institute of Technology,<br />

Sweden in 1989. Since fall 1999 he has been a graduate student at the Centre for Applied<br />

Autonomous Sensor Systems, Örebro University. He received his licentiate-of-technology<br />

degree from AASS, Örebro Univ. in 2002. His current research interests include modelling<br />

and identification with applications to process measurement.<br />

Linn Robertsson was born in Örebro in 1979. She was awarded the degree of Master of<br />

Science in Engineering with the specialization on aerospace technology at Luleå University of<br />

Technology in 2001. Since fall 2002 she has been a graduate student at the Centre of Applied<br />

Autonomous Sensor Systems, Örebro University, Örebro, Sweden. Her current research<br />

interests are biologically inspired Sensory Information Fusion Systems and feature extraction<br />

methods.


42 AASS – Center for Applied Autonomous Sensor Systems<br />

2.2. Mobile Robotics Lab<br />

The main project structure in this Lab in <strong>2004</strong> was the same as the one in 2003. All the work<br />

done by this Lab in <strong>2004</strong> concentrated around three vertical research lines, plus one horizontal<br />

line. The project structure is described in the next subsection. The following sub-section<br />

<strong>report</strong>s the activities within each individual project.<br />

2.2.1. Research directions<br />

The general objective of the AASS Mobile Robotics Lab is the development of autonomous<br />

mobile robots that can operate without the need human intervention in unmodified<br />

environments. Our specific research focus is the crucial problem of the integration of higherlevel<br />

cognitive processes into a physically embedded system. The intended scientific<br />

breakthrough of this focus is to provide the "missing link" between the field of Artificial<br />

Intelligence, especially in the area of knowledge representation and reasoning, and the field of<br />

Autonomous Robotics, especially in the area of sensor-based control of autonomous systems.<br />

We address in particular three facets of the integration problem: (i) integration between<br />

reasoning about goals and performance of actions, (ii) integration between models of the<br />

world at different levels of abstraction, and (iii) integration between symbols and sensor data.<br />

In all cases, we study the above problems both in the case of a single robot, and in the case of<br />

multiple cooperating robots.<br />

These facets are reflected in our four research lines:<br />

1. Behavioural plans<br />

We study how a robot can form plans for actions, and then execute them in the face of<br />

uncertainty and changing conditions in the environment.<br />

2. Hybrid maps<br />

The environment of the robot can be represented at different levels of abstraction, like the<br />

geometry of a room, the topology of a building, or the roadmap of a city. We study the<br />

problem of how to integrate these representations, and how to exploit the synergies<br />

between them.<br />

3. Perceptual anchoring<br />

Humans often use symbolic names to refer to objects, like "Room-22", when<br />

programming a robot or interacting with it. The robot, however, can only access sensor<br />

data, like an image from a camera. We have pioneered the field of "perceptual anchoring",<br />

that is, the connection between symbols and sensor data that refer to the same physical<br />

objects.<br />

4. Cooperation<br />

We study how to deal with the previous issues in the case of a team consisting of multiple<br />

robots and possibly humans. This research line is "horizontal" in the sense that it considers<br />

all the above issues, adding the additional dimension of cooperation.


Annual Report <strong>2004</strong> 43<br />

2.2.2. Projects in <strong>2004</strong><br />

Project: Model-free execution monitoring, J412<br />

Project leader: Ola Pettersson<br />

Staff: Alessandro Saffiotti, Lars Karlsson<br />

Funding: Faculty<br />

Synopsis:<br />

Intelligent mobile robots need the ability to integrate robust navigation facilities with higher<br />

level reasoning. This project aims at combining results and techniques from the areas of robot<br />

navigation and of intelligent agency. In particular, we investigate techniques that allow the<br />

robot to decide when to go on with execution, and when to stop and ponder about a new<br />

situation. Our current efforts are directed towards the monitoring of the current execution of a<br />

B-Plan (Behavioural Plan) in order to detect and identify possible failures. We focus on the<br />

use of pattern recognition techniques that avoid the need for a predictive model of the system.<br />

This project belongs to the research line "Behavioural plans". The objective is to investigate<br />

the use of model-free techniques for execution monitoring. The main "pull" is academic.<br />

Results in <strong>2004</strong>:<br />

- PhD thesis by Ola Pettersson, titled “Model-Free Execution Monitoring in Behaviour-<br />

Based Mobile Robots”. The thesis was defended on October 1, <strong>2004</strong>.<br />

- Submission of a journal paper summarizing part of the PhD thesis. A second journal<br />

submission is in preparation.<br />

Partners: None.<br />

Future developments:<br />

- The project was completed in <strong>2004</strong> and it will not be continued in 2005.


44 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Hybrid maps, J415<br />

Project leader: Pär Buschka<br />

Staff: Alessandro Saffiotti<br />

Funding: KK-foundation - IT and Faculty.<br />

Synopsis:<br />

Autonomous mobile robots need to use spatial information about the environment in order to<br />

effectively plan and execute navigation tasks. This information can be represented at different<br />

level of abstractions and of locality. Each level is adequate for some sub-tasks, but not for<br />

others. In this project we study hybrid maps, representations of the space that integrate<br />

different levels of locality and abstraction. Hybrid maps are expected to provide a way for<br />

robots to scale up to much larger environments, which cannot be modelled using metric maps.<br />

This project belongs to research direction "Hybrid Maps". The objective is to define H-Maps,<br />

and the processes needed to build them and to use them in autonomous agents. The main<br />

"pull" is academic.<br />

Results in <strong>2004</strong>:<br />

- Presented a paper on the analysis and definition of the concept of "hybrid maps" at the Int.<br />

Conf. on Intelligent Autonomous Systems (IAS, Amsterdam, NL, April <strong>2004</strong>).<br />

- Presented a paper on fuzzy maps at the Int. Robocup Symposium (Lisbon, PT, July <strong>2004</strong>).<br />

Joint work with project J-448.<br />

- Paper on the survey and classification of hybrid maps submitted to a journal.<br />

- Implemented experimental system to build hybrid maps, and used for extensive<br />

experimentation.<br />

- Started the integration between hybrid maps and multi-hierarchical maps, joint work with<br />

University of Malaga.<br />

Partners:<br />

- University of Malaga, Spain.<br />

- AASS Learning Systems Lab.<br />

Future developments:<br />

- Submission of journal paper on the integration between hybrid maps and multihierarchical<br />

maps.<br />

- PhD Thesis of Pär Buschka expected to be completed during the first half of 2005.


Annual Report <strong>2004</strong> 45<br />

Project: Behaviour-based control of a mobile manipulator, J416<br />

Project leader: Zbigniew Wasik<br />

Staff: Alessandro Saffiotti<br />

Funding: Faculty and KK-foundation<br />

Synopsis:<br />

In this project, we investigate new solutions to the mobile manipulation problem. The<br />

investigation proceeds along two lines: (i) to develop a behaviour-based approach to real-time<br />

visual serving of a manipulator; and (ii) to extend the "Thinking Cap" architecture to cope<br />

with the simultaneous control of the manipulator and of the mobile platform on which the arm<br />

is mounted. The target tasks will include the ability to grasp and move objects in an<br />

unmodified indoor environment. This project belongs to the research line "Behavioural<br />

plans". The objective is to investigate the use of behaviour-based plans to control more<br />

complex plants than a mobile platform, e.g., a mobile manipulator. The main "pull" is<br />

academic, but flexible mobile manipulation is also expected to have industrial relevance in the<br />

future.<br />

Results in <strong>2004</strong>:<br />

- Extension of the behaviour-based manipulation system to perform combined mobility and<br />

manipulation.<br />

- The writing of the PhD thesis of Zbigniew Wasik has been completed.<br />

Partners:<br />

- University of Rome-3, Italy.<br />

Future developments:<br />

- The project will be completed with the defence of the PhD thesis of Zbigniew Wasik, in<br />

Spring 2005.


46 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Symbolic reasoning for perception, J424<br />

Project leader: Amy Loufti<br />

Staff: Silvia Coradeschi, Alessandro Saffiotti<br />

Funding: KK-foundation and Faculty<br />

Synopsis:<br />

In this research line we investigate the use of symbolic reasoning techniques for robot<br />

perception. We focus in particular on one challenging perception problem: the use of an<br />

electronic nose (e-nose). The e-nose is a type of sensor which is rapidly gaining popularity<br />

because of its many potential applications. We consider the problem of integrating the<br />

information provided by the e-nose with both prior information and information from other<br />

sensors (e.g., vision), as well as the problem of deciding when, how and where the e-nose<br />

should be activated. We will consider ideas developed in the field of AI for diagnosis and for<br />

planning of perceptual actions. We will also use, and possibly extend, the framework for<br />

"perceptual anchoring" developed in project J-445 to connect symbolic techniques to the<br />

sensor data provided by the e-nose. Experiments will be performed on a mobile robot<br />

equipped with an e-nose together with a variety of more conventional sensors, including<br />

vision. This project belongs to the research line "Perceptual anchoring". The general<br />

objective is to investigate the use of symbolic reasoning techniques for perception, with<br />

special focus on the use of e-noses. The main "pull" is academic.<br />

Results in <strong>2004</strong>:<br />

- Submission of journal paper summarizing the results of the Licentiate of Amy Loutfi.<br />

- Publication of a paper on forming odour categories (European Conf on AI, Valencia,<br />

Spain).<br />

- Publication of a paper on the use of sensor planning in olfaction (Int. Conf. on Intelligent<br />

Robots and Systems, Sendai, Japan). Joint work with project J-446.<br />

- Contributed a chapter on artificial perceptual systems to the Handbook of Sensor<br />

Networks (CRC Press).<br />

- Thesis plan for Amy Loutfi defined.<br />

- Integration of the software for the e-nose into the Thinking Cap platform.<br />

Partners:<br />

- BIS Lab at AASS.<br />

Future developments:<br />

- Submission of paper on perception management to IJCAI-05.<br />

- Extensive experimental evaluation of the integration between olfaction and other sensing<br />

modalities through anchoring.<br />

- Work toward the completion of the PhD thesis of Amy Loutfi, expected in 2006.


Annual Report <strong>2004</strong> 47<br />

Project: Perceptual anchoring, J445<br />

Project leader: Silvia Coradeschi<br />

Staff: Alessandro Saffiotti, Mathias Broxvall, Kevin LeBlanc<br />

Funding: Swedish Research Council (Vetenskapsrådet) and CUGS<br />

Synopsis:<br />

Intelligent agents embedded in physical environments need the ability to connect the symbols<br />

used to perform abstract reasoning to the physical entities to which these symbols refer.<br />

Anchoring is the process of creating and maintaining the correspondence between symbols<br />

and sensor data that refer to the same physical objects. Anchoring must deal with indexical<br />

and objective references, definite and indefinite identifiers, and temporary impossibility to<br />

perceive physical entities. Furthermore it needs to rely on sensor data which is inherently<br />

affected by uncertainty, and to deal with ambiguities. This project belongs to the research line<br />

"Perceptual anchoring". The objective is the definition and the in-depth study of the problem<br />

of anchoring, and of its use in autonomous agents. The main "pull" is academic: the problem<br />

of anchoring has been defined as such at AASS, and this project aims at maintaining the<br />

position of AASS as the leader of a new research community working around this problem.<br />

Results in <strong>2004</strong>:<br />

- A three year extension grant was awarded to this project by the Swedish Vetenskapsrådet.<br />

- Organized a Workshop on Anchoring at AAAI-04 (San Jose, CA, July <strong>2004</strong>). Chairs: S.<br />

Coradeschi and A. Saffiotti.<br />

- Publication of 2 papers on dealing with ambiguities in anchoring (Int. Conf. on Intelligent<br />

Autonomous Systems, Amsterdam, NL; and ECAI Workshop on Cognitive Robotics,<br />

Valencia, Spain). Joint work with project J-446.<br />

- Publication of 1 workshop papers on anchoring in conceptual spaces (AAAI Workshop on<br />

Anchoring, San Jose, CA).<br />

Partners:<br />

- University of Palermo, Italy<br />

Future developments:<br />

- A new PhD student will be enrolled on this project, supported by the above grant.<br />

- Continue work on the resolution of ambiguities in perceptual anchoring using planning<br />

techniques.<br />

- Continue joint work with Univ. of Palermo on anchoring in conceptual spaces.


48 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Sensor-based planning for mobile robots, J446<br />

Project leader: Lars Karlsson<br />

Staff: Abdelbaki Bouguerra, Mathias Broxvall, Silvia Coradeschi, Alessandro Saffiotti<br />

Funding: Swedish Research Council (Vetenskapsrådet) and KK-foundation.<br />

Synopsis:<br />

The problem we investigate is conditional planning under uncertainty for autonomous robots.<br />

A conditional planner is able to account for different contingencies, and to plan in advance for<br />

detecting when these contingencies occur. For this purpose, we intend to research both the<br />

issues of representation, search etc for a conditional planner, and the integration of the planner<br />

into an actual robotic system. The planning techniques used will be based on an existing<br />

planner, PTLplan, which generates conditional plans taking into account probabilistic or<br />

possibilistic uncertainty, but which so far (like its competitors) has a simplified treatment of<br />

sensing. This project belongs to the research line "Behavioural plans". The objective is to<br />

extend existing planning techniques to better suit the needs of autonomous robotic<br />

applications. The main "pull" is academic.<br />

Results in <strong>2004</strong>:<br />

- Paper on hierarchical task planning under uncertainty presented at the Italian Workshop<br />

on Planning and Scheduling (Perugia, Italy).<br />

- Defined plan for Licentiate by Abdelbaki Bouguerra.<br />

- Publication of 2 papers on the use of planning to solve perceptual ambiguities (Int. Conf.<br />

on Intelligent Autonomous Systems, Amsterdam, NL; and ECAI Workshop on Cognitive<br />

Robotics, Valencia, Spain). Joint work with project J-445.<br />

- Publication of a paper on the use of sensor planning in olfaction (Int. Conf. on Intelligent<br />

Robots and Systems, Sendai, Japan). Joint work with project J-424.<br />

Partners:<br />

EC Network of Excellence on Planning: PLANET.<br />

Future developments:<br />

- Continue the study on the generation of on-the-fly plans to recover from failures in<br />

execution.<br />

- Journal submission of the work on hierarchical planning under uncertainty.<br />

- Licentiate by Abdelbaki Bouguerra to be produced by the end of 2005.


Annual Report <strong>2004</strong> 49<br />

Project: Robot team-work, J447<br />

Project leader: Robert Lundh<br />

Staff: Lars Karlsson, Alessandro Saffiotti<br />

Funding: CUGS and Faculty<br />

Synopsis:<br />

The objective of this project is to develop models and techniques to dynamically configure<br />

and re-configure a team of collaborating physical agents to adapt to the current tasks,<br />

situations and resources. Agents may be homogeneous or heterogeneous robots, and human<br />

agents may also be included in the team. The point of view is to see the team as a unique<br />

system, and each agent as providing set of functionalities. The configuration of the team is<br />

defined in terms of which agent provides which functionalities, to whom, and how. This<br />

project belongs to research line "Behavioural Plans", to which it adds the special focus on<br />

cooperation. The main "pull" of this project is academic.<br />

Partners:<br />

- EURON, the European Research Network<br />

- University of Murcia, Spain<br />

Results in <strong>2004</strong>:<br />

- Defined a framework for team configurations and implemented it in the Thinking Cap.<br />

- Published a paper about this framework at a workshop (ECAI Workshop on Agents in<br />

Dynamic and Real-Time Environments. Valencia, Spain).<br />

- Licentiate plan of Robert Lundh defined.<br />

- Set-up of an experimental platform, based on the Thinking Cap, for robot planning,<br />

navigation, and cooperation.<br />

Future developments:<br />

- Paper submission on configuration planning to IROS-05.<br />

- Work toward the licentiate of Robert Lundh (expected late 2005 – early 2006).<br />

- There will be a 6 month pause in 2006 due to parental leave.


50 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: RoboCup, J448<br />

Project leader: Kevin LeBlanc<br />

Staff: Robert Lundh, Kevin LeBlanc, Alessandro Saffiotti.<br />

Funding: CUGS and Faculty<br />

Synopsis:<br />

RoboCup is an international robot soccer competition. AASS is the leader of Team Sweden, a<br />

multi-university team currently including three Swedish universities (Orebro Univ, Lund<br />

Univ, and Blekinge Institute of Technology) and a Spanish one (Univ. of Murcia). Team<br />

Sweden has participated in all competitions since 1999, using the Sony AIBO robots as its<br />

robotic platforms. The objective of this project was to develop a team of autonomous robots<br />

able to compete in the RoboCup 2003 competition. This project belongs to the research line<br />

"Behavioural Plans", with a strong emphasis on the cooperation aspect. It has a mainly<br />

academic pull.<br />

Results in <strong>2004</strong>:<br />

- Participation in the RoboCup <strong>2004</strong> international competition in Lisbon, Portugal.<br />

- Presented a paper on cooperative object localization at the Int. Robocup Symposium<br />

(Lisbon, PT, July <strong>2004</strong>). Joint work with project J-463.<br />

- Presented a paper on fuzzy maps at the Int. Robocup Symposium (Lisbon, PT, July <strong>2004</strong>).<br />

Joint work with project J-415.<br />

- Presented a paper on localization with natural landmarks at the Int. Conf. on Information<br />

Processing and Management of Uncertainty (Perugia, Italy). Joint work with project J-<br />

415.<br />

Partners:<br />

Team Sweden (Orebro Univ, Lund Univ, and Blekinge Institute of Technology in Sweden;<br />

plus Univ of Murcia in Spain).<br />

Future developments:<br />

- This project will be discontinued in 2005.


Annual Report <strong>2004</strong> 51<br />

Project: Navigation System for Automatic Loaders, J449<br />

Project leader: Johan Larsson<br />

Staff: Mathias Broxvall, Alessandro Saffiotti.<br />

Funding: Robotdalen, Atlas Copco and Faculty<br />

Synopsis:<br />

This project comprises development of a robust and flexible navigation system for<br />

underground mine loaders (LHD, Load Haul Dump) that has only modest requirements in<br />

terms of infrastructure. The goal is to enable autonomous operation of these vehicles. This is<br />

accomplished by combining the mobile robotics skills at the AASS Mobile Robotics Lab with<br />

the knowledge of “real-world” applications of Atlas Copco Rock Drills AB. The idea is to<br />

have a navigation system that supports collections of sensors sufficient for operation in both<br />

open and closed environments. This project belongs to the research line "Behavioural plans".<br />

The objective is to use the B-plan technology to develop an autonomous system for Load-<br />

Haul-Dump operation in underground mines. The main "pull" is industrial.<br />

Results in <strong>2004</strong>:<br />

- Analyzed the state of the art in autonomous mining<br />

vehicles.<br />

- Defined the main approach and technologies.<br />

- Defined the sensors to be used, analyzing data<br />

collected in a test mine.<br />

- Developed a first version of a laboratory demonstrator<br />

running at high speed.<br />

Partners:<br />

Atlas Copco Rock Drills AB.<br />

Future developments:<br />

- Integrate RFID-based localization in the laboratory<br />

demonstrator, and test it in a mining environment.<br />

- Paper submission to the IFR conference.<br />

- Start the porting of the technique to the real vehicle.


52 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Cooperative perceptual anchoring, J463<br />

Project leader: Kevin LeBlanc<br />

Staff: Silvia Coradeschi, Alessandro Saffiotti<br />

Funding: Faculty and CUGS<br />

Synopsis:<br />

The objective of this project is to extend the notion of anchoring to capture "cooperative<br />

anchoring". This is the problem of how to create and maintain inter-agent agreement about the<br />

meaning of the words used in the exchange of information about a common physical<br />

environment. A typical example is the problem of establishing the correspondence between<br />

the linguistic symbols used by two different robots to refer to the same physical object.<br />

Cooperative anchoring is also needed for efficient human-robot cooperation. This project<br />

belongs to research line "Perceptual Anchoring", with a strong emphasis on the cooperation<br />

aspect. The main "pull" of this project is academic.<br />

Results in <strong>2004</strong>:<br />

- Developed experimental tool for the systematic evaluation of multi-robot localization<br />

under uncertainty.<br />

- Presented a paper on cooperative object localization at the Int Robocup Symposium<br />

(Lisbon, PT, July <strong>2004</strong>). Joint work with project J-448.<br />

- Defined Licentiate plan for Kevin LeBlanc.<br />

Partners:<br />

University of Murcia, Spain.<br />

Future developments:<br />

- Systematic experimental evaluation of different techniques for fuzzy information sharing.<br />

- Licentiate thesis by Kevin LeBlanc expected during 2005.


Annual Report <strong>2004</strong> 53<br />

2.2.3. Staff<br />

Alessandro Saffiotti, PhD, is a professor of Computer Science at the Centre for Applied<br />

Autonomous Sensors Systems of Örebro University, Sweden, where he heads the Mobile<br />

Robotics Lab. He has previously been a researcher with the University of Pisa (Italy), with<br />

SRI International (USA), and with the Universite Libre de Bruxelles (Belgium). His research<br />

interests encompass autonomous robotics, soft computing, and non-standard logics for<br />

common-sense reasoning. He has published more than 80 research papers in international<br />

journals and conferences, and co-edited a book on fuzzy logic techniques for autonomous<br />

navigation.<br />

He was a chair of the 1999, 2001 and 2003 IJCAI workshops on ``Reasoning with uncertainty<br />

in robotics'', of two workshops on “Anchoring symbols to sensor data” (at AAAI 2001 fall<br />

symposium and at AAAI <strong>2004</strong>), and of two workshops on “Cooperative robotics” (at IROS<br />

2002 and at ICRA 2005). In 2002 he co-organized the First European Summer School on<br />

cooperative robotics. In 2003 he was the chair of the 4-legged league at the International<br />

Robocup Competition. He will serve as chair for the poster track of IJCAI 2005. He is a<br />

member of IEEE, AAAI, and IAS.<br />

Mathias Broxvall, PhD, is a lecturer of Computer Science at the Centre for Applied<br />

Autonomous Sensor Systems of Örebro University. He presented his thesis, A Study in the<br />

Computational Complexity of Temporal Reasoning, at Linköping University within the field<br />

of temporal reasoning and constraint solving. His current research interests are autonomous<br />

robotics and planning. He has journal publications and articles in several well established<br />

international conferences. For teaching he has given programming, database, logics and<br />

artificial intelligence courses. On the side he has also contributed to and authored several<br />

large open-source projects.<br />

Silvia Coradeschi is an assistant professor at the Centre for Applied Autonomous Sensor<br />

Systems at Örebro University. She has received a master degree in Philosophy at the<br />

University of Florence, a master degree in Computer Science at the University of Pisa, and a<br />

PhD in Computer science at Linköping University. She is a member of the board of trustees<br />

of the RoboCup Federation and was general chair of the Third Robot World Cup Soccer<br />

Games and Conferences (RoboCup-99). She is also a member of the Advisory Board for the<br />

Seventeenth International Joint Conference on Artificial Intelligence (IJCAI-01) and member<br />

of the board of the European Coordinating Committee for Artificial Intelligence.<br />

Silvia Coradeshi is director of the undergraduate studies for the Computer Engineering<br />

Division at Örebro University and she is vice-head of the Technology Department. She has<br />

published 18 conference/journal papers and her main research interest is in establishing the<br />

connection (anchoring) between the symbols used to perform abstract reasoning and the<br />

physical entities, which these symbols refer to. She also works in multi-agent systems and<br />

cooperative robotics.


54 AASS – Center for Applied Autonomous Sensor Systems<br />

Lars Karlsson is an assistant professor at the Centre for Applied Autonomous Sensor<br />

Systems at Örebro University. He received a MSc. degree in Computer Science at Linköping<br />

University in 1993, and a PhD in 1999. He was a co-chair of the Third Robot World Cup<br />

Soccer Games and Conferences (RoboCup-99). He is the coordinator for the MSc program in<br />

Computer Engineering at Örebro University, and he is the director for graduate education in<br />

AASS. He has 18 conference/journal publications and his research interests include planning<br />

under uncertainty, reasoning about actions and integration between reasoning and<br />

action/perception in autonomous systems.<br />

Pär Buschka was born in Gothenburg, Sweden on April 22, 1966. He received the MSc<br />

degree in computer science and engineering in 1996 from Chalmers University of Technology<br />

in Gothenburg, Sweden. Since autumn 1999 he has been a graduate student at the Centre for<br />

Applied Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current<br />

research interests include mobile robot localization and navigation using hybrid maps.<br />

Ola Pettersson was born in Falkenberg, Sweden on March 7, 1972. He received the BSc<br />

degree in electrical engineering in 1994, and the MSc degree in electrical engineering in 1995<br />

(specialization in photonics and image analysis), both from Halmstad University, Halmstad,<br />

Sweden. In 2000 he received a Licentiate of Technology in computer science from Linköping<br />

University, Linköping, Sweden. Since fall 1996 he has been a graduate student at the Centre<br />

for Applied Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current<br />

research interests include mobile robot action control, planning, and execution monitoring.<br />

Zbigniew Wasik was born in Nowy Dwor Mazowiecki, Poland on October 13, 1973. He<br />

received both the BSc degree and the MSc degree in electrical engineering in 1998<br />

(specialization in Automation and Robotics) from Wroclaw University of Technology,<br />

Wroclaw, Poland. Since fall 1998 he has been a graduate student at the Centre for Applied<br />

Autonomous Sensor Systems, Örebro University, Örebro, Sweden. His current research<br />

includes a behaviour-based approach to real-time visual servoing of a mobile manipulator.<br />

Kevin LeBlanc was born in Moncton, New Brunswick, Canada, on November 11, 1977. He<br />

received his B.Sc. in Electrical Engineering with a Computer Engineering Option at the<br />

University of New Brunswick in May 2001. In the fall of 2002 he began graduate studies at<br />

the Centre for Applied Autonomous Sensor Systems, Orebro University, Orebro, Sweden. His<br />

research falls within the cooperative perception area; his primary focus deals with cooperative<br />

perceptual anchoring.<br />

Robert Lundh was born in Jämshög, Sweden on September 17, 1978. He received the MSc<br />

degree in Computer Technology in 2002 from Örebro University, Örebro, Sweden. Since late<br />

spring 2002 he has been a graduate student at the Centre for Applied Autonomous Sensor<br />

Systems, Orebro University, Orebro, Sweden. His current research is within the field of<br />

cooperative robotics.<br />

Abdelbaki Bouguerra was born in M'sila, Algeria on October 10, 1974. He received an<br />

Engineering degree in Computer Science in 1997 (in Computer Systems) from The National<br />

Institute of Computer Science, Algiers, Algeria, and a Master degree in Computer Science in<br />

2001 (specialization Industrial Computer Science) from the National Military Polytechnics<br />

School, Algiers, Algeria. He joined Schlumberger-Geoquest as a data management Engineer<br />

in the same year where he worked for approximately one year, and then he joined the<br />

department of computer science at Linköping University as a visiting scholar for six months.


Annual Report <strong>2004</strong> 55<br />

Since January 2003, he has been a graduate student at the Centre for Applied Autonomous<br />

Sensor Systems, Orebro University, Orebro, Sweden. His current research includes planning<br />

and execution for mobile robots.<br />

Johan Larsson was born in Norrköping Sweden, in July 1970. He received the MSc degree<br />

in mechanical engineering (specialization in mechatronics) in 1996, from the Royal Institute<br />

of Technology, Stockholm, Sweden. In 1998 he joined Atlas Copco Rock Drills, Örebro,<br />

where he has developed software for the underground drill rig control systems. Since<br />

February <strong>2004</strong> he has been a graduate student at the Centre for Applied Autonomous Sensor<br />

Systems, Örebro University, Örebro, Sweden. His current research focuses on the<br />

autonomous navigation of industrial vehicles in underground mines.


56 AASS – Center for Applied Autonomous Sensor Systems<br />

2.3 Intelligent Control Lab<br />

The objective of the lab is to build perception-based control systems able to perform humanlike<br />

motions and operations by bringing together the sensation and the control in mechatronic<br />

systems. We emphasize on two types of activities:<br />

• Development of new methodologies,<br />

technologies and equipment for<br />

implementing complex control systems.<br />

• Integrating above with soft computing<br />

methods, control algorithms and sensing<br />

technology to achieve high-speed motion<br />

control systems with embedded intelligence.<br />

2.3.1 Research directions<br />

Our work and expertise is concentrated in three major research directions:<br />

• Advanced Mechatronic Systems: we design, develop and prototype specific robotic<br />

constructions for performing dedicated stand-alone desktop operations or for integration<br />

with a mobile platform. Desired dynamic properties, balanced kinematics, minimum<br />

energy consumption, higher flexibility and compliance are combined for accomplishing<br />

maximum performance. Various interfacing and integration types of problems are<br />

addressed for achieving properties that outperform existing systems.<br />

• Advanced Control and Industrial Applications: we develop methods to control robots that<br />

are designed at our lab for performing complex behaviour like executing a motion for a<br />

minimum time, studying human arms motions for transferring them to a robot for given<br />

task. Another aspect is the industrial orientation of our work aimed at the transfer of the<br />

advanced technologies developed in the lab to industry.<br />

• Vision, Image and Signal Processing Systems: we apply, in a novel way, fuzzy similarity<br />

ideas to the development of new methods and algorithms for very efficient real-time<br />

vision and image processing, operating at high speed, and needed for any high speed<br />

motion control system. The concept of fired-rules-hyper-cube was introduced by us and<br />

implemented on FPGA-chips for fuzzy logic based control, high frequency signal and<br />

real-time image processing.<br />

In what follows we describe the work done during <strong>2004</strong> on specific projects from the above<br />

three research directions.


Annual Report <strong>2004</strong> 57<br />

2.3.2 Projects in <strong>2004</strong><br />

Project: Fast fuzzy logic image processing and fast vision system, J432<br />

Project leader: Ivan Kalaykov<br />

Staff: Gustav Tolt<br />

Funding: KK-foundation - IT and Faculty<br />

Synopsis:<br />

The project belongs to the research direction "Vision, image and signal processing". The<br />

objective is to develop techniques for high-speed image processing and high-speed vision<br />

system able to provide over 50-60 frames per second for the low and medium levels of image<br />

processing. This performance is needed for real-time image processing systems such as fast<br />

vision systems in visual-servoing tasks when it is necessary to control high-speed motion.<br />

This project is based completely on the academic challenge to outperform the current<br />

industrial vision systems, which generally limit the frequency band of robot motion control.<br />

However, the fast image processing algorithms can be used in various applications where the<br />

processing time is an important factor.<br />

Partners: None<br />

Results in <strong>2004</strong>:<br />

- One publication, two others in final stage of preparation.<br />

- Simulated image processing functions in VHDL-based; development system.<br />

- Doctoral dissertation by Gustav Tolt draft available; planned for defence in April 2005.<br />

Major contributions include:<br />

- Unified approach to image processing based on the fuzzy similarity principle.<br />

- High performance algorithms both in terms of speed and quality of the processing.<br />

- Set of hardware structures for implementing the typical image processing algorithms.<br />

- Embedded high-speed image processing algorithms using fuzzy logic.<br />

Future developments:<br />

Short-term goals:<br />

- Development and completing the theoretical issues of the unified approach to low and<br />

medium level image processing based on fuzzy similarity principle.<br />

- Experimental tests of the developed concepts and algorithms on prototype hardware<br />

system, possibly for some industrial applications under Robotdalen.<br />

Long-term goals:<br />

- Further development of the fuzzy similarity concept for higher level of image processing<br />

and for higher complexity of image-based scenarios.<br />

- Expansion of the research by opening new PhD student position(s), as this direction is<br />

foreseen as fundamental for the IC lab.<br />

- Experimental hardware platform by cooperation with the Mälardalens högskolan under a<br />

joint Robotdalen project.<br />

- Performing tests in industrial environments.


58 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Redundant robots, J441<br />

Project leader: Anani Ananiev<br />

Staff: Thorsten Michelfelder, Ivan Kalaykov<br />

Funding: Faculty<br />

Synopsis:<br />

The project belongs to the research direction "Advanced Mechatronic Systems". The<br />

objective is to overcome problems with strength, navigation and locomotion that have<br />

restricted the use of snake-like robots. The mechanical and the electronic design of the snake<br />

will be based on minimalist approach with as simple as possible mechanical construction and<br />

simplest control system. The development of environment-specific movement strategies is<br />

currently a hot topic of research.<br />

Partners:<br />

Velox Devices, LLC, New York, USA<br />

Results in <strong>2004</strong>:<br />

- One publication.<br />

- Working prototype with basic modes of motion.<br />

- Demo is available, demonstrated at ISR’<strong>2004</strong>, Paris.<br />

Major contributions include:<br />

- Unique approach for motion transmission system embodied in the robot using only one<br />

irreversible motor.<br />

- Optimised ratio of weight and force.<br />

Future developments:<br />

Short-term goals:<br />

- To complete the snake-robot with the minimum set of sensors and functionalities for<br />

performing a pre-specified set of tasks in rescue-related scenarios.<br />

- To study the electromechanical properties of the innovative driving mechanism and the<br />

respective control approaches for obtaining certain dynamical properties.<br />

- To study the constraints of the driving mechanism and the limitations on the total<br />

construction of a hyper-redundant robot of this type.<br />

Long-term goals:<br />

- To extend the approach for building hyper-redundant robots of other configurations for<br />

performing high-complexity tasks in industrial environments. This goal will be coordinated<br />

with ABB Robotics, which expressed their interests to be active industrial<br />

partner.<br />

- To build complete dynamical model of the hyper-redundant robot with this kinematics<br />

structure and unique driving mechanism


Annual Report <strong>2004</strong> 59<br />

Learning Control of Robot Arms by Emulating Human Actions, J460<br />

Project leader: Tom Duckett<br />

Staff: Alexander Skoglund: a PhD student at the Intelligent Control Lab (50%) and at the<br />

Learning Systems Lab (50%), Rainer Palm, Ivan Kalaykov.<br />

Note:<br />

This is a common project with the Learning Systems lab. For detailed description look at<br />

Section 2.3 (J460).


60 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Cooperating arms, J465<br />

Project leader: Ivan Kalaykov<br />

Staff: Anani Ananiev, Thorsten Michelfelder<br />

Funding: Faculty<br />

Synopsis:<br />

The project belongs to the research direction "Advanced Mechatronic Systems". The<br />

objective is to develop techniques for performing cooperating actions of two (or more) robotic<br />

arms in executing common tasks where one arm is needed to do the main action and the other<br />

is complementing the first, for example providing support. The cooperative actions are based<br />

on embedded learned/pre-programmed behaviours and visual guidance. Additional sensory<br />

information will be used depending on the concrete application. This project is based on<br />

purely academic idea, however certain applications are envisioned.<br />

Partners: None<br />

Results in <strong>2004</strong>:<br />

- Preparation of an experimental set-up.<br />

Future developments:<br />

- Decision to discontinue the project was made due to limited manpower and absence of<br />

possibility to employ a PhD student. Some issues on cooperating arms are foreseen as part<br />

of the hyper-redundant robot project J441.


Annual Report <strong>2004</strong> 61<br />

Project: Flexible food cell, J466<br />

Project leader: Ivan Kalaykov<br />

Staff: Anani Ananiev, Lars Jennergren<br />

Funding: KK-foundation<br />

Synopsis:<br />

The project belongs to the research direction "Advanced Mechatronic systems". The objective<br />

is to create an intelligent assembly cell for ready to eat meals. The production has to be<br />

customer oriented, which leads to shorter and more irregular production series with an<br />

increased number of different products. During the entire project the hygienic aspects and<br />

mechanical and thermal restriction of food assembly are considered. The project is started in<br />

co-operation with SIK (The Swedish institute for food and biotechnology). The work is<br />

strongly related to the food factory of the future, which is one of the major projects at SIK.<br />

The results will hopefully improve its capacity.<br />

Partners:<br />

SIK, Göteborg<br />

Results in <strong>2004</strong>:<br />

- Three publications.<br />

- Licentiate thesis officially presented and defended in August <strong>2004</strong>.<br />

Major contributions include:<br />

- Hygienic and robust manipulation of specific food groups.<br />

- A flexible cell layout that is easy to reconfigure for new product variants.<br />

- A demonstration cell that can assemble a set of pre-specified products.<br />

Future developments:<br />

- Increasing the level of intelligence in all phases of preparing the execution plan.<br />

- Increasing the robustness of the entire system by introducing continuous visual feedback<br />

during the plan execution (assembly of meals).<br />

- The project is discontinued as the employment of Lars Jennergren at SIK has finished and<br />

no further funding is available.


62 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Friction Steer Welding (FSW) Robot Welding, J467<br />

Leader: Anani Ananiev<br />

Staff: Mikael Soron, Ivan Kalaykov<br />

Funding:<br />

Robotdalen, ESAB Welding Equipment AB, Specma Automation, ABB Robotics and Faculty<br />

Project synopsis<br />

Friction Stir Welding (FSW) is a relatively new welding method invented by the TWI<br />

Company in UK in 1991. It is used for welding mainly of aluminium, for example in airplane<br />

and space industry. There exists a need for developing a technology for three-dimensional<br />

welding of large and small objects for various other industries such as car manufacturing. The<br />

goal of this project, supported by Robotdalen, is to contribute to finding proper solution based<br />

on the competence at the Intelligent Control Laboratory in robot kinematics and dynamics,<br />

and visual-servoing and force feedback control as well.<br />

Duration<br />

Started in September 2003, ends in 2005.<br />

Collaborations<br />

ESAB, Laxå<br />

Specma Automation, Laxå<br />

ABB Robotics, Västerås<br />

Results achieved in <strong>2004</strong><br />

- Survey and analysis of publications.<br />

- Concept of a licentiate thesis.<br />

- Preliminary test of feasible methods<br />

- Development and test of force-feedback system for ABB robot.<br />

Expected results 2005<br />

- Completed primary tests for the functionality of the demonstration platform.<br />

- Completed licentiate thesis of M. Soron.<br />

Major contributions include:<br />

- Developing techniques for force-feedback control of industrial robot with compensation<br />

of gravity in 3D space.<br />

- Development of fully operational demonstration platform with ABB robot force sensor<br />

and FSW-tool.<br />

Future developments:<br />

- Development of user-friendly environment for off-line planning and verifying of 3Dwelding<br />

trajectories.<br />

- Development of integrated hardware/software in the loop system for increasing the<br />

effectiveness of the set-up operations.


Annual Report <strong>2004</strong> 63<br />

Project: Vision-Based Control of Continuous Webs and Flows, J468<br />

Project leader: George Fodor<br />

Staff: Thomas Uppgård, George Fodor, Ivan Kalaykov<br />

Funding: KK-foundation and Faculty.<br />

Project synopsis<br />

The project belongs to two research directions “Advanced control and industrial applications”<br />

and “Vision, image and signal processing”. The objective is to develop and test new<br />

techniques for quality monitoring and direct control of web/texture materials flowing with<br />

high speed. This is one form of direct application of the results of the “Fast vision system”<br />

project in industry wherever appropriate.<br />

Duration<br />

Started in October 2003, continues till end of 2008.<br />

Collaboration<br />

ABB Automation Technology Products, Instrumentation and Control<br />

Results achieved in <strong>2004</strong><br />

- Survey and analysis of publications.<br />

- Concept of a licentiate thesis.<br />

Expected results 2005<br />

- Preliminary test of feasible methods<br />

- Publications<br />

Milestones<br />

March-April 2006: licentiate thesis<br />

Major contributions include:<br />

- Developing new techniques for quality monitoring and direct control of web/texture<br />

materials and real-time control of the respective machines.<br />

Relation to other projects<br />

Input from J432 (Fast fuzzy logic image processing and fast vision system): the processing<br />

unit and the respective hardware structure.


64 AASS – Center for Applied Autonomous Sensor Systems<br />

The Robot Air-hockey Player, integration project, J4XX<br />

Project leader: Ivan Kalaykov<br />

Staff: Gustav Tolt, Mikael Soron, ex-job students Lasse Nord, Daniel Magnusson<br />

Funding: KK-foundation – IT, Robotdalen and Faculty.<br />

Project synopsis<br />

The goal is to make interactive demonstrations where humans and robots share the same<br />

space or perform a co-operative task in the form of playing a game between a human and<br />

robot. The challenging problem of fast eye-to-hand reaction is in: (i) evaluating the strike of<br />

the opponent; (ii) detecting the direction of puck’s motion; (iii) predicting its trajectory and<br />

(iv) activating arm-hand motion to intercept the puck and implement counter strike to the<br />

opponent’s field. The main difficulty is the extremely short time interval to complete all these<br />

actions. To be winning, the human players must train certain time otherwise only good luck<br />

can provide victory. The task is very advanced for robot players. Extremely fast image<br />

processing and fast robots are only prerequisites for achieving such performance.<br />

Duration<br />

Started in January <strong>2004</strong>, continued till June <strong>2004</strong>.<br />

Collaboration<br />

None<br />

Results achieved in <strong>2004</strong><br />

- Developed effective control system for rapidly changing and poorly modelled<br />

environment with sensor noise and error.<br />

- Developed an accurate prediction procedure of target motion with the least computational<br />

load.<br />

- Developed a switching planning and execution control strategy, based on the estimated<br />

and predicted trajectory of the puck, before entering the robot’s play field.<br />

- Integration of all components and achieving reasonable (within the limitations caused by<br />

the available hardware components) behaviour of the entire hybrid in nature high-speed<br />

two-dimensional ballistic manipulation system.<br />

- M.Sc. thesis presented and accepted.<br />

Future developments:<br />

- Topics are clarified, but not possible to be planned for implementation, as it will depend<br />

on available resources in the next years for eventual continuation of the project.


Annual Report <strong>2004</strong> 65<br />

2.3.3 Staff<br />

Prof. Ivan Kalaykov received his Dipl. Eng. in Electrical Engineering, Ph.D. in Control<br />

Engineering from the Technical University of Sofia, Bulgaria, 1972 and 1985 respectively. In<br />

January <strong>2004</strong> he became a professor at the Dept. of Technology, Örebro University. He has<br />

been an Associate Professor at: Dept. of Control and Systems Engineering, Technical<br />

University of Sofia, since 1987; Dept. of Physics, Trömsoe University, Norway, 1998-1999;<br />

and the Dept. of Technology, Örebro University since 2000, where he is now the head of the<br />

Intelligent Control Lab. He has been a visiting researcher at the Control Laboratory of Dept.<br />

of Electrical Engineering, Delft University of Technology, Netherlands and Institute for<br />

Peripheral Microelectronics, University of Kassel, Germany. He has been also Chairman and<br />

Vice-chairman of the Bulgarian Union of Automation and Informatics (UAI - the professional<br />

society of control engineers).<br />

Ivan Kalaykov served as IPC-member of many scientific events and has more than 60<br />

conference/journal publications. His research interests include adaptive control systems,<br />

intelligent control systems, fuzzy logic control, fuzzy logic hardware, and visual servoing for<br />

robot manipulation. He is a member of IEEE, SPIE and EUSFLAT.<br />

Prof. George Fodor received his M.Sc. degree in Electrical Engineering from the<br />

Polytechnic Institute of Cluj, Romania, in 1979, and the Ph.D. degree in Computer Sciences<br />

from the Linköping University, Sweden, in 1995. He is currently the head of the Systems<br />

Development Dept. for Force Measurement and Systems at ABB Automation Products,<br />

Sweden. He is an Adjunct Professor at Western Michigan University, Kalamazoo, USA, from<br />

1997 and member of the Advisory Board of the Electrical and Computer Engineering Faculty<br />

at the same university from 1998. He is an associated professor at Örebro University, Sweden,<br />

from 2000. His research interests include discrete control, control of complex industrial<br />

systems, discrete fault detection and isolation, ontological control, software architectures. He<br />

is the author of one book and some 30 conference and journal articles.<br />

Doc. Anani Ananiev is an Associate Professor at the Centre for Applied Autonomous Sensor<br />

Systems at Örebro University. He received his Dipl.Eng. in Mechanical Engineering and<br />

Ph.D. in Robotics and Automation from the Technical University of Sofia in 1987 and 1992<br />

respectively. He is an associate professor (on leave) at the Dept. of Robotics and<br />

Mechatronics, Institute of Mechanics, Bulgarian Academy of Science. He has been a visiting<br />

researcher at the Robotics Laboratory of the Wuppertal University, Germany, 1994 -1998;<br />

and Dept. of Robotics at the Institute Superior Technico, Lisbon, 1995-1997. He has 65<br />

conference/journal publications, 27 patents and has received 2 bronze medals at INPEX IX<br />

(US Invention New Product Trade Show) in 1993. His research interests include robotics,<br />

lightweight robot arms, and hyper-redundant robots.<br />

Prof. Dimiter Driankov received the BSc Math degree, the MSc degree in Computer Science<br />

from the University of Sofia, Faculty of Mathematics, Sofia, Bulgaria, and the PhD degree in<br />

Computer Science from the Univ. of Linköping, Linköping, Sweden in 1973, 1975, and 1988<br />

respectively. From 1985 to 2000 he was with the Dept. of Comp. Sci., Univ. of Linköping<br />

where he was heading the Autonomous Systems Lab (1996-1999). At present he is a visiting<br />

researcher with the Division for Artificial Intelligence and Integrated Computer Systems at<br />

this department and a member of the Wallenberg Lab for Information Technology and


66 AASS – Center for Applied Autonomous Sensor Systems<br />

Autonomous Systems. Since 2001 he is a professor at the Technology Dept., Örebro Univ.,<br />

Örebro, Sweden acting as a research coordinator for the Applied Autonomous Sensor Systems<br />

Centre. During the period 1990--1997 he has spent a total of three years as Visiting Scientist<br />

at Siemens Corporate R & D, Munich, Germany.<br />

Dimiter Driankov is a member of the IEEE Technical Committee on Intelligent Control and<br />

on the editorial board of the Int. Journal of Uncertainty, Fuzziness and Knowledge-based<br />

Systems. He has co-authored and authored more than 40 conference, journal articles, and<br />

book chapters, 2 books, and 3 edited volumes in the areas of fuzzy logic and fuzzy control. He<br />

is a coordinator for a EC Marie Curie Training Site in the area of autonomous robotic<br />

systems. His current research interests and activities are in the areas of model-based fuzzy<br />

control, computational theories of perception, and perception-based control of autonomous<br />

vehicles.<br />

Christer Lindkvist was born in Örebro, Sweden, on December 23, 1954. He received his<br />

BSc degree in 1988 from Örebro University. From July 1, 1989 he works as teacher in the<br />

Department of Technology, Örebro University. In the fall of 2001 he became a graduate<br />

student with AASS, Örebro University. His current research interests include distributed<br />

component-based systems.<br />

Gustav Tolt was born in Örebro, Sweden, on January 14, 1975. He received MSc degree in<br />

engineering physics (specialization in signal processing and image analysis) from Chalmers<br />

University of Technology, Gothenburg, Sweden. Since February 2000 he is a graduate student<br />

at AASS, Örebro University. His research interests include high-speed image processing and<br />

computer vision.<br />

Lars Jennergren received his MSc in Mechanical engineering at the Technical University of<br />

Luleå, Sweden in 2002. His main subject was production engineering; this was also the area<br />

of his thesis work conducted at SKF, Gothenburg, Sweden. Since April 2002 he is a graduate<br />

student within a project conducted in co-operation between SIK, Swedish institute for food<br />

and biotechnology, and AASS, Örebro University, Sweden. His research includes<br />

requirements and building of a flexible assembly cell for ready-to-eat meals including topics<br />

such as production strategies, flexible cell layout, grasping and manipulation of fragile items,<br />

such as food.<br />

Thorsten Michelfelder was born in Freiburg im Breisgau, Germany, in 1977. He received his<br />

BEng degree in mechatronics at FH Karlsruhe. Now he is completing his MSc at Örebro<br />

University and is a part-time research assistant at AASS. His research interests include<br />

mechatronics systems and robotics.<br />

Thomas Uppgård was born in Avesta, Sweden on Mars 8, 1978. He received the MSc degree<br />

in Computer Engineering from Örebro University, Örebro, Sweden 2002. He is since fall<br />

2003 an industrial PhD student at the Centre for Applied Autonomous Sensor Systems at<br />

Örebro University in cooperation with ABB Automation Technology Products. His research<br />

interests are visual based control of continuous webs and flows.


Annual Report <strong>2004</strong> 67<br />

Alexander Skoglund is a Ph.D. student at the Dept. of Technology, Örebro University<br />

between the Learning Systems and Intelligent Control Laboratories at AASS. He received the<br />

B.Sc. degree in Electrical and Electronic Engineering in 1998 and his M.Sc. degree in<br />

Electrical and Electronic Engineering in 2002, both from Örebro University. Between 2000-<br />

2001 he worked at AerotechTelub as a radio engineer, and from 2001-2003 at AASS, Dept. of<br />

Technology, Örebro University as a research engineer. Since February 2003 he has been a<br />

graduate student with research interests in robotic manipulation and learning.<br />

Mikael Soron was born in Motala, Sweden, on February 12, 1975. He received his MSc<br />

degree in Computer Technology in 2003 from Örebro University, Örebro, Sweden. Since<br />

June 2003 he is an industrial PhD student at AASS, Örebro University, in co-operation with<br />

Robotdalen. His research interests include robotic control for Friction Stir Welding.


68 AASS – Center for Applied Autonomous Sensor Systems<br />

2.4 Learning Systems Lab<br />

Our objective is to advance the state-of-the-art in the theory and practice of learning and<br />

adaptation in autonomous sensor systems. This will be achieved by developing strongly<br />

autonomous agents with the capacity to learn from experience and thus to adapt to highly<br />

dynamic and uncertain environments and working scenarios.<br />

These situations are very difficult to model by traditional methods of numerical analysis due<br />

to the highly unpredictable nature of both the agent's sensory perceptions and the effects of<br />

motor actions, and the presence of other agents such as humans. We therefore focus on<br />

learning and adaptation through interaction of the agent with the user and environment. The<br />

techniques that we apply include unsupervised, supervised and reinforcement learning<br />

algorithms, including artificial neural networks, genetic algorithms, self-organisation, etc.<br />

2.4.1 Research directions<br />

The research focus of the Learning Systems Lab is the development of robots and<br />

autonomous systems that can improve performance by learning from their own sensor<br />

information and/or sensor-motor experience. We concentrate on three major research<br />

directions in particular:<br />

1. Navigation systems<br />

This covers learning of spatial representations and behaviours in mobile robotic systems<br />

that have various levels of autonomy, by application of state-of-the-art in sensor and<br />

measurement technology.<br />

2. Learning control<br />

This covers learning of robotic skills and behaviours from human demonstration, selforganisation<br />

and reinforcement learning, including control of both mobile robots and<br />

robotic manipulators.<br />

3. Perception systems<br />

This covers pattern recognition and self-organisation in robotics and automation,<br />

including recognition of people, objects and places by autonomous robots, and automatic<br />

sensory analysis in the Future Food Factory.<br />

The research methodology of the Learning Systems Lab is based on developing theoretically<br />

sound solutions to real world problems, and places strong emphasis on empirical methods,<br />

including use of performance metrics, quantitative comparisons of actual systems, and<br />

statistical tests of significance.<br />

In what follows we describe the work done in <strong>2004</strong> on specific projects from the above three<br />

research directions.


Annual Report <strong>2004</strong> 69<br />

2.4.2 Projects in <strong>2004</strong><br />

Project: Hierarchical learning of robot behaviours, J450<br />

Project leader: Tom Duckett<br />

Staff: Li Jun<br />

Funding: KK-foundation, Faculty and regional funding<br />

Synopsis:<br />

The project belongs to the research direction Learning Control. The project will develop a<br />

generic architecture for learning sensor-motor behaviours in robotic systems, without<br />

requiring pre-programmed symbolic representations. Instead, the robot will develop its own<br />

internal representations through a process of incremental on-line learning. One application of<br />

this technology would be programming by demonstration, where the human operator simply<br />

shows the robot what to do (e.g., "water my plants", "clean my bathroom", etc.). The<br />

behaviours acquired will be complex, non-linear and non-achievable by a purely reactive<br />

system, so the learning system must incorporate representations, which encode the temporal<br />

and spatial context of the task and environment. A particular challenge will be to carry out all<br />

of the learning in real-time. The project investigates the implementation of a hierarchy of<br />

fast, on-line learning algorithms that are integrated by layered learning. The techniques<br />

investigated include, but are not limited to, embedded machine learning algorithms such as<br />

self-organisation, recurrent artificial neural networks and reinforcement learning.<br />

Partners:<br />

University of Alicante, Spain (Assoc. Prof. Tomas Martinez).<br />

Results in <strong>2004</strong>:<br />

Li Jun successfully defended his Licentiate thesis in November <strong>2004</strong> (previously planned for<br />

May <strong>2004</strong>), and a journal article has been submitted based on this work.<br />

Future developments:<br />

Li Jun should be ready to defend Ph.D. Thesis around November 2005. This will<br />

involve incorporating reinforcement learning into the architecture for teaching by<br />

demonstration, based on the earlier work using growing RBF networks for function<br />

approximation in perception-based robot control. More substantial results and several more<br />

publications are urgently required.


70 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Enabling robot-human cooperation, J451<br />

Project leader: Tom Duckett<br />

Staff: Grzegorz Cielniak, Andre Treptow (Marie Curie fellow, Tuebingen University).<br />

Funding: KK-foundation, Faculty, regional funding and EU.<br />

Synopsis:<br />

The project belongs to the research direction Perception Systems. The ability to interact with<br />

people is an important requirement for robots, which operate in populated environments. In<br />

tasks such as cleaning, housekeeping, rehabilitation, entertainment, inspection and<br />

surveillance, so-called service robots need to communicate and cooperate with people. To<br />

enable this interaction, the robot needs to know how many people there are in the<br />

neighbourhood, their position, and who they are (the three fundamental problems of people<br />

detection, localisation and identification).<br />

The platform for this research is a mobile robot equipped with vision, thermal, omnidirectional<br />

vision and laser sensors. In current work, we are integrating methods for detection,<br />

localisation and identification of persons by a mobile robot using vision, thermal and laser<br />

data. The eventual goal is to obtain 95% recognition performance within a few seconds by a<br />

moving mobile platform on a database comprising the members of AASS. Possible themes for<br />

future research include recognition, interpretation and prediction of human behaviour.<br />

Partners:<br />

Autonomous Intelligent Systems Group, Freiburg University, Germany (Prof. Wolfram<br />

Burgard).<br />

University of Tuebingen, Computer Science Dept., Germany. (Prof. Andreas Zell).<br />

Results in <strong>2004</strong>:<br />

Two journal articles accepted for publication: one appeared in <strong>2004</strong> (J. Intelligent and Fuzzy<br />

Systems) and one will appear in 2005 (Int. J. Robotics Research). Paper presented at<br />

SAIS/SLSS Workshop in Lund, Sweden, April 15-16, <strong>2004</strong>. A major development was the<br />

visit of Andre Treptow, a Marie Curie fellow and Ph.D. student from Tuebingen University.<br />

This resulted in a working system for tracking of people in thermal images and then tracking<br />

of the face region in a greyscale image using Particle Filters, and some first results in<br />

identification using Eigenfaces.<br />

Future developments:<br />

Grzegorz Cielniak to defend Ph.D. Thesis around December 2005. Subsequent work for the<br />

Ph.D. will include person identification, e.g., by improved face recognition, integration of the<br />

two previous works on high-level/global tracking with Abstract Hidden Markov Models (with<br />

Freiburg Univ.) and lower-level/local tracking with Particle Filters (with Tuebingen Univ.),<br />

and final evaluation of the complete system with respect to the project goals.


Annual Report <strong>2004</strong> 71<br />

Project: Simultaneous localisation and mapping, J452<br />

Project leader: Tom Duckett<br />

Staff: Peter Biber (Marie Curie fellow, Tuebingen University).<br />

Funding: Faculty and EU (Marie Curie programme)<br />

Synopsis:<br />

The project belongs to the research direction Navigation Systems. Maps are essential for<br />

mobile robots navigating in non-trivial environments, being needed for tasks such as path<br />

planning, manipulation of objects, and communication with humans. To navigate in unknown<br />

environments, an autonomous robot requires the ability to build its own map while<br />

simultaneously maintaining an estimate of its own position. This is a hard problem because<br />

the same, noisy sensor data must be used for both mapping and self-localisation.<br />

Most existing solutions to the problem of simultaneous localisation and mapping (SLAM)<br />

work by decoupling the localisation and mapping processes, assuming that the data<br />

association problem (i.e., landmark identification) is already solved when measurements are<br />

updated into the map. However, this assumption is bound to fail eventually for robots<br />

operating in difficult or populated environments. This project investigates robust SLAM<br />

algorithms that take into account both the measurement uncertainty (e.g., due to sensor noise)<br />

and identification uncertainty (e.g., due to perceptual aliasing).<br />

Partners:<br />

BISS, University of Bremen, Germany (Dr. Udo Frese).<br />

WSI-GRIS, Tuebingen University, Germany (Prof. Wolfgang Strasser)<br />

Results in 2003:<br />

Journal article (IEEE Trans. Robotics) on multi-level relaxation accepted for publication (with<br />

Bremen Univ.). Paper on 3D modelling presented at IROS’04, Japan (with Tuebingen Univ.<br />

and Henrik Andreasson, AASS). A major development was the visit of Peter Biber, a Marie<br />

Curie fellow and Ph.D. student from Tuebingen University. This resulted in the development<br />

of a new approach for lifelong learning in dynamic environments, so that the robot’s map is<br />

adapted perpetually over time.<br />

Future developments:<br />

Future work will include further theoretical and practical developments, including more work<br />

on evolutionary algorithms for handling the data association problem in SLAM, and<br />

experiments in outdoor mapping.


72 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Navigation by smell, J453<br />

Project leader: Tom Duckett<br />

Staff: none yet.<br />

Funding: Faculty<br />

Synopsis:<br />

The project belongs to the research direction Navigation Systems. Smell is perhaps the least<br />

studied sense in robotic applications. Gas sensor systems known as "electronic noses" have<br />

been widely used under laboratory conditions, e.g., for food analysis, but so far there have<br />

been few applications on mobile platforms in real world environments, e.g., for use by<br />

intelligent service robots. There are a number of reasons why this should be so, including the<br />

complexity of the sample handling process and environmental influences such as air<br />

turbulence.<br />

This project investigates mechanisms for navigation using olfaction, especially concerning the<br />

problem of gas source localisation in indoor environments that are not artificially ventilated<br />

(thus a strong constant airflow cannot be assumed, as in other works). Several different<br />

approaches are considered, including gas concentration mapping, reactive sensor-motor<br />

behaviours, and re-implementation of the navigation strategies used by biological systems.<br />

Partners:<br />

Computer Science Dept., University of Tuebingen, Germany (Dr. Achim Lilienthal).<br />

Results in <strong>2004</strong>:<br />

Two journal articles were published in <strong>2004</strong> (RSJ J. Advanced Robotics, Robotics and<br />

Autonomous Systems) with Achim Lilienthal (Tuebingen Univ.)<br />

Future developments:<br />

Depends on whether an additional full time researcher can be recruited to the Learning<br />

Systems Lab.


Annual Report <strong>2004</strong> 73<br />

Project: Sensory analysis in the future food factory, J455<br />

Project leader: Tom Duckett<br />

Staff: Per Munkevik Gunnar Hall (SIK, Gothenburg).<br />

Funding: Faculty, regional funding, SIK, Gothenburg and Delfoi AB.<br />

Synopsis:<br />

The project belongs to the research direction Perception Systems. The most common way<br />

today to make descriptions, analyses and inspections of food products is to use people, either<br />

in the production line or in sensory evaluation panels. In the production line they discriminate<br />

invalid products from valid ones but they are also a possible source for contamination of the<br />

food. There are two kinds of sensory evaluation panels; one is a customer panel and the other<br />

is an expert panel used to describe the properties of the evaluated food product.<br />

This project tries to find a solution to make inspections, descriptions and sensory evaluations<br />

of food, especially ready meals, without using people. The main approach at the moment is to<br />

use a sensor system consisting of a digital camera and an electronic nose to get samples of<br />

meals. A segmentation algorithm is used to extract the contents of the meal. Several features<br />

are extracted for each component, e.g., concerning its shape and position on the plate and its<br />

sensory properties. A pattern recognition system is then used to make a quality evaluation of<br />

the meal.<br />

Partners:<br />

SIK (The Swedish Institute for Food and Biotechnology), Gothenburg.<br />

Results in <strong>2004</strong>:<br />

Paper presented at International Conference on Engineering and Food (ICEF9), Montpellier,<br />

France, March 7-11, <strong>2004</strong>. All research work completed for Lic. Thesis.<br />

Future developments:<br />

Per Munkevik to defend Lic. Thesis in March. 2005. Project ends unless further funding to<br />

Ph.D. can be found. Two journal articles to be submitted.


74 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Learning control of robot arms, J460<br />

Project leader: Tom Duckett<br />

Staff: Alexander Skoglund, Rainer Palm (AASS Intelligent Control Lab).<br />

Funding: KK-foundation, Faculty. In addition the three month stay of a student financed by<br />

EU (Marie Curie programme).<br />

Synopsis:<br />

The project belongs to the research direction Learning Control. To manually program a robot<br />

is a tedious job for anyone. It would be much more convenient to just show the robot what to<br />

do, and for the robot to learn the required behaviour automatically (this type of learning is<br />

often known as "teaching by demonstration" or "teaching by showing"). How to capture and<br />

apply a human's control abilities for driving a robot arm to perform human-like actions is the<br />

main objective of this research. Moreover, the goal is to create a solution such that the<br />

developed techniques are embedded in the control system of an actual robot arm.<br />

Our approach is to measure and model the human behaviour, without restricting the motion of<br />

the human. The eventual aim of the project is to substitute the human subject (e.g., an<br />

operator at a machine) with the robot arm. The platform for this project incorporates a<br />

"shapetape" sensor for human motion capture, which measures bend and twist at 16 sensor<br />

locations along the human arm, and a lightweight robot arm PANDI-1 developed in-house<br />

within the Intelligent Control Laboratory at AASS. Future work will investigate other sensors<br />

mounted on the robot arm to enable autonomous operation.<br />

Partners:<br />

Parma University, Italy (previous Marie Curie student, Jacopo Aleotti).<br />

Siemens AG, Munich, Germany. (Dr. Rainer Palm).<br />

Results in <strong>2004</strong>:<br />

Paper presented at International Conf. on Manipulation and Grasping (IMG’04), Genoa, Italy,<br />

July 1-2, <strong>2004</strong> (with Parma University). Initial experiments in reinforcement learning and<br />

development of a demonstration system based on a human arm model.<br />

Future developments:<br />

Integration of human arm demonstration system within the framework of supervised<br />

reinforcement learning, as a general methodology for teaching by showing. Specific<br />

experimental work on robotic manipulators. More substantial results and further publications<br />

are needed.


Annual Report <strong>2004</strong> 75<br />

Project: Object recognition by autonomous robots, J457<br />

Project leader: Tom Duckett<br />

Staff: Henrik Andreasson<br />

Funding: KK-foundation, Faculty and regional funding.<br />

Synopsis:<br />

The project belongs to the research direction Perception Systems. Object recognition has been<br />

a topic of interest for researchers in computer vision, artificial intelligence, the cognitive<br />

sciences and robotics. Without this ability, the possibilities for robots to carry out useful tasks<br />

remains limited. The object recognition systems that exist today are usually solved on a<br />

system-by-system basis, using recognition techniques that are hand-crafted for a small class<br />

of objects in one particular application.<br />

This project tries to find a more general way of doing object recognition without requiring<br />

pre-installed specifications or models of the object to be recognised. The main approach<br />

investigated in current work is using the motion of a robot to acquire an internal<br />

representation of a given object using structure from motion or optic flow. The main sensor<br />

used for current experiments is an Omni-directional camera.<br />

Partners:<br />

Autonomous Intelligent Systems Group, Freiburg University, Germany (Prof. Wolfram<br />

Burgard).<br />

University of Tuebingen, Computer Science Dept., Germany. (Prof. Andreas Zell).<br />

Results in <strong>2004</strong>:<br />

Paper on place recognition using local features presented at Symposium on Intelligent<br />

Autonomous, Portugal, July 5-7, <strong>2004</strong>, and extension of this work to the global localisation<br />

problem with Particle Filters accepted for ICRA’05, Barcelona, April 18-22 (with Tuebingen<br />

Univ.). A major development was the visit of Henrik Andreasson to Freiburg University as a<br />

Marie Curie fellow. This resulted in a new approach for fusing 3D-laser and colour<br />

information for environment modelling.<br />

Future developments:<br />

Fusion of 3D range-finder data and colour information for object recognition by mobile<br />

robots, focussing on this topic for the Ph.D. Thesis, and eventual defence around 2007.


76 AASS – Center for Applied Autonomous Sensor Systems<br />

Project: Semi-autonomous mapping by UAV-UGV cooperation, J417<br />

Project leader: Tom Duckett<br />

Staff: Martin Persson<br />

Funding: KK-foundation, AerotechTelub AB and Faculty.<br />

Synopsis:<br />

This project belongs to the research direction Navigation Systems. Mapping an outdoor<br />

environment implies new challenges for mobile robots. This project investigates the use of<br />

Semi-autonomous mapping, SAM, in this context. The basic idea is to use some a priori<br />

information in the form of a sketch map to assist the mapping process. The sensor<br />

measurements of the robot are used to add information to the map and to correct the sketch<br />

map where it is wrong. The sketch map may contain information extracted from an aerial<br />

image, hand-drawn map, geographic information system, etc. It may have low resolution,<br />

incorrect scale, and contain errors.<br />

The platform for this research is an integrated robotic system comprising an unmanned aerial<br />

vehicle, UAV, and its commands to an unmanned ground vehicle, UGV. The UAV is<br />

simulated in a simulation environment for aerial visual servoing (SEAVS) that uses<br />

orthographic satellite and aerial images. These are draped on an elevation grid giving realistic<br />

3D images from a nadir view. The UGV is a real ATRV-Jr mobile robot equipped with an<br />

array of positioning, vision and range finder sensors for autonomous outdoor navigation.<br />

Applications of this technology would include terrain and urban mapping, search and rescue<br />

operations, and planetary exploration.<br />

Partners:<br />

Aerotech Telub, AB.<br />

Results in <strong>2004</strong>:<br />

Research project on extraction of man-made structures from aerial images, paper submitted to<br />

forthcoming CIRA’05 workshop in Finland.<br />

Future developments:<br />

Investigate detection of the same structures by an outdoors-mobile robot using on-board<br />

sensors, extraction of relevant features from a hand-drawn sketch, and data fusion in a single<br />

map representation. More substantial results and further publications are needed.


Annual Report <strong>2004</strong> 77<br />

Project: Learning Optimal Control, J456<br />

Project leader: Tom Duckett<br />

Staff: none.<br />

Funding: Faculty<br />

Synopsis:<br />

This project documents the work carried out by Assoc. Prof. Tomas Martinez of Alicante<br />

University, Spain, on his research visits to AASS in 2003 and <strong>2004</strong>. The work concerns a<br />

visual servoing approach for a mobile manipulation task, in which the Peoplebot mobile robot<br />

has to move towards an object located on a table (docking) and then pick up that object with<br />

its gripper (grasping). The approach belongs to the family of techniques known as imagebased<br />

visual servoing. A novel reinforcement learning algorithm incorporating planning is<br />

used to learn a time-optimal control policy.<br />

Partners:<br />

University of Alicante, Spain (Assoc. Prof. Tomas Martinez).<br />

Results in <strong>2004</strong>:<br />

Paper published in proceedings of IEEE Int. Conf. Robotics, Automation and Mechatronics<br />

(RAM’04), Singapore, December 1-3, <strong>2004</strong>. Paper accepted for IEEE Int. Conf. Robotics and<br />

Automation (ICRA’05), Spain, April 18-22, 2005.<br />

Future developments:<br />

Further experiments and submit journal article.


78 AASS – Center for Applied Autonomous Sensor Systems<br />

2.4.3 Staff<br />

Tom Duckett is a Docent (Associate Professor) at the Dept. of Technology, Örebro<br />

University and leader of the AASS Learning Systems Lab. He received the B.Sc.(Hons)<br />

degree in Computer and Management Sciences from Warwick University, U.K., in 1991.<br />

After working in industry as an Analyst/Programmer for several years, he was awarded an<br />

M.Sc. with distinction in Knowledge Based Systems by Heriot-Watt University, U.K., in<br />

1995. His M.Sc. dissertation was carried out as an ERASMUS exchange student at Karlsruhe<br />

University, Germany.<br />

Tom Duckett received his Ph.D. on concurrent map building and self-localisation for mobile<br />

robot navigation from Manchester University, U.K., in 2000, including a research visit to<br />

Bremen University, Germany, on landmark selection for mobile robot navigation. He has<br />

authored 8 journal articles and 33 full paper refereed conference papers, and is a regular<br />

reviewer for many international conferences and journals. He also has 9 years of teaching<br />

experience at university level. His research interests include mobile robotics, navigation,<br />

SLAM, machine learning, AI, learning control, robotic olfaction, and recognition systems for<br />

autonomous robots.<br />

Li Jun is a Ph.D. student at the Dept. of Technology, Örebro University in the AASS<br />

Learning Systems Lab. He received the B.S. and M.S. degree from Gui Zhou University of<br />

Technology, Gui Zhou, China, in 1982 and 1985 respectively. His current research interests<br />

include theory and application of artificial neural network learning, specifically for<br />

autonomous mobile robotic systems.<br />

Grzegorz Cielniak is a Ph.D. student at the Dept. of Technology,<br />

Örebro University in the AASS Learning Systems Lab. He was born<br />

in Krapkowice, Poland in 1975. He received his MSc degree in<br />

robotics in 2000 at the Wroclaw University of Technology, Wroclaw,<br />

Poland. Since January 2001 he has been a graduate student at AASS.<br />

His current research interests include artificial intelligence, robot<br />

learning and vision systems.<br />

Henrik Andreasson is a Ph.D. Student at the Dept. of Technology,<br />

Örebro University in the AASS Learning System Lab since October<br />

2002. He received his M.Sc. degree in Mechatronics at the Royal<br />

Institute of Technology, Stockholm, Sweden in 2001. Since October<br />

2002 he has been a graduate student at AASS. His current research<br />

interests include robotic vision and learning.<br />

Per Munkevik is a joint Ph.D. student between the AASS Learning<br />

Systems Lab at the Dept. of Technology, Örebro University, and SIK,<br />

Gothenburg since November 2002. He received the M.Sc. degree in<br />

Computer Science in 2002 at Luleå University of Technology. His<br />

current research includes pattern recognition, artificial neural<br />

networks, sensory science and learning algorithms for food quality<br />

evaluation. The objective is to perform automatic sensory evaluations<br />

of food products, especially ready meals.


Annual Report <strong>2004</strong> 79<br />

Martin Persson was born in Lund, Sweden, on June 1, 1970. He received his M.Sc. in<br />

Applied Physics and Electronic Engineering from the University of Linköping, Sweden, in<br />

1994. AerotechTelub has employed him since 1994 as a system engineer working mainly with<br />

guidance, control and simulation models for dispenser weapon systems and stand-off missiles.<br />

Since 1999 he has been an industrial PhD student with AASS at Örebro University. He<br />

received his Licentiate degree from AASS, Örebro University in 2002. His research interests<br />

include visual servoing in aerial applications and semi-autonomous mapping for mobile<br />

robots.<br />

Alexander Skoglund is a Ph.D. student at the Dept. of Technology, Örebro University<br />

between the Learning Systems and Intelligent Control Laboratories at AASS. He received the<br />

B.Sc. degree in Electrical and Electronic Engineering in 1998 and his M.Sc. degree in<br />

Electrical and Electronic Engineering in 2002, both from Örebro University. Between 2000-<br />

2001 he worked at AerotechTelub as a radio engineer, and from 2001-2003 at AASS, Dept. of<br />

Technology, Örebro University as a research engineer. Since February 2003 he has been a<br />

graduate student with research interests in robotic manipulation and learning.


80 AASS – Center for Applied Autonomous Sensor Systems<br />

3. Publications<br />

3.1 Books (incl. PhD/Lic theses) and edited volumes<br />

1. Lindquist, Malin. Electronic Tongue for Water Quality Assessment, Licentiate thesis,<br />

Örebro University Studies in Technology 15, <strong>2004</strong>.<br />

2. B. Iliev. Minimum-time Sliding Mode Control of Robot Manipulators. Doctoral<br />

Dissertation, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />

3. L. Jennergren. Flexible Assembly of Ready-to-eat Meals, Licentiate thesis, Örebro<br />

University Studies in Technology Series, <strong>2004</strong>.<br />

4. Pettersson, O. Model-Free Execution Monitoring in Behaviour-Based Mobile Robots.<br />

PhD thesis, Örebro University Studies in Technology Series, <strong>2004</strong>.<br />

5. S. Coradeschi and A. Saffiotti (Eds.) Proceedings of the AAAI-04 Workshop on<br />

Anchoring Symbols to Sensor Data. AAAI Press (Menlo Park, CA, <strong>2004</strong>).<br />

3.2 Chapters in edited volumes<br />

1. Loutfi, A., Lindquist M. and Wide P. Artificial Perceptual Systems, Book chapter, In<br />

Handbook of Sensor Networks, CRC Press, <strong>2004</strong><br />

3.3 Journals<br />

1. R. Palm. Synchronization of Decentralized Multiple-Model Systems by Market-Based<br />

Optimization. IEEE Trans. SMC B, Vol. 34, No 1 Feb. <strong>2004</strong>, pp. 665-672<br />

2. G. Cielniak and Tom Duckett. People Recognition by Mobile Robots. Journal of<br />

Intelligent and Fuzzy Systems, Vol. 15, No. 1, pp. 21-27, <strong>2004</strong><br />

3. Achim Lilienthal and Tom Duckett, Experimental Analysis of Gas-Sensitive Braitenburg<br />

Vehicles. RSJ Journal of Advanced Robotics, Vol. 18, No. 8, pp. 817-834, <strong>2004</strong>.<br />

4. Achim Lilienthal and Tom Duckett, Building Gas Concentration Gridmaps with a Mobile<br />

Robot. Robotics and Autonomous Systems, Vol. 48, No. 1, pp. 3-16, <strong>2004</strong>.<br />

5. E. Pagello, E. Menegatti, A. Bredenfel, P. Costa, T. Christaller, A. Jacoff, D. Polani, M.<br />

Riedmiller, A. Saffiotti, E. Sklar, T. Tomoichi. RoboCup-2003: New Scientific and<br />

Technical Advances. AI Magazine 25(2):81-98, <strong>2004</strong><br />

6. B. Kadmiry, Pr. D. Driankov: Fuzzy Gain Scheduler for Attitude Control of an<br />

Unmanned Helicopter (*) (Special issue) on IEEE Transactions on Fuzzy Systems<br />

Journal (TFS), ISSN: 0163-6706, Vol.12 /4, pp. 502-515, August <strong>2004</strong>


Annual Report <strong>2004</strong> 81<br />

3.4 Conference papers<br />

1. M. Lindquist, P. Wide, New Sensor System for Drinking Water Quality. In Sensors for<br />

Industry Conference, New Orleans, USA, Feb <strong>2004</strong>.<br />

2. B. Iliev, I. Kalaykov. Minimum-time sliding mode control for second-order systems.<br />

In Proc. American Control Conference, ACC'04, June 30-July 3, <strong>2004</strong>, Boston, USA.<br />

3. I. Hristozov, B. Iliev and S. Eskiizmirler. A combined feature extraction method for an<br />

electronic nose, In Proc. of Information Processing and Management of Uncertainty<br />

IPMU’ 04, Perugia, Italy, July <strong>2004</strong>.<br />

4. L. Robertsson and P. Wide. Analysis bacteriological growth using wavelet transform. In<br />

Proceedings IMTC’04, Como, Italy <strong>2004</strong><br />

5. I. Hristozov, B. Iliev and S. Eskiizmirler. A combined feature extraction method for an<br />

electronic nose, In Proc. of Information Processing and Management of Uncertainty<br />

IPMU’ 04, Perugia, Italy, July <strong>2004</strong>.<br />

6. Tolt, G. A Fuzzy Approach for Detecting Multi-junctions in Edgeness Images. Proc. of<br />

IASTED Conf. on Visualization, Imaging and Image Processing, pages 420-424,<br />

Marbella, Spain, <strong>2004</strong>.<br />

7. J. L. Granter, R. Gottipati, G. A Fodor, Fuzzy Logic Enabled Software Agents for<br />

Supervisory Control. Proc. of the FUZZ-IEEE Conference, Budapest, 27-29 July <strong>2004</strong>.<br />

8. T. Martínez-Marín and T. Duckett, Reinforcement Learning in a Visual Servoing<br />

Framework. Proc. IEEE Int. Conference on Robotics, Automation and Mechatronics<br />

(RAM'04), Singapore, December 1-3, <strong>2004</strong>.<br />

9. Peter Biber, Henrik Andreasson, Tom Duckett and Andreas Schilling. 3D Modelling of<br />

Indoor Environments by a Mobile Robot with a Laser Scanner and Panoramic Camera.<br />

Proc. IEEE/RSJ Int. Conference on Intelligent Robots and Systems (IROS <strong>2004</strong>), Sendai,<br />

Japan, September 28 - October 2, <strong>2004</strong>.<br />

10. Jacopo Aleotti, Alexander Skoglund and Tom Duckett. Teaching Position Control of a<br />

Robot Arm by Demonstration with a Wearable Input Device. Proc. IMG04, International<br />

Conference on Intelligent Manipulation and Grasping, Genoa, Italy, July 1-2, <strong>2004</strong>.<br />

11. Per Munkevik, Tom Duckett and Gunnar Hall. Vision System Learning for Ready Meal<br />

Characterisation Proc. International Conference on Engineering and Food (ICEF9),<br />

Montpellier, France, March 7-11, <strong>2004</strong>.<br />

12. Grzegorz Cielniak and Tom Duckett. People Recognition by Mobile Robots. Proc. AILS-<br />

<strong>2004</strong>, 2nd Joint SAIS/SSLS Workshop Lund, Sweden, April 15-16, <strong>2004</strong>.


82 AASS – Center for Applied Autonomous Sensor Systems<br />

13. Tom Duckett, Grzegorz Cielniak, Henrik Andreasson, Li Jun, Achim Lilienthal and Peter<br />

Biber. An Electronic Watchman for Safety, Security and Rescue Operations (abstract).<br />

Proc. SIMSafe <strong>2004</strong>, Improving Public Safety through Modelling and Simulation,<br />

Karlskoga, Sweden, June 15-17, <strong>2004</strong>.<br />

14. P. Buschka and A. Saffiotti. Some Notes on the Use of Hybrid Maps for Mobile Robots.<br />

Proc. of the 8th Int. Conf. on Intelligent Autonomous Systems (IAS) pp. 547-556.<br />

Amsterdam, NL, <strong>2004</strong>.<br />

15. M. Broxvall, L. Karlsson and A. Saffiotti. Steps Towards Detecting and Recovering from<br />

Perceptual Failures. Proc. of the 8th Int. Conf on Intelligent Autonomous Systems (IAS)<br />

pp. 793-800. Amsterdam, NL, <strong>2004</strong>.<br />

16. A. Loutfi and S. Coradeschi. Forming Odour Categories Using an Electronic Nose. Proc.<br />

of the European Conf. on Artificial Intelligence (ECAI) 119-124. Valencia, Spain, <strong>2004</strong>.<br />

17. R. Lundh, L. Karlsson and A. Saffiotti. Dynamic Configuration of a Team of Robots.<br />

Proc. of the ECAI-04 Workshop on Agents in Dynamic and Real-Time Environments.<br />

Valencia, Spain, <strong>2004</strong>.<br />

18. A. Loutfi, S. Coradeschi, L. Karlsson and M. Broxvall. Putting Olfaction into Action:<br />

Using an Electronic Nose on an Multi-Sensing Mobile Robot Proc. of the IEEE/RSJ Int.<br />

Conf. on Intelligent Robots and Systems (IROS). Sendai, Japan, <strong>2004</strong>.<br />

19. Janos L. Grantner, R. Gottipati, G.A. Fodor, Intelligent Fuzzy Controllers Laboratory,<br />

Proceedings of the <strong>2004</strong> ASEE Annual Conference.<br />

20. G. A. Fodor, The Case for Hierarchy-Mobile Agents in Industrial Informatics. Keynote<br />

talk. Proc. of the second IEEE International Conference on Industrial Informatics,<br />

INDIN'04, 24-26 June, Berlin, Germany, <strong>2004</strong>.<br />

21. G. A. Fodor, Formal and Architectural Competitive Factors in Industrial Informatics,<br />

Proc. of the second IEEE International Conference on Industrial Informatics, INDIN'04,<br />

24-26 June, Berlin, Germany, <strong>2004</strong>.<br />

22. L. Jennergren, I. Kalaykov, L. Ahrne. Requirements for assembly of ready-to-eat meals.<br />

Proc. of ICEF9 International Conference on Engineering and Food, Montpellier, France,<br />

7-11 March, <strong>2004</strong>.<br />

23. L. Jennergren, Optimizing the flexible assembly of ready-to-eat meals. Proc. of<br />

International Conference on Intelligent Manipulation and Grasping, Genoa, Italy, 1-2<br />

July, <strong>2004</strong>.<br />

24. L. Jennergren, I. Kalaykov. Human-free flexible assembly of ready-to-eat meals using<br />

visual feedback. Proc. of Food Factory <strong>2004</strong> Conference, France, 6-8 October, <strong>2004</strong>.


Annual Report <strong>2004</strong> 83<br />

25. A. Ananiev, I. Kalaykov, E. Petrov, B. Hadjiyski. Single-motor driven construction of<br />

hyper-redundant robot. Proc. of International Conference on Mechatronics and Robotics<br />

’04, Aachen, Germany, 13-15 September, <strong>2004</strong>, vol. 2, p. 543-547.<br />

3.5 Workshop and Symposium papers<br />

26. R. Palm. Multi-Step-Ahead Prediction in Control Systems using Gaussian Processes and<br />

TS-Fuzzy Models. In Proceedings 14th Workshop Fuzzy Systeme und Computational<br />

Intelligence. Schriftenreihe d. Inst. f. Angew. Informatik/ Automatisierungstechnik Univ.<br />

Karlsruhe (TH) Band 6, <strong>2004</strong>, Universitätsverlag Karlsruhe, pp. 42-54.<br />

27. Henrik Andreasson and Tom Duckett. Topological Localization for Mobile Robots using<br />

Omni-directional Vision and Local Features. Proc. IAV<strong>2004</strong>, The 5th Symposium on<br />

Intelligent Autonomous Vehicles, Lisbon, Portugal, July 5-7, <strong>2004</strong>.<br />

28. Tom Duckett, Grzegorz Cielniak, Henrik Andreasson, Li Jun, Achim Lilienthal, Peter<br />

Biber and Tomás Martínez. Robotic Security Guard - Autonomous Surveillance and<br />

Remote Perception (abstract). Proc. IEEE International Workshop on Safety, Security,<br />

and Rescue Robotics, Bonn, Germany, May 24-26, <strong>2004</strong>.<br />

29. Dimiter Driankov, Tom Duckett and Alessandro Saffiotti. A System for Vision Based<br />

Human-Robot Interaction (short paper). Proc. IEEE International Workshop on Safety,<br />

Security, and Rescue Robotics, Bonn, Germany, May 24-26, <strong>2004</strong>.<br />

30. D. Herrero Pérez, H. Martínez Barberá and A. Saffiotti. Fuzzy Self-Localization using<br />

Natural Features on an AIBO Robot. Proc. of the Int. RoboCup Symposium. Lisbon,<br />

Portugal, <strong>2004</strong>.<br />

31. J.P Cánovas, K. LeBlanc and A. Saffiotti. Multi-Robot Object Localization by Fuzzy<br />

Logic. Proc. of the Int. RoboCup Symposium. Lisbon, Portugal, <strong>2004</strong>.<br />

32. A. Chella, S. Coradeschi, M. Frixione and A. Saffiotti. Perceptual Anchoring via<br />

Conceptual Spaces. Proc. of the AAAI-04 Workhsop on Anchoring. San Jose, CA, <strong>2004</strong>.<br />

33. R. Lundh, L. Karlsson and A. Saffiotti. Dynamic Configuration of a Team of Robots.<br />

Proc. of the ECAI-04 Workshop on Agents in Dynamic and Real-Time Environments.<br />

Valencia, Spain, <strong>2004</strong>.<br />

34. K. Bergstrand, K. Carlsson, P. Wide, B. Lindgren. Sound Detection in Noisy<br />

Environment – Location Drilling Sound by using an Artificial Ear. Proceedings of the<br />

<strong>2004</strong> International workshop on Robot Sensing. ROSE’<strong>2004</strong>. Graz, Austria, <strong>2004</strong>.<br />

35. M. Broxvall, S. Coradeschi, L. Karlsson and A. Saffiotti. Have Another Look: On<br />

failures and recovery planning in perceptual anchoring. Proc. Of the ECAI-04 Workshop<br />

on Cognitive Robotics. Valencia, Spain, <strong>2004</strong>.<br />

36. A. Bouguerra and L. Karlsson. Hierarchical Task Planning under Uncertainty. Proc. Of<br />

the 3 rd Italian Workshop on Planning and Scheduling. Perugia, Italy, <strong>2004</strong>.


84 AASS – Center for Applied Autonomous Sensor Systems<br />

37. Lucia Vacariu, B. P. Csaba, I. A. Letia, G. A. Fodor, O. Cret, A Multi-Agent Cooperative<br />

Mobile Robotics Approach for Search and Rescue Missions, IFAC Symposium on<br />

Intelligent Autonomous Vehicles, 5-7 July, Lisbon, Portugal, <strong>2004</strong>.<br />

38. G. Fodor, Information-Effective Industrial Architectures, Workshop paper, Proc of the<br />

IECON <strong>2004</strong> Conference (The 30-th Annual Conference of the IEEE Industrial<br />

Electronics Society), Nov. 2-6, <strong>2004</strong>, Busan, Korea.

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!