POETICON++
Robots need Language: A computational mechanism for generalisation and generation of new behaviours in robots
| Coordinatore | FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA
Organization address
address: VIA MOREGO 30 contact info |
| Nazionalità Coordinatore | Italy [IT] |
| Totale costo | 5˙120˙798 € |
| EC contributo | 3˙880˙000 € |
| Programma | FP7-ICT
Specific Programme "Cooperation": Information and communication technologies |
| Code Call | FP7-ICT-2011-7 |
| Funding Scheme | CP |
| Anno di inizio | 2012 |
| Periodo (anno-mese-giorno) | 2012-01-01 - 2015-12-31 |
Partecipanti
| # | ||||
|---|---|---|---|---|
| 1 |
FONDAZIONE ISTITUTO ITALIANO DI TECNOLOGIA
Organization address
address: VIA MOREGO 30 contact info |
IT (GENOVA) | coordinator | 0.00 |
| 2 |
ATHENA RESEARCH AND INNOVATION CENTER IN INFORMATION COMMUNICATION & KNOWLEDGE TECHNOLOGIES
Organization address
address: G. MPAKOU contact info |
EL (ATHINA) | participant | 0.00 |
| 3 |
COGNITIVE SYSTEMS RESEARCH INSTITUTE
Organization address
address: MAK PRANTOUNA contact info |
EL (ATHINA) | participant | 0.00 |
| 4 |
INSTITUTO SUPERIOR TECNICO
Organization address
address: Avenida Rovisco Pais contact info |
PT (LISBOA) | participant | 0.00 |
| 5 |
THE UNIVERSITY SYSTEM OF MARYLAND FOUNDATION, INC.
Organization address
address: METZEROTT ROAD 3300 contact info |
US (ADELPHI) | participant | 0.00 |
| 6 |
UNIVERSITY OF PLYMOUTH
Organization address
address: DRAKE CIRCUS contact info |
UK (PLYMOUTH) | participant | 0.00 |
Mappa
Word cloud
Esplora la "nuvola delle parole (Word Cloud) per avere un'idea di massima del progetto.
Obiettivo del progetto (Objective)
Handling novel situations beyond learned schemas or set behaviours is still a quest in engineering cognitive and embodied systems. Simply put, sensorimotor experiences in real world are non-finite and therefore powerful generalisation mechanisms are necessary for any agent to operate effectively in real-world environments.nPOETICON\ suggests that natural language can be used as a learning tool for:n(a) generalisation of learned behaviours and perceptual experiences, andn(b) generation of new behaviours and experiences (creativity).nThis is a new approach to behaviour and perception generalisation for artificial agents that capitalises on the use of a hierarchical and generative symbolic system for 'indexing' (labelling) sensorimotor experiences at different levels of abstraction. Motivated by experimental findings on a common neurological basis between language, perception and action (a common syntax), POETICON\ suggests the use of natural language for generalisation and generation of sensorimotor 'syntactic structures'.nThe main objective of POETICON\ is the development of a computational mechanism for such generalisation of motor programs and visual experiences for robots. To this end, it will integrate natural language and visual action/object recognition tools with motor skills and learning abilities, in the iCub humanoid. Tools and skills will engage in a cognitive dialogue for novel action generalisation and creativity experiments in two scenarios of 'everyday activities', comprising of (a) behaviour generation through verbal instruction, and (b) visual scene understanding.nPOETICON\ views natural language as a necessary tool for endowing artificial agents with generalisation and creativity in real world environments. Building on results from the POETICON project, it brings together an extended interdisciplinary group of experts for developing the first ever computational mechanism that will use language as a behaviour/experience generalisation tool.