Opendata, web and dolomites
MuMMER SIGNED
MultiModal Mall Entertainment Robot
Total Cost €
0EC-Contrib. €
0Partnership
0Views
0MuMMER project word cloud
Explore the words cloud of the MuMMER project. It provides you a very rough idea of what is the project "MuMMER" about.
stakeholders
robotics
evaluation
socially
verbal
positively
collecting
managers
influence
area
customers
crucially
combining
scene
retailers
markets
behaviours
robots
navigation
games
mummer
communication
engage
autonomously
public
collaborative
guidance
entertaining
advancing
acceptance
human
signal
business
multimodal
playing
entertainment
engaging
integrate
feedback
action
speech
later
aldebaran
visits
social
customer
aid
humanoid
platform
dynamic
scenario
shopping
initially
4th
mall
interaction
robot
naturally
interact
exhibit
explicitly
pepper
technologies
service
employment
audiovisual
environments
jokes
finland
appropriate
telling
co
market
truly
Project "MuMMER" data sheet
The following table provides information about the project.
| Coordinator |
UNIVERSITY OF GLASGOW
Organization address contact info |
| Coordinator Country | United Kingdom [UK] |
| Project website | http://mummer-project.eu/ |
| Total cost | 5˙345˙137 € |
| EC max contribution | 4˙297˙835 € (80%) |
| Programme |
1. H2020-EU.2.1.1. (INDUSTRIAL LEADERSHIP - Leadership in enabling and industrial technologies - Information and Communication Technologies (ICT)) |
| Code Call | H2020-ICT-2015 |
| Funding Scheme | RIA |
| Starting year | 2016 |
| Duration (year-month-day) | from 2016-03-01 to 2020-02-29 |
Partnership
Take a look of project's partnership.
| # | ||||
|---|---|---|---|---|
| 1 | UNIVERSITY OF GLASGOW | UK (GLASGOW) | coordinator | 815˙178.00 |
| 2 | SOFTBANK ROBOTICS EUROPE | FR (PARIS) | participant | 958˙750.00 |
| 3 | HERIOT-WATT UNIVERSITY | UK (EDINBURGH) | participant | 904˙287.00 |
| 4 | CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS | FR (PARIS) | participant | 851˙771.00 |
| 5 | Teknologian tutkimuskeskus VTT Oy | FI (Espoo) | participant | 600˙347.00 |
| 6 | KIINTEISTO OY IDEAPARK AB | FI (LEMPÄÄLÄ) | participant | 167˙500.00 |
| 7 | FONDATION DE L'INSTITUT DE RECHERCHE IDIAP | CH (MARTIGNY) | participant | 0.00 |
Map
Project objective
'In MuMMER ('MultiModal Mall Entertainment Robot'), we propose to address the important and growing market of consumer entertainment robotics by advancing the technologies needed to support this area of robotics, and also by explicitly addressing issues of consumer acceptance, thus creating new European business and employment opportunities in consumer robotics. Specifically, we will develop a humanoid robot (based on Aldebaran's Pepper platform) able to engage and interact autonomously and naturally in the dynamic environments of a public shopping mall, providing an engaging and entertaining experience to the general public. Using co-design methods, we will work together with stakeholders including customers, retailers, and business managers, to develop truly engaging robot behaviours, including telling jokes or playing games, as well as providing guidance, information, and collecting customer feedback. Crucially, our robot will exhibit behaviour that is socially appropriate, combining speech-based interaction with non-verbal communication and human-aware navigation. To support this behaviour, we will develop and integrate new methods from audiovisual scene processing, social-signal processing, high-level action selection, and human-aware robot navigation.
Throughout the project, the robot will be deployed in a large public shopping mall in Finland: initially for short visits to aid in collaborative scenario development, co-design, and system evaluation, and later for a long-term field study in the 4th year of the project. Through our co-design approach, we will both study and foster acceptance of consumer robots and thus positively influence the consumer markets of service robots. '
Deliverables
| Project website and social media dissemination | Websites, patent fillings, videos etc. | 2019-05-22 22:13:57 |
| Social state processing components (initial) | Other | 2019-05-22 22:13:58 |
| Co-design of use scenarios and user requirements | Documents, reports | 2019-05-22 22:13:57 |
| Socially engaging interaction management component (initial) | Other | 2019-05-22 22:13:57 |
| Development of technical infrastructure | Other | 2019-05-22 22:13:58 |
| Audio-visual algorithms for person tracking and characterization (baseline) | Other | 2019-05-22 22:13:58 |
| Initial data management plan | Open Research Data Pilot | 2019-05-22 22:13:58 |
| Initial components of Human-aware motion planner | Other | 2019-05-22 22:13:58 |
| Social state processing components (upgrade) | Other | 2019-05-22 22:13:56 |
| Audio-visual algorithms for person tracking and characterization (upgrade) | Other | 2019-05-22 22:13:57 |
| Socially engaging interaction management component (upgrade) | Other | 2019-05-22 22:13:57 |
| Initial WP5 software ready for integration on real robot | Other | 2019-05-22 22:13:56 |
| Initial integrated robot system | Demonstrators, pilots, prototypes | 2019-05-22 22:13:56 |
Take a look to the deliverables list in detail: detailed list of MuMMER deliverables.
Publications
| year | authors and title | journal | last update |
|---|---|---|---|
| 2016 |
Mary Ellen Foster Public-space human-robot interaction in the MuMMER project published pages: , ISSN: , DOI: |
The 3rd Workshop on Public Space Human-Robot Interaction (PubRob 2016), at RO-MAN 2016, New York, NY, August 2016 | 2019-06-18 |
| 2016 |
Mary Ellen Foster, Rachid Alami, Olli Gestranius, Oliver Lemon, Marketta Niemelä, Jean-Marc Odobez, Amit Kumar Pandey The MuMMER project: Engaging human-robot interaction in real-world public spaces published pages: 753-763, ISSN: , DOI: 10.1007/978-3-319-47437-3_74 |
8th International Conference on Social Robotics, ICSR 2016, Kansas City, MO, USA, November 2016 | 2019-06-18 |
| 2016 |
Harmish Khambhaita, Jorge Rios-Martinez, and Rachid Alami Head-Body Motion Coordination for Human Aware Robot Navigation published pages: , ISSN: , DOI: |
9th International Workshop on Human Friendly Robotics, 29. & 30. September 2016, Genoa, Italy | 2019-06-18 |
| 2017 |
Mary Ellen Foster, Ronald P. A. Petrick Separating Representation, Reasoning, and Implementation for Interaction Management: Lessons from Automated Planning published pages: 93-107, ISSN: , DOI: 10.1007/978-981-10-2585-3_7 |
Dialogues with Social Robots: Enablements, Analyses, and Evaluation | 2019-06-18 |
| 2016 |
Jules Waldhart and Mamoun Gharbi and Rachid Alami A Novel Software Combining Task and Motion Planning for Human-Robot Interaction published pages: , ISSN: , DOI: |
AI-HRI 2016, AAAI Fall Symposium Series November 17-19, Arlington, VA, USA | 2019-06-18 |
| 2017 |
Y. Yu, K. Funes, and J.-M. Odobez Robust and Accurate 3D Head Pose Estimation through 3DMM and Online Head Model Reconstruction published pages: , ISSN: , DOI: |
12th IEEE Conference on Automatic Face and Gesture Recognition | 2019-06-18 |
| 2016 |
Petrick, Ronald P. A.; Foster, Mary Ellen Using General-Purpose Planning for Action Selection in Human-Robot Interaction published pages: , ISSN: , DOI: |
AAAI Fall Symposium on Artificial Intelligence for Human-Robot Interaction (AI-HRI 2016) 1 | 2019-06-18 |
| 2016 |
Yanchao Yu, Arash Eshghi, and Oliver Lemon Training an adaptive dialogue policy for interactive learning of visually grounded word meaning published pages: 339-349, ISSN: , DOI: |
Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue | 2019-06-18 |
| 2018 |
Devin, S. and Vrignaud, C. and Belhassein, K. and Clodic, A. and Carreras, O. and Alami, R. Evaluating the Pertinence of Robot Decisions in a Human-Robot Joint Action Context: The PeRDITA Questionnaire published pages: , ISSN: , DOI: |
Proceedings of the 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) | 2019-05-27 |
| 2018 |
Yu, Yu and Liu, Gang and Odobez, Jean-Marc Deep Multitask Gaze Estimation with a Constrained Landmark-Gaze Model published pages: , ISSN: , DOI: |
European Conference on Computer Vision Workshop | 2019-05-27 |
| 2018 |
Yu Yu, Kenneth Alberto Funes Mora, Jean-Marc Odobez HeadFusion: 360 Head Pose Tracking Combining 3D Morphable Model and 3D Reconstruction published pages: 2653-2667, ISSN: 0162-8828, DOI: 10.1109/TPAMI.2018.2841403 |
IEEE Transactions on Pattern Analysis and Machine Intelligence 40/11 | 2019-05-27 |
| 2018 |
Bart Craenen and Amol Deshmukh and Mary Ellen Foster and Alessandro Vinciarelli Shaping Gestures to Shape Personalities: The Relationship Between Gesture Parameters, Attributed Personality Traits and Godspeed Scores published pages: , ISSN: , DOI: |
Proceedings of the 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) | 2019-05-29 |
| 2018 |
Nam Le, Jean-Marc Odobez Robust and Discriminative Speaker Embedding via Intra-Class Distance Variance Regularization published pages: 2257-2261, ISSN: , DOI: 10.21437/Interspeech.2018-1685 |
Interspeech 2018 | 2019-05-29 |
| 2018 |
Bart Craenen and Amol Deshmukh and Mary Ellen Foster and Alessandro Vinciarelli Do We Really Like Robots that Match our Personality? The Case of Big-Five Traits, Godspeed Scores and Robotic Gestures published pages: , ISSN: , DOI: |
Proceedings of IEEE RO-MAN 2018 | 2019-05-29 |
| 2018 |
Bart Craenen and Amol Deshmukh and Mary Ellen Foster and Alessandro Vinciarelli Shaping Gestures to Shape Personality: Big-Five Traits, Godspeed Scores and the Similarity-Attraction Effect published pages: , ISSN: , DOI: |
Proceedings of the 17th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2018) | 2019-05-29 |
| 2018 |
Ioannis Papaioannou, Christian Dondrup, Oliver Lemon Human-Robot Interaction Requires More Than Slot Filling - Multi-Threaded Dialogue for Collaborative Tasks and Social Conversation published pages: 61-64, ISSN: , DOI: 10.21437/ai-mhri.2018-15 |
FAIM/ISCA Workshop on Artificial Intelligence for Multimodal Human Robot Interaction | 2019-05-29 |
| 2018 |
Fraser, Jamie and Papaioannou, Ioannis and Lemon, Oliver Spoken Conversational AI in Video Games-Emotional Dialogue Management Increases User Engagement published pages: , ISSN: , DOI: 10.1145/3267851.3267896 |
Proceedings of International Conference on Intelligent VirtualAgents (IVA \'18), | 2019-05-29 |
| 2018 |
Heikkila, Paivi and Lammi, Hanna and Belhassein, Kathleen Where Can I Find a Pharmacy? - Human-Driven Design of a Service Robot\'s Guidance Behaviour published pages: , ISSN: , DOI: |
Proceedings of the Fourth Workshop on Public-Space Human-Robot Interaction (PubRob 2018) | 2019-05-29 |
| 2017 |
Khambhaita, Harmish and Alami, Rachid Viewing Robot Navigation in Human Environment as a Cooperative Activity published pages: , ISSN: , DOI: |
International Symposium on Robotics Research (ISSR 2017) | 2019-05-29 |
| 2018 |
Andrea Vanzo, Jose L. Part, Yanchao Yu, Daniele Nardi, and Oliver Lemon Incrementally Learning Semantic Attributes through Dialogue Interaction published pages: 865-873, ISSN: , DOI: |
Proceedings of the 17th International Conference on Autonomous Agents and MultiAgent Systems (AAMAS \'18) | 2019-05-29 |
| 2018 |
Yuanzhouhan Cao and Olivier Canevet and Jean-Marc Odobez Leveraging Convolutional Pose Machines for Fast and Accurate Head Pose Estimation published pages: , ISSN: , DOI: |
IEEE/RSJ International Conference on Intelligent Robots and Systems | 2019-05-29 |
| 2018 |
Severin Lemaignan and Yoan Sallami and Christopher Wallbridge and Aurelie Clodic and Tony Belpaeme and Rachid Alami Underworlds: Cascading situation assessment for robots published pages: , ISSN: , DOI: |
Proceedings of IROS 2018 | 2019-05-29 |
| 2018 |
Martinez-Gonzalez, Angel and Villamizar, Michael and Canevet, Olivier and Odobez, Jean-Marc Investigating Depth Domain Adaptation for Efficient Human Pose Estimation published pages: , ISSN: , DOI: |
2018 European Conference on Computer Vision - Workshops, {ECCVW} 2018 | 2019-05-29 |
| 2017 |
R. Siegfried and J.-M. Odobez Supervised Gaze Bias Correction for Gaze Coding in Interactions published pages: , ISSN: , DOI: |
Proceedings of the Communication by Gaze Interaction symposium (COGAIN) | 2019-05-29 |
| 2018 |
Jules Waldhart and Aurelie Clodic and Rachid Alami Planning Human and Robot Placements for Shared Visual Perspective, the SVP Planner published pages: , ISSN: , DOI: |
Proceedings of IROS workshop Robotic Co-workers 4.0 | 2019-05-29 |
| 2018 |
Amit Kumar Pandey, Rodolphe Gelin A Mass-Produced Sociable Humanoid Robot: Pepper: The First Machine of Its Kind published pages: 40-48, ISSN: 1070-9932, DOI: 10.1109/MRA.2018.2833157 |
IEEE Robotics & Automation Magazine 25/3 | 2019-05-29 |
| 2018 |
Dondrup, Christian and Baillie, Lynne and Broz, Frank and Lohan, Katrin How can we transition from lab to the real world with our HCI and HRI setups? published pages: , ISSN: , DOI: |
Proceedings of the Fourth Workshop on Public-Space Human-Robot Interaction (PubRob 2018) | 2019-05-29 |
| 2017 |
Belhassein, Kathleen and Clodic, Aurelie and Cochet, Helene and Niemela, Marketta and Heikkila, Paivi and Lammi, Hanna and Tammela, Antti Human-Human Guidance Study published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2017 |
Papaioannou, Ioannis and Curry, Amanda Cercas and Part, Jose L and Shalyminov, Igor and Xu, Xinnuo and Yu, Yanchao and Du{v{s}}ek, Ondrej and Rieser, Verena and Lemon, Oliver Alana: Social dialogue using an ensemble model and a ranker trained on user feedback published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2018 |
Liu, Gang and Yu, Yu and Funes Mora, Kenneth Alberto and Odobez, Jean-Marc A Differential Approach for Gaze Estimation with Calibration published pages: , ISSN: , DOI: |
29TH BRITISH MACHINE VISION CONFERENCE (BMVC) | 2019-05-29 |
| 2017 |
Marketta Niemelä, Päivi Heikkilä, Hanna Lammi, Virpi Oksman Shopping Mall Robots -- Opportunities and Constraints from the Retailer and Manager Perspective published pages: 485-494, ISSN: , DOI: 10.1007/978-3-319-70022-9_48 |
Social Robotics | 2019-05-29 |
| 2018 |
Weipeng He, Petr Motlicek, Jean-Marc Odobez Joint Localization and Classification of Multiple Sound Sources Using a Multi-task Neural Network published pages: 312-316, ISSN: , DOI: 10.21437/Interspeech.2018-1269 |
Interspeech 2018 | 2019-05-29 |
| 2017 |
Katrin Solveig Lohan, Hagen Lehmann, Christian Dondrup, Frank Broz, Hatice Kose Enriching the Human-Robot Interaction Loop with Natural, Semantic, and Symbolic Gestures published pages: 1-21, ISSN: , DOI: 10.1007/978-94-007-7194-9_136-1 |
Humanoid Robotics: A Reference | 2019-05-29 |
| 2018 |
Martinez-Gonzalez, Angel and Villamizar, Michael and Canevet, Olivier and Odobez, Jean-Marc Real-time Convolutional Networks for Depth-based Human Pose Estimation published pages: , ISSN: , DOI: |
2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2018 | 2019-05-29 |
| 2018 |
Mary Ellen Foster Natural Language Generation for Public-Space Social Robots published pages: , ISSN: , DOI: |
Proceedings of the 4th Workshop on Public Space Human-Robot Interaction (PubRob 2018) | 2019-05-29 |
| 2018 |
Amol Deshmukh and Bart Craenen and Mary Ellen Foster and Alessandro Vinciarelli The More I Understand it, the Less I Like it: The Relationship Between Understandability and Godspeed Scores for Robotic Gestures published pages: , ISSN: , DOI: |
Proceedings of the 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) | 2019-05-29 |
Are you the coordinator (or a participant) of this project? Plaese send me more information about the "MUMMER" project.
For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.
Send me an email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.
Thanks. And then put a link of this page into your project's website.
The information about "MUMMER" are provided by the European Opendata Portal: CORDIS opendata.