#	Pagina
attuale pagina	/open-h2020/projects/194317/index.html

Opendata, web and dolomites

ARIA-VALUSPA

Artificial Retrieval of Information Assistants - Virtual Agents with Linguistic Understanding, Social skills, and Personalised Aspects

Total Cost €

EC-Contrib. €

Partnership

Views

Outcomes and
results

ARIA-VALUSPA project word cloud

Explore the words cloud of the ARIA-VALUSPA project. It provides you a very rough idea of what is the project "ARIA-VALUSPA" about.

refining essence generate humans meant whom verbal search sophisticated personality employ model breaking special web human sentence unexpected presenting book artificial com queries sustain chosen nod ground audio arias return situations creation indicating aria captured speech interaction difficult interactions retrieval something head speaking valuspa decides emotive capturing emotionally uses appropriately video synthesisers assistants signals realistic communication tripadvisor channelling time ask smile holiday created characters requested ways implementations 3d returning dialogue components modal react create questions booking travel interacting back expressive interfaces holding framework industrial perfect few social coloured virtual input agent

Project "ARIA-VALUSPA" data sheet

The following table provides information about the project.

Coordinator	THE UNIVERSITY OF NOTTINGHAM Organization address address: University Park city: NOTTINGHAM postcode: NG7 2RD website: www.nottingham.ac.uk contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.
Coordinator Country	United Kingdom [UK]
Project website	http://aria-agent.eu/
Total cost	2˙949˙318 €
EC max contribution	2˙949˙317 € (100%)
Programme	1. H2020-EU.2.1.1.4. (Content technologies and information management: ICT for digital content, cultural and creative industries)
Code Call	H2020-ICT-2014-1
Funding Scheme	RIA
Starting year	2015
Duration (year-month-day)	from 2015-01-01 to 2017-12-31

Partnership

Take a look of project's partnership.

#	participants	country	role	EC contrib. [€]
1	THE UNIVERSITY OF NOTTINGHAM THE UNIVERSITY OF NOTTINGHAM Organization address address: University Park city: NOTTINGHAM postcode: NG7 2RD website: www.nottingham.ac.uk contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.	UK (NOTTINGHAM)	coordinator	528˙895.00
2	UNIVERSITAET AUGSBURG UNIVERSITAET AUGSBURG Organization address address: UNIVERSITAETSSTRASSE 2 city: AUGSBURG postcode: 86159 website: www.uni-augsburg.de contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.	DE (AUGSBURG)	participant	472˙482.00
3	CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE CNRS Organization address address: RUE MICHEL ANGE 3 city: PARIS postcode: 75794 website: www.cnrs.fr contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.	FR (PARIS)	participant	472˙042.00
4	IMPERIAL COLLEGE OF SCIENCE TECHNOLOGY AND MEDICINE IMPERIAL COLLEGE OF SCIENCE TECHNOLOGY AND MEDICINE Organization address address: SOUTH KENSINGTON CAMPUS EXHIBITION ROAD city: LONDON postcode: SW7 2AZ website: http://www.imperial.ac.uk/ contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.	UK (LONDON)	participant	440˙715.00
5	UNIVERSITEIT TWENTE UNIVERSITEIT TWENTE Organization address address: DRIENERLOLAAN 5 city: ENSCHEDE postcode: 7522 NB website: www.utwente.nl contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.	NL (ENSCHEDE)	participant	414˙045.00
6	CEREPROC LTD CEREPROC LTD Organization address address: CODEBASE ARGYLE HOUSE 3 LADY LAWSON STREET city: EDINBURGH postcode: EH3 9DR website: n.a. contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.	UK (EDINBURGH)	participant	322˙651.00
7	LA CANTOCHE PRODUCTION SA LA CANTOCHE PRODUCTION SA Organization address address: Rue d'Hauteville 68 city: PARIS postcode: 75010 website: n.a. contact info title: n.a. name: n.a. surname: n.a. function: n.a. email: n.a. telephone: n.a. fax: n.a.	FR (PARIS)	participant	298˙486.00

Map

Project objective

The ARIA-VALUSPA project will create a ground-breaking new framework that will allow easy creation of Artificial Retrieval of Information Assistants (ARIAs) that are capable of holding multi-modal social interactions in challenging and unexpected situations. The system can generate search queries and return the information requested by interacting with humans through virtual characters. These virtual humans will be able to sustain an interaction with a user for some time, and react appropriately to the user's verbal and non-verbal behaviour when presenting the requested information and refining search results. Using audio and video signals as input, both verbal and non-verbal components of human communication are captured. Together with a rich and realistic emotive personality model, a sophisticated dialogue management system decides how to respond to a user's input, be it a spoken sentence, a head nod, or a smile. The ARIA uses special speech synthesisers to create emotionally coloured speech and a fully expressive 3D face to create the chosen response. Back-channelling, indicating that the ARIA understood what the user meant, or returning a smile are but a few of the many ways in which it can employ emotionally coloured social signals to improve communication. As part of the project, the consortium will develop two specific implementations of ARIAs for two different industrial applications. A ‘speaking book’ application will create an ARIA with a rich personality capturing the essence of a novel, whom users can ask novel-related questions. An ‘artificial travel agent’ web-based ARIA will be developed to help users find their perfect holiday – something that is difficult to do with existing web interfaces such as those created by booking.com or tripadvisor.

Deliverables

List of deliverables.
Public access to interactive ARIA-VALUSPA platform under a research license	Websites, patent fillings, videos etc.	2019-05-30 17:04:34
First integrated system with simple support for web and mobile device user interfaces	Demonstrators, pilots, prototypes	2019-03-11 11:19:51
Implementation of adaptive task-based dialogue system	Demonstrators, pilots, prototypes	2019-03-11 11:19:02
Final report on standardisation and workshops activities	Documents, reports	2019-03-11 11:19:47
Implementation of multi-lingual user- and environment-adaptive speech analysis	Demonstrators, pilots, prototypes	2019-03-11 11:19:16
Implementation of adaptive audiovisual communicative behaviour generation	Demonstrators, pilots, prototypes	2019-03-11 11:19:54
Release of the multilingual, adaptive dialogue toolbox	Demonstrators, pilots, prototypes	2019-03-11 11:19:05
Fine-tuned, multi-lingual realisation of Book-ARIA using M3 system	Demonstrators, pilots, prototypes	2019-03-11 11:19:49
Public access to interactive system data	Websites, patent fillings, videos etc.	2019-03-11 11:19:46
Second integrated system with improved real-time capabilities in distributed environments	Demonstrators, pilots, prototypes	2019-03-11 11:19:50
Final adaptive audiovisual communicative behaviour generation	Demonstrators, pilots, prototypes	2019-03-11 11:19:52
Multi-lingual realisation of Book-ARIA using M2 system	Demonstrators, pilots, prototypes	2019-03-11 11:19:27
Implementation of long-term adaptation for speech analysis	Demonstrators, pilots, prototypes	2019-03-11 11:19:17
Final integrated system with documented support for web standard technologies	Demonstrators, pilots, prototypes	2019-03-11 11:19:26
Uni-lingual realisation of Book-ARIA using M1 system	Demonstrators, pilots, prototypes	2019-03-11 11:19:35
Public access to labelled Wizard-of-Oz data	Websites, patent fillings, videos etc.	2019-03-11 11:19:43
Evaluation report	Documents, reports	2019-03-11 11:19:51
Implementation of multi-lingual task-based dialogue system for the chosen scenario	Demonstrators, pilots, prototypes	2019-03-08 17:24:14
Implementation of overall dynamic audiovisual communicative behaviour generation	Demonstrators, pilots, prototypes	2019-03-08 17:24:14
Implementation of cross-domain, context-sensitive speech analysis	Demonstrators, pilots, prototypes	2019-03-08 17:24:14
Project website, first version	Websites, patent fillings, videos etc.	2019-03-08 17:24:14
Ethical Policies	Documents, reports	2019-03-08 17:24:14
Data Management Plan	Documents, reports	2019-03-08 17:24:14

Take a look to the deliverables list in detail: detailed list of ARIA-VALUSPA deliverables.

Publications

List of publications.
year	authors and title	journal	last update
2016	B. Martinez and M.F. Valstar Advances, Challenges, and Opportunities in Automatic Facial Expression Recognition published pages: , ISSN: , DOI:	Advances in Face Detection and Facial Image Analysis	2019-05-30
2016	Escalera, S., Torres Torres, M., Martinez, B., BarÃ³, X. and Escalante, H.J., Guyon I., Tzimiropoulos, G., Corneau, C., Oliu, M., Bagheri, M.A., Valstar, M.F. ChaLearn Looking at People and Faces of the World: Face Analysis Workshop and Challenge 2016 published pages: , ISSN: , DOI:	CVPR	2019-05-30
2016	ChloÃ© Clavel, Zoraida Callejas From opinion mining to human-agent interaction published pages: , ISSN: 1949-3045, DOI:	IEEE TAC	2019-05-30
2015	Caroline Langlet, Chloe Clavel Improving social relationships in face-to-face human-agent interactions: when the agent wants to know userâ€™s likes and dislikes published pages: , ISSN: , DOI:	ACL	2019-05-30
2016	Zixing Zhang, Fabien Ringeval, Bin Dong, Eduardo Coutinho, Erik Marchi, BjÃ¶rn Schuller Enhanced semi-supervised learning for multimodal emotion recognition published pages: , ISSN: , DOI:	ICASSP	2019-05-30
2016	Yue Zhang, Felix Weninger, Zhao Ren, BjÃ¶rn Schuller Sincerity, deception in speech: Two sides of the same coin? A transfer- and multi-task learning perspective published pages: , ISSN: , DOI:	ICMI	2019-05-30
2015	Hesam Sagha, Eduardo Coutinho, BjÃ¶rn Schuller Exploring the importance of individual differences to the automatic estimation of emotions induced by music published pages: , ISSN: , DOI:	MM	2019-05-30
2015	BjÃ¶rn Schuller, Amr El-Desoky Mousa, Vryniotis Vasileios Sentiment analysis, opinion mining: on optimal parameters and performances published pages: , ISSN: 1942-4787, DOI:	Wiley Interdisciplinary Reviews: Data Mining, Knowledge Discovery	2019-05-30
2015	Johannes Wagner, Andreas Seiderer, Florian Lingenfelser, Elisabeth AndrÃ© Combining Hierarchical Classification with Frequency Weighting for the Recognition of Eating Conditions published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2016	Valstar, M.F., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres Torres, M., Scherer, S., Stratou, G., Cowie, R. and Pantic, M AVEC 2016 â€“ Depression, Mood, and Emotion Recognition Workshop and Challenge published pages: , ISSN: , DOI:	ACM Multimedia 2016	2019-05-30
2016	Yue Zhang, Eduardo Coutinho, Zixing Zhang, Caijiao Quan, BjÃ¶rn Schuller Dynamic active learning based on agreement, applied to emotion recognition in spoken interactions published pages: , ISSN: , DOI:	ICMI	2019-05-30
2016	George Trigeorgis, Mihalis A. Nicolaou, Stefanos Zafeiriou, BjÃ¶rn Schuller Deep canonical time warping published pages: , ISSN: , DOI:	CVPR	2019-05-30
2015	Fabien Ringeval, Erik Marchi, Marc Mehu, Klaus Scherer, BjÃ¶rn Schuller Face reading from speech â€“- predicting facial action units from audio cues published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2016	M. Aylett, B. Potard, G. Pullin, S. Hennig, D. Braude, M. Antunes Ferreira Don\'t Say Yes, Say Yes: Interacting with Synthetic Speech Using Tonetable published pages: , ISSN: , DOI:	CHI EA \'16	2019-05-30
2016	A. Chowanda, P. Blanchfield, M. Flintham and M.F. Valstar Computational Models of Emotion, Personality, and Social Relationships for Interactions in Games published pages: , ISSN: , DOI:	AAMAS	2019-05-30
2015	Fabien Ringeval, BjÃ¶rn Schuller, Michel Valstar, Roddy Cowie, Maja Pantic AVEC 2015 â€“ The 5th International Audio/Visual Emotion Challenge and Workshop published pages: , ISSN: , DOI:	MM	2019-05-30
2016	Amr El-Desoky Mousa, BjÃ¶rn Schuller Deep bidirectional long short-term memory recurrent neural networks for grapheme-to-phoneme conversion utilizing complex many-to many alignments published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2016	Zixing Zhang, Fabien Ringeval, Jing Han, Jun Deng, Erik Marchi, BjÃ¶rn Schuller Facing realism in spontaneous emotion recognition from speech: feature enhancement by autoencoder with LSTM neural networks published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2015	Ringeval, F., Schuller, B., Valstar, M., Jaiswal, S., Marchi, E., Lalanne, D., Cowie, R. and Pantic, M AV+ EC 2015--The First Affect Recognition Challenge Bridging Across Audio, Video, and Physiological Data published pages: , ISSN: , DOI:	AVEC	2019-05-30
2016	Angelo Cafaro, Nadine Glas, Catherine Pelachaud The Effects of Interrupting Behavior on Interpersonal Attitude and Engagement in Dyadic Interactions published pages: , ISSN: , DOI:	AAMAS	2019-05-30
2015	Marc SchrÃ¶der, Elisabetta Bevacqua, Roddy Cowie, Florian Eyben, Hatice Gunes, Dirk Heylen, Mark ter Maat, Gary McKeown, Sathish Pammi, Maja Pantic, Catherine Pelachaud, BjÃ¶rn Schuller, Etienne de Sevin, Michel Valstar, Martin WÃ¶llmer Building autonomous sensitive artificial listeners (extended abstract) published pages: , ISSN: , DOI:	ACII	2019-05-30
2016	George Trigeorgis, Fabien Ringeval, Raymond BrÃ¼ckner, Erik Marchi, Mihalis Nicolaou, BjÃ¶rn Schuller, Stefanos Zafeiriou Adieu features? End-to-end apeech emotion recognition using a deep convolutional recurrent network published pages: , ISSN: , DOI:	ICASSP	2019-05-30
2015	Kun Qian, Zixing Zhang, Fabien Ringeval, BjÃ¶rn Schuller Bird sounds classification by large scale acoustic features, extreme learning machine published pages: , ISSN: , DOI:	GlobalSIP	2019-05-30
2015	Eduardo Coutinho, George Trigeorgis, Stefanos Zafeiriou, BjÃ¶rn Schuller Automatically estimating emotion music using long-short term memory recurrent neural networks published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2015	Fabien Ringeval, BjÃ¶rn Schuller, Michel Valstar, Shashank Jaiswal, Erik Marchi, Denis Lalanne, Roddy Cowie, Maja Pantic AV+EC 2015 â€“- The first affect recognition Challenge bridging across audio, video, and physiological Data published pages: , ISSN: , DOI:	MM	2019-05-30
2015	Yue Zhang, Eduardo Coutinho, Zixing Zhang, Caijiao Quan, BjÃ¶rn Schuller Agreement-based dynamic active learning with least, medium certainty query strategies published pages: , ISSN: , DOI:	Advances in Active Learning : Bridging Theory, Practice Workshop	2019-05-30
2015	George Trigeorgis, Eduardo Coutinho, Fabien Ringeval, Erik Marchi, Stefanos Zafeiriou, BjÃ¶rn Schuller The ICL-TUM-PASSAU approach for the MediaEval 2015 â€œAffective Impact of Moviesâ€ task published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2015	Lucas Azais, Adrien Payan, Tianjiao Sun, Guillaume Vidal, Tina Zhang, Eduardo Coutinho, Florian Eyben, BjÃ¶rn Schuller Does my speech rock? Automatic assessment of public speaking skills published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2016	A. Chowanda, P. Blanchfield, M. Flintham and M.F. Valstar Playing with Social and Emotional Game Companions published pages: , ISSN: , DOI:	IVA	2019-05-30
2015	T. Almaev, B. Martinez and M.F. Valstar Learning to transfer: transferring latent task structures and its application to person-specific facial action unit detection published pages: , ISSN: , DOI:	ICCV	2019-05-30
2015	Yue Zhang, Eduardo Coutinho, Zixing Zhang, Michael Adam, BjÃ¶rn Schuller On rater reliability, correlation based dynamic active learning published pages: , ISSN: , DOI:	ACII	2019-05-30
2015	BjÃ¶rn Schuller Speech analysis in the big data era published pages: , ISSN: , DOI:	TSD	2019-05-30
2016	S. Jaiswal, M.F. Valstar Deep Learning the Dynamic Appearance and Shape of Facial Action Units published pages: , ISSN: , DOI:	IEEE WACV	2019-05-30
2016	W. Zhu, A. Chowanda, M.F. Valstar Topic switch models for dialogue management in virtual humans published pages: , ISSN: , DOI:	IVA	2019-05-30
2016	Caroline Langlet, Chloe Clavel Adapting sentiment analysis to face-to-face human-agent interactions: from detection to evaluation issues published pages: , ISSN: , DOI:	ACII	2019-05-30
2016	Caroline Langlet, Chloe Clavel Grounding the detection of the userâ€™s likes Â´ and dislikes on the topic structure of human-agent interactions published pages: , ISSN: 0950-7051, DOI:	KBS	2019-05-30
2016	B. Potard, M. Aylett, D. Braude, P. Motlicek An Open Source Kaldi Based Parametric Speech Synthesiser based on DNN published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2016	Tobias Baur, Dominik Schiller, Elisabeth AndrÃ© Modeling Userâ€™s Social Attitude in a Conversational System published pages: , ISSN: , DOI:	Emotions and Personality in Personalized Services	2019-05-30
2016	Yue Zhang, Yuxiang Zhou, Jie Shen, BjÃ¶rn Schuller Semi-autonomous data enrichment based on cross-task labelling of missing targets for holistic speech analysis published pages: , ISSN: , DOI:	ICASSP	2019-05-30
2016	George Trigeorgis, Konstantinos Bousmalis, Stefanos Zafeiriou, BjÃ¶rn Schuller A deep matrix factorization method for learning attribute representations published pages: , ISSN: 0162-8828, DOI:	PAMI	2019-05-30
2015	X. Wang, M.F. Valstar, B. Martinez, M.H. Khan, T.P. Pridmore TRIC-track: Tracking by Regression with Incrementally Learned Cascades published pages: , ISSN: , DOI:	ICCV	2019-05-30
2016	E. SÃ¡nchez-Lozano, B. Martinez, G. Tzimiropoulos, M.F. Valstar Cascaded continuous regression for real-time incremental face tracking published pages: , ISSN: , DOI:	ECCV	2019-05-30
2016	B. Potard, M. Aylett, D. Braude. Cross Modal Evaluation of High Quality Emotional Speech Synthesis with the Virtual Human Toolkit published pages: , ISSN: , DOI:	IVA	2019-05-30
2016	E. SÃ¡nchez-Lozano, B. Martinez, M.F. Valstar Cascaded Regression with Sparsified Feature Covariance Matrix for Facial Landmark Detection published pages: , ISSN: 0167-8655, DOI:	Pattern Recognition Letters	2019-05-30
2016	Clavel, C., Cafaro, A., Campano, S., & Pelachaud, C. Fostering user engagement in face-to-face human-agent interactions: a survey published pages: , ISSN: , DOI:	Toward Robotic Socially Believable Behaving Systems-Volume II	2019-05-30
2015	Eduardo Coutinho, BjÃ¶rn Schuller Automatic estimation of biosignals from the human voice published pages: , ISSN: 2329-9290, DOI:	Science, Special Supplement on Advances in Computational Psychophysiology	2019-05-30
2015	Tobias Baur, Gregor Mehlmann, Ionut Damian, Florian Lingenfelser, Johannes Wagner, Birgit Lugrin, Elisabeth AndrÃ©, Patrick Gebhard Context-Aware Automated Analysis and Annotation of Social Human-Agent Interactions published pages: , ISSN: 2160-6455, DOI:	ACM Transactions on Interactive Intelligent Systems (TiiS) 5.2	2019-05-30
2015	M. Wester, M. Aylett, M. Tomalin, R. Dall Artificial Personality and Disfluency published pages: , ISSN: , DOI:	Interspeech	2019-05-30
2015	Kornelia Gentsch, Eduardo Coutinho, Florian Eyben, BjÃ¶rn Schuller, Klaus R. Scherer Classifying emotion-antecedent appraisal in brain activity using machine learning methods published pages: , ISSN: , DOI:		2019-05-30
2015	Erik Marchi, Fabio Vesperini, Felix Weninger, Florian Eyben, Stefano Squartini, BjÃ¶rn Schuller Non-linear prediction with LSTM recurrent neural networks for acoustic novelty detection published pages: , ISSN: , DOI:	OJCNN	2019-05-30
2016	BjÃ¶rn Schuller, Stefan Steidl, Anton Batliner, Julia Hirschberg, Judee K. Burgoon, Alice Baird, Aaron Elkins, Yue Zhang, Eduardo Coutinho, Keelan Evanini The INTERSPEECH 2016 Computational Paralinguistics Challenge: Deception & Sincerity published pages: , ISSN: , DOI:	ICMI	2019-05-30
2015	S. Jaiswal, B. Martinez, M.F. Valstar Learning to combine local models for Facial Action Unit detection published pages: , ISSN: , DOI:	FERA	2019-05-30
2015	B. Martinez and M.F. Valstar L21-based regression and prediction accumulation across views for robust facial landmark detection published pages: , ISSN: 0262-8856, DOI:	Image and Vision Computing	2019-05-30

Are you the coordinator (or a participant) of this project? Plaese send me more information about the "ARIA-VALUSPA" project.

For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.

Send me an email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.

Thanks. And then put a link of this page into your project's website.

The information about "ARIA-VALUSPA" are provided by the European Opendata Portal: CORDIS opendata.