Sound of Vision
Natural sense of vision through acoustics and haptics
Total Cost €
0EC-Contrib. €
0Partnership
0Views
0Sound of Vision project word cloud
Explore the words cloud of the Sound of Vision project. It provides you a very rough idea of what is the project "Sound of Vision" about.
Project "Sound of Vision" data sheet
The following table provides information about the project.
| Coordinator |
HASKOLI ISLANDS
Organization address contact info |
| Coordinator Country | Iceland [IS] |
| Project website | http://www.soundofvision.net |
| Total cost | 3˙960˙709 € |
| EC max contribution | 3˙960˙709 € (100%) |
| Programme |
1. H2020-EU.3.1.4. (Active ageing and self-management of health) |
| Code Call | H2020-PHC-2014-single-stage |
| Funding Scheme | RIA |
| Starting year | 2015 |
| Duration (year-month-day) | from 2015-01-01 to 2017-12-31 |
Partnership
Take a look of project's partnership.
| # | ||||
|---|---|---|---|---|
| 1 | HASKOLI ISLANDS | IS (REYKJAVIK) | coordinator | 1˙336˙898.00 |
| 2 | UNIVERSITATEA POLITEHNICA DIN BUCURESTI | RO (BUCHAREST) | participant | 705˙400.00 |
| 3 | UNIVERSITATEA TEHNICA GHEORGHE ASACHI DIN IASI | RO (IASI) | participant | 424˙709.00 |
| 4 | ISTITUTO PER L'INTERSCAMBIO SCIENTIFICO | IT (TORINO) | participant | 383˙518.00 |
| 5 | POLITECHNIKA LODZKA | PL (LODZ) | participant | 352˙906.00 |
| 6 | INFO WORLD SRL | RO (BUCURESTI SECTOR 2) | participant | 269˙118.00 |
| 7 | BJONUSTU-OG BEKKINGARMIOSTOO FYRIRBLINDA SJONSKERTA OG DAUFBLINDA EINSTAKLINGA | IS (REYKJAVIK) | participant | 197˙832.00 |
| 8 | SZECHENYI ISTVAN UNIVERSITY | HU (GYOR) | participant | 149˙625.00 |
| 9 | FUNDACJA INSTYTUT ROZWOJU REGIONALNEGO | PL (KRAKOW) | participant | 140˙700.00 |
Map
Project objective
Sound of Vision (Vision restoration through sound and haptics) will design, implement and validate an original non-invasive hardware and software system to assist visually impaired people by creating and conveying an auditory representation of the surrounding environment. This representation will be created, updated and delivered to a blind person continuously and in real time. This system will help visually impaired people in any kind of environment (indoor/outdoor), without the need for predefined tags/sensors located in the surroundings.
The process of assisting visually impaired people proposed by Sound of Vision consists of a series of repetitive steps. The first step uses hardware and software for generating a 3D representation of the surrounding environment. In the second step, objects are identified within the 3D model and the information is then transformed into 3D sound and haptics sources. In the last step, all the 3D sound and haptics sources are combined and conveyed to the user, using specialized wearable hardware and algorithms.
A functional prototype will be developed, followed by experimental validations and subsequent improvements, according to the feedback provided by visually impaired people, training specialists and neurologists. The product thus obtained will be sold as a hardware and software system, as well as some training courses that will help blind people use the system.
The consortium has the necessary complementary competences to design and develop the proposed system, to test the prototype, establish training protocols and also to commercialize the system as an intuitive and accessible final product.
Sound of Vision is a concept that goes beyond the state of the art of the visual sensory substitution systems, having the potential to become an affordable commercial product that will actually help blind people. This system can have an impressive social impact, improving the lifestyle of blind people, and also of their families and friends, on which they would otherwise depend.
Free keywords (updated): Visual impairments; brain-computer interface (BCI); Neuroplasticity; Psychophysics; audio/video processing; wearable assistive devices; sonification; sound localization; haptic space perception.
Deliverables
| Scientific papers IV | Documents, reports | 2019-03-08 17:52:28 |
| Project website (updated) | Websites, patent fillings, videos etc. | 2019-03-08 17:52:32 |
| Doctoral reports | Documents, reports | 2018-12-11 10:53:01 |
| Usage questionnaires | Other | 2018-12-11 10:52:45 |
| Scientific review (survey) articles | Documents, reports | 2018-12-11 10:53:07 |
| Scientific papers III | Documents, reports | 2018-12-11 10:52:57 |
| Scientific papers II | Documents, reports | 2018-12-11 10:52:37 |
| Scientific papers I | Documents, reports | 2018-12-11 10:52:37 |
| Project web site | Websites, patent fillings, videos etc. | 2018-12-11 10:52:51 |
| Final version of the project website | Websites, patent fillings, videos etc. | 2018-12-11 10:52:50 |
| Project website (updated II) | Websites, patent fillings, videos etc. | 2018-12-11 10:52:44 |
| Project website (updated III) | Websites, patent fillings, videos etc. | 2018-12-11 10:52:59 |
Take a look to the deliverables list in detail: detailed list of Sound of Vision deliverables.
Publications
| year | authors and title | journal | last update |
|---|---|---|---|
| 2017 |
Iulia-Cristina Stănică, Maria-Iuliana Dascălu, Alin Moldoveanu, Florica Moldoveanu An Innovative Solution Based on Virtual Reality to Treat Phobia published pages: 1-13, ISSN: 2165-9508, DOI: 10.5171/2017.155350 |
International Journal of Interactive worlds | 2019-05-29 |
| 2016 |
I.-C. Stanica, A. Moldoveanu, C.-N. Bodea, M.-I. Dascalu, S. Hostiuc A survey of virtual reality applications as psychotherapeutic tools to treat phobias published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2016 |
Sorin Hostiuc, Alin Moldoveanu, Maria-Iuliana Dascălu, Runar Unnthorsson, Ómar I. Jóhannesson, Ioan Marcus Translational research—the need of a new bioethics approach published pages: , ISSN: 1479-5876, DOI: 10.1186/s12967-016-0773-4 |
Journal of Translational Medicine 14/1 | 2019-05-29 |
| 2015 |
Oana Bălan, Alin Moldoveanu, Florica Moldoveanu, Alexandru Butean Developing a navigational 3D audio game with hierarchical levels of difficulty for the visually impaired players published pages: 49-54, ISSN: 2344-1690, DOI: |
Romanian Conference on Human-Computer Interaction | 2019-05-29 |
| 2017 |
H. Nagy, Ã. Csapó and G. Wersényi Audio-based mobile applications for Android using multisensory feedback in assistive technology published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2016 |
Oana-Maria FERCHE, Alin MOLDOVEANU, Florica MOLDOVEANU, Alexandra VOINEA and Victor ASAVEI Challenges and Issues for Successfully Applying Virtual Reality in Medical Rehabilitation published pages: , ISSN: , DOI: 10.12753/2066-026X-15-073 |
2019-05-29 | |
| 2017 |
Wersényi, György; Répás, József Comparison of HRTFs from a Dummy-Head Equipped with Hair, Cap, and Glasses in a Virtual Audio Listening Task over Equalized Headphones published pages: , ISSN: , DOI: |
Proceedings of the 142nd Convention of the Audio Engineering Society 9766 | 2019-05-29 |
| 2016 |
Simone Spagnol, Erica Tavazzi, Federico Avanzini Distance rendering and perception of nearby virtual sound sources with a near-field filter model published pages: , ISSN: 0001-4966, DOI: |
Journal of the Acoustical Society of America (JASA) | 2019-05-29 |
| 2017 |
M. Owczarek, P. Skulimowski and P. Strumiłło A mobile system for interactive sonification of 3D scenes from “U-disparity†representation published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2016 |
I.-C. Stanica, M.-I. Dascalu, A. Moldoveanu and F. Moldoveanu Le Traitement Des Phobies Par La Réalité Virtuelle published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2016 |
P. Skulimowski, M. Owczarek, M. Bujacz and P. Strumillo Interactive sonification of the U-disparity maps of 3D scenes published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2017 |
Nagy, Hunor; Wersényi, György Evaluation of Training to Improve Auditory Memory Capabilities on a Mobile Device Based on a Serious Game Application published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2016 |
C.-D. Nichifor, A. Moldoveanu, C.-N. Bodea, M.-I. Dascalu, A.-M. Neagu Cognitive training games to improve learning skills published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2018 |
Charalampos Saitis, Mohammad Zavid Parvez, Kyriaki Kalimeri Cognitive Load Assessment from EEG and Peripheral Biosignals for the Design of Visually Impaired Mobility Aids published pages: 1-9, ISSN: 1530-8669, DOI: 10.1155/2018/8971206 |
Wireless Communications and Mobile Computing 2018 | 2019-05-29 |
| 2016 |
Ómar Jóhannesson, Oana Balan, Runar Unnthorsson, Alin Moldoveanu, Ãrni Kristjánsson The Sound of Vision Project: On the Feasibility of an Audio-Haptic Representation of the Environment, for the Visually Impaired published pages: 20, ISSN: 2076-3425, DOI: 10.3390/brainsci6030020 |
Brain Sciences 6/3 | 2019-05-29 |
| 2015 |
Simone Spagnol, Erica Tavazzi, Federico Avanzini Relative Auditory Distance Discrimination with Virtual Nearby Sound Sources published pages: , ISSN: 2413-6689, DOI: |
Proc. of the 18th Int. Conference on Digital Audio Effects (DAFx-15) | 2019-05-29 |
| 2017 |
O. Bălan, A. Moldoveanu, F. Moldoveanu, H. Nagy, G. Wersényi and R. Unnthorsson Improving the Audio Game--Playing Performances of People with Visual Impairments Through Multimodal Training published pages: , ISSN: 0145-482X, DOI: |
Journal of Visual Impairment & Blindness | 2019-05-29 |
| 2016 |
Ãrni Kristjánsson, Alin Moldoveanu, Ómar I. Jóhannesson, Oana Balan, Simone Spagnol, VigdÃs Vala Valgeirsdóttir, Rúnar Unnthorsson Designing sensory-substitution devices: Principles, pitfalls and potential1 published pages: 769-787, ISSN: 0922-6028, DOI: 10.3233/RNN-160647 |
Restorative Neurology and Neuroscience 34/5 | 2019-05-29 |
| 65535 |
Andrei Ciobanu, Anca Morar, Florica Moldoveanu, Alin Moldoveanu Real-time segmentation of depth map frames on mobile devices published pages: -, ISSN: 1454-8658, DOI: |
Journal of Control Engineering and Applied Informatics | 2019-05-29 |
| 2017 |
COSMA, Călin; BĂLAN, Oana; MOLDOVEANU, Alin; MORAR, Anca; MOLDOVEANU, Florica; TASLITCHI, Cristian Treating acrophobia with the help of virtual reality published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2017 |
Balan, Oana; Moldoveanu, Alin; Moldoveanu, Florica; Nagy, Hunor; Wersenyi, Gyorgy; Unnporsson, Runar Improving the Audio Game-Playing Performances of People with Visual Impairments through Multimodal Training published pages: , ISSN: 0145-482X, DOI: |
Journal of Visual Impairment & Blindness | 2019-05-29 |
| 2015 |
Oana Bălan, Alin Moldoveanu, Florica Moldoveanu 3D Audio and Haptic Interfaces for Training the Spatial Acoustic Resolution in Virtual Auditory Environments published pages: 3-4, ISSN: , DOI: |
International Conference on Auditory Display 2015 Student Think Tank | 2019-05-29 |
| 2017 |
Csapo, Adam; Spagnol, Simone; Herrera Martinez, Marcelo; Bujacz, Michal; Janeczek, Maciej; Ivanica, Gabriel; Wersényi, György; Moldoveanu, Alin; Unnthorsson, Runar Usability and Effectiveness of Auditory Sensory Substitution Models for the Visually Impaired published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2015 |
P. Strumillo, M. Bujacz, P. Baranski, P. Skulimowski, P. Korbel, M. Owczarek, K. Tomalczyk, A. Moldoveanu, R. Unnthorsson Different Approaches to Aiding Blind Persons in Mobility and Navigation in the “Naviton†and “Sound of Vision†Projects published pages: 435-468, ISSN: , DOI: 10.1007/978-3-319-54446-5_15 |
2019-05-29 | |
| 2016 |
S. Spagnol, S. Galesso and F. Avanzini Estimation of spectral HRTF features for 3D audio rendering with non-linear anthropometric models published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2016 |
Charalampos Saitis, Kyriaki Kalimeri Identifying Urban Mobility Challenges for the Visually Impaired with Mobile Monitoring of Multimodal Biosignals published pages: 616-627, ISSN: , DOI: 10.1007/978-3-319-40238-3_59 |
2019-05-29 | |
| 2016 |
Simone Spagnol, Charalampos Saitis, Michal Bujacz, Omar I. Johannesson, Kyriaki Kalimeri, Alin Moldoveanu, Arni Kristjansson, Runar Unnthorsson Model-based obstacle sonification for the navigation of visually impaired persons published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2017 |
Anca Morar, Florica Moldoveanu, Lucian Petrescu, Alin Moldoveanu Real Time Indoor 3D Pipeline for an Advanced Sensory Substitution Device published pages: 685-695, ISSN: , DOI: 10.1007/978-3-319-68548-9_62 |
2019-05-29 | |
| 2015 |
Simone Spagnol, Federico Avanzini Frequency Estimation of the First Pinna Notch in Head-Related Transfer Functions with a Linear Anthropometric Model published pages: , ISSN: 2413-6689, DOI: |
Proceedings of the 18th International Conference on Digital Audio Effects | 2019-05-29 |
| 2015 |
Baranski P., Strumillo P. Field trials of a teleassistance system for the visually impaired published pages: 173-179, ISSN: 2158-2246, DOI: |
2015 8th International Conference on Human System Interaction (HSI) | 2019-05-29 |
| 2017 |
V. E. Dinu, D. Papuc, A. Gheorghiu, M.-I. Dascalu, A. Moldoveanu and F. Moldoveanu Biometric Data in Learning Analytics: a Survey on Existing Applications published pages: , ISSN: , DOI: 10.12753/2066-026X-17-151 |
2019-05-29 | |
| 2016 |
V. E. Dinu, A. Moldoveanu, I. Negoi, T. I. Codarnai, M.-I. Dascalu and C. Taslitchi A practical survey on health monitoring devices and their impact on quality of life published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2016 |
Hunor Nagy, György Wersényi Evaluation of Response Times on a Touch Screen Using Stereo Panned Speech Command Auditory Feedback published pages: 279-286, ISSN: , DOI: 10.1007/978-3-319-43958-7_33 |
2019-05-29 | |
| 2016 |
S. Spagnol, C. Saitis, K. Kalimeri, O. Johannesson and R. Unnthorsson Obstacle sonification as a navigation aid for the visually impaired published pages: , ISSN: , DOI: |
2019-05-29 | |
| 2015 |
Bogdan Troancă, Alexandru Butean, Alin Moldoveanu, Oana Bălan Introducing Basic Geometric Shapes to Visually Impaired People Using a Mobile App published pages: 91-94, ISSN: , DOI: |
12th National Conference on Human-Computer Interaction, Bucharest, 2015 | 2019-05-29 |
| 2015 |
P. Skulimowski and P. Strumillo Verification of Visual Odometry Algorithms with an OpenGL BasedSoftware Tool published pages: , ISSN: , DOI: |
Journal of Electronic Imaging 12.03.2015 | 2019-05-29 |
| 2015 |
Oana Bălan, Alin Moldoveanu, Florica Moldoveanu Multimodal Perceptual Training for Improving Spatial Auditory Performance in Blind and Sighted Listeners published pages: , ISSN: 2300-262X, DOI: 10.1515/aoa-2015-0049 |
Archives of Acoustics 40/4 | 2019-05-29 |
| 2015 |
Piotr Skulimowski, Pawel Strumillo Verification of visual odometry algorithms with an OpenGL-based software tool published pages: 33003, ISSN: 1017-9909, DOI: 10.1117/1.JEI.24.3.033003 |
Journal of Electronic Imaging 24/3 | 2019-05-29 |
| 2015 |
Przemyslaw Baranski, Pawel Strumillo Emphatic Trials of a Teleassistance System for the Visually Impaired published pages: 1640-1651, ISSN: 2156-7018, DOI: 10.1166/jmihi.2015.1621 |
Journal of Medical Imaging and Health Informatics 5/8 | 2019-05-29 |
Are you the coordinator (or a participant) of this project? Plaese send me more information about the "SOUND OF VISION" project.
For instance: the website url (it has not provided by EU-opendata yet), the logo, a more detailed description of the project (in plain text as a rtf file or a word file), some pictures (as picture files, not embedded into any word file), twitter account, linkedin page, etc.
Send me an email (fabio@fabiodisconzi.com) and I put them in your project's page as son as possible.
Thanks. And then put a link of this page into your project's website.
The information about "SOUND OF VISION" are provided by the European Opendata Portal: CORDIS opendata.