Report

Teaser, summary, work performed and final results

Periodic Reporting for period 1 - SenseCare (Sensor Enabled Affective Computing for Enhancing Medical Care)

Teaser

This project brings together a diverse group of subject matter experts from industry and academia under one umbrella, with the main aim of enhancing and advancing future healthcare processes and systems using sensory and machine learning technologies to provide emotional...

Summary

This project brings together a diverse group of subject matter experts from industry and academia under one umbrella, with the main aim of enhancing and advancing future healthcare processes and systems using sensory and machine learning technologies to provide emotional (affective) and cognitive insights into patients well-being so as to provide them with more effective treatment across multiple medical domains.From a technical perspective, the primary objective is to “develop a cloud based affective computing operating system capable of processing and fusing multiple sensory data streams to provide cognitive and emotional intelligence for AI connected healthcare systems”. In particular the consortium will:
• Specify and engineer the architecture of the SenseCare platform and release two versions of the platform cloud infrastructure during the life of the RISE project.
• Create and evaluate two use case test pilots (relating to the dementia care and connected health medical domains) that integrate with, use and apply the services of the SenseCare platform.
• Specify and engineer a number of medical informatics applications that will run on the SenseCare platform and that will also be tested and evaluated as part of the use case test pilot phases.

The consortium brings together the following participants and their associated skills/expertise:
• Cork Institute of Technology [CIT]
• University of Ulster [Ulster]
• Forschungsinstitut für Telekommunikation [FTK]
• GLOBIT
• INMARK

The outputs of the project will lead to significant and lasting impact on the innovation potential of the individual researchers, their host organizations as well as impacting in a much wider sense at a European and global level.
We will develop a cloud-based operating system platform which will deliver user(s) cognitive/affective state data from the fusion of multiple data streams from sensory devices. The overall approach is summarized in Figure 1.

The achievement of the core aim has been broken down into the following technical objectives which match the main Work Packages (WP):
WP1. Use Case Requirements [Led by University of UUlster]. This work packages will identify, define and specify the most relevant use cases in which the SenseCare platform will ultimately be deployed.
WP2. Affective Computing & Machine Learning [Led by CIT]. This WP will develop and apply affective computing algorithms to form the intelligent nucleus of the SenseCare platform.
WP3. Big Data Fusion & Machine Learning[Led by FTK]. This WP will develop a number of input interfaces for specific sensory devices such as cameras, wearables and Internet of Things.
WP4. Psychology of AC [Led by INMARK]. This work package will apply the most current thinking, models and algorithms from psychology and will form an integral input to other work packages.
WP5. Medical Informatics [Led by GLOBIT]. This WP is responsible for the configuration, interface, deployment and testing of the use case SenseCare applications that have been specified in WP1 (Use Case Requirements).

Work performed

WP1 Use Case Requirements [Ulster]
• Ulster has been working with GLOBIT and INMARK to scope the user requirements based on initial use case scenarios that will be informed by engagements with people living with dementia and their caregivers. Initial system requirements and a number of use case stories have been identified via literature review and engaging with researchers.
• Deliverable 1.1 was submitted - pilot scenarios that the dementia care and connected health research community expect to execute and be supported by the SenseCare platform.

WP2 Affective Computing & Machine Learning (System Build) [CIT]
• Work was completed on use cases, affective computing, sensory fusion and the technical architecture of SenseCare through a significant knowledge exchange between all partners, framed by the work toward completing the deliverables in WP 2, 3 and 4.
• Deliverable D2.1 “SenseCare Requirement Analysis and Architecture Notebook for SenseCare (SC) Affective Computing (AC) Layer” was submitted
• Submitted Deliverable D2.3 “SenseCare Platform Infrastructure Release 1 (Software)

WP 3 Big Data Fusion and Machine Learning (System Build) [FTK]
• Developed the draft SenseCare portal architecture, defining a framework between WP2, in which CIT is establishing an Affective Computing layer that is foreseen to closely interact with the Data Fusion Layer, which is being realised by FTK in WP3. FTK collaborated with INMARK and GLOBIT on ontologies and the Wiki Portal setup (Milestone 1) through provision of relevant research data and further by planning activities with respect to the overall Wiki Portal realisation.
• Deliverable 3.1: “Requirements Analysis and Architecture Notebook for SenseCare Data Fusion layer” and Deliverable 3.2: “Semantic and Ontological Notebook for SenseCare Data Fusion layer” were submitted. D3.1 and D3.2 are documenting various aspects of the portal architecture.
• Submitted Deliverable 3.4: “SenseCare Platform Infrastructure Release 1 in conjunction with WP2”

WP 4 Psychology of AC [InMark]
• To date INMARK has been the focal point of research activities in SenseCare through WP4. Contributed to the initial input of the psychological and sociological aspects of dementia and dementia care to provide grounds for other project partners to progress in a more informed manner.
• Globit, working with INMARK, has prepared the SenseCare Online Portal (Milestone1: Psychology of AC SenseCare portal/wiki). The initial version was configured and deployed
• Deliverable 4.1, Semantic, Ontological and Psychology of AC Notebook, submitted, Deliverable 4.2, Psychology of AC SenseCare portal/wiki (Demonstrator) and Deliverable 4.3, SenseCare Security and Ethical Protection Mechanisms, submitted

WP 5 Medical Informatics Pilot Application Deployment [Globit]
• GLOBIT is building the framework for the pilot deployments; working together with Ulster to scope the user requirements and initial use case scenarios; working with CIT to learn more about Affective Computing (AC); working with FTK on the Data Fusion and Big Data components and requirements for the overall SenseCare portal; working with INMARK intensively on the psychology of AC
• Submitted Deliverable 5.2 SenseCare Use Case Test Pilots Release 1

Final results

SenseCare has targeted the following impacts for the project
• Enhancing research- and innovation-related human resources, skills, and working conditions to realise the potential of individuals and to provide new career perspectives
• To develop new and lasting research collaborations, to achieve transfer of knowledge between research institutions and to improve research and innovation potential at the European and global levels
• Develop a way to build the self-sustainability of the partnership after the end of the project.
• Make a contribution to the improvement of the research & innovation potential within Europe and/or worldwide.
• Position SenseCare solutions effectively in a futuristic marketplace and one in which Europe must be involved with/in for sustained economic prosperity and overall EU citizen well-being.

Through use cases and the prototypes, the tools to explore the development of new practices with healthcare professional now exist. Now a community construct is needed and SenseCare is exploring the paradigm of communities of practice to develop this.

Website & more info

More info: http://www.sensecare.eu/.