#	Pagina
attuale pagina	/open-h2020/projects/216112/results.html

Report

Teaser, summary, work performed and final results

Periodic Reporting for period 1 - FITOPTIVIS (From the cloud to the edge - smart IntegraTion and OPtimization Technologies for highly efficient Image and VIdeo processing Systems)

Teaser

Summary

CPS are systems that are in feedback with their environment, possibly with humans in the loop. They are often distributed with sensors and actuators, smart, adaptive and predictive and react in real-time Image- and video-processing pipelines are a prime source for environmental information improving the possibilities of active, relevant feedback. Advanced imaging and video applications are very complex. This complexity further increases when multiple heterogeneous sensor inputs are combined for analysis and through the distributed nature and the integration of both generic and specialised devices. On top of that, CPS need to satisfy stringent constraints on real-time behaviour, safety, security, form factor, performance, energy consumption, reliability and quality.

It is challenging to balance power demand versus performance of the increasingly complex distributed configurations, reflected in the growing number of sensors, actuators and other smart devices, their heterogeneity, their growing autonomy, and the increased need for performance. To address this challenge, FitOptiVis aims to provide end-to-end multi-objective optimisation for imaging and video pipelines of CPS, with an emphasis on energy and performance.

The objective of FitOptiVis is to develop a cross-domain approach for smart integration of image- and video-processing pipelines for CPS covering a reference architecture, supported by low-power, high-performance, smart devices, and by methods and tools for combined design-time and run-time multi-objective optimisation within system and environment constraints. Low latency Image processing is often crucial for autonomy, and performing the right interaction of the CPS with its environment. Many CPS demonstrators in the project have sensors and processing at distributed places. For many reasons (parts of) CPS have to operate on low energy, whereas the complete system needs results with low latency. The focus of the project is on multi-objective optimisation for performance and energy use. However, other qualities, like reliability, security etc. also play a role in the optimisation.

FitOptiVis will provide a reference architecture supporting composability built on suitable component abstractions and embedded sensing, actuation and processing devices adhering to those abstractions. The reference architecture will support design portability, on-line multi-objective quality and resource management and run-time adaptation guaranteeing system constraints and requirements based on platform virtualization.

Objectives
FitOptiVis developments are driven by industrial use cases that serve as a basis for requirements, demonstration, and validation. Models and abstractions play a crucial role as a basis for an integrated reference architecture, design methods and run-time operation of CPS imaging and video pipelines. Devices and components expose their functional and performance set points, each with the corresponding resource requirements, through minimal interfaces. Model-driven design methods aim to design set points that trade-off functional and performance capabilities against resource usage, for maximal design-time and run-time flexibility. Resource virtualization and predictable, composable reconfiguration enable modular, scalable run-time multi-objective adaptation and optimization ensuring quality and real-time performance, even across reconfigurations. On-line monitoring and learning techniques enable the evolution of set points and their resource requirements in changing contexts, both operational environments and use patterns. A common reference architecture will capture the essential aspects of the envisioned approach in appropriate component abstractions, virtualization techniques and quality- and resource management protocols. The approach is grounded in the development of smart, high-performance, energy-efficient devices and components to validate the concepts and as a basis to exploit the FitOptiVis results

Work performed

Work performed during the reporting period and main results achieved so far
During this reporting period, the initial requirements and use cases have been identified and documented in standard formats for the project. These will be the basis of development in the other work packages. Feedback of these developments will be used for future updates of the requirements.
The project agreed on an initial outline for the common reference architecture. In addition, a common component model was defined to be able to abstract components and their configurations in the project. First steps were made in investigation virtualisation mechanisms and model.
Furthermore, the project provided initial work on design-time optimization, deployment and programming strategies, design, programming and accelerator design tools. The project started the development of run-time modelling. A concrete proposal for a heterogeneous distributed software stack was proposed and prototyped. In addition, an inventory of existing virtualization techniques was provided. The project did an extensive internal survey on core hardware, software and communication technologies/ components.
The validation and evaluation strategy is defined and documented. It involves validation methods for each user need and verification methods for each requirement.
Databases were set-up for monitoring and managing exploitation and dissemination activities.
Several work packages had intense collaboration and alignment sessions, as certain topics are relevant for more than one work package.

Final results

Expected final results and their potential impact and use (including the socio-economic impact and the wider societal implications of the action so far
FitOptiVis ultimate goal is to define an integrated development environment, including reference architecture, development tools, runtime support and dedicated software and hardware components, to enable cost effective and rapid smart integration of energy efficient image and video processing platform for CPS. FitOptiVis technologies have a direct impact on the ECSEL Design Technology, Smart System Integration and CPS programmes of the MASP (see Section 2.1.1-3), and we intend to demonstrate the effectiveness of the envisioned solutions by means of 10 challenging use cases that span across 4 over 5 Smart-* Key Application Domains of the MASP.

With this in mind, we are on track