Report

Teaser, summary, work performed and final results

Periodic Reporting for period 2 - NEAT (A New, Evolutive API and Transport-Layer Architecture for the Internet)

Teaser

The Internet’s transport-layer architecture is, in some aspects, still dependent on developments dating from the 1980’s. Modern online applications need a more flexible transport architecture to rest upon, given the substantial changes that the usage of the Internet has...

Summary

The Internet’s transport-layer architecture is, in some aspects, still dependent on developments dating from the 1980’s. Modern online applications need a more flexible transport architecture to rest upon, given the substantial changes that the usage of the Internet has undergone in the past decades. The new reality includes mobile users and no longer shows a clear separation between data communication and telecommunication services.

Smartphones and tablets can run an extensive variety of Internet applications, connected via networks such as WiFi and LTE; terminals such as laptops and desktop PCs add wired connections to the above mix of wireless network technologies. Each application has its own requirements for how it wishes its data to be carried over the Internet. The communication needs of a sensor application differ from those of web browsing or remote conferencing applications. This diversity of needs and technologies often requires application developers to consider the different networks their application may run on, and how to tune transport and network parameters for those networks – not an easy task.

The problem above is compounded by the fact that the current transport architecture of the Internet – as embodied by common Application Programming Interfaces (APIs) – exposes communication protocols to applications instead of exposing services, and ties applications to a priori choices.

NEAT provides a new approach that enables developers to specify an application’s requirements in terms of rate, delay, reliability, cost, etc. This allows NEAT to choose, or help choose, the best communication service. By separating services offered to applications from the underlying protocols and OS features, NEAT can automatically and transparently choose the best transport options available. As network technologies and protocols continue to evolve, NEAT-enabled applications will immediately be able to take advantage of new functions to reduce web page download times, make teleconferences more responsive or reduce the cost of downloading a software update.

The NEAT Transport System is designed to:

• Offer an enhanced API between applications and the transport layer, so that it exposes transport services to applications.
• Use the most suitable protocols and functions that are available end-to-end along a network path.
• Provide transparent support for: (a) dealing with middleboxes; (b) discovering and leveraging end-to-end features; (c) interacting with the network for a better application experience.
• Enable user-space protocol stacks.

This allows the NEAT System to: (a) decouple applications from a priori choices of underlying protocols and technologies; (b) support incremental evolution and deployment of new transports; (c) relieve application developers from the burden of implementing common mechanisms, and avoid “reinventing the wheel”.

NEAT therefore reduces significantly the implementation effort needed to develop an efficient Internet application, making it easier for European SMEs to compete with the “Internet Big Five”.

Work performed

In the first year of the NEAT project, the main focus was on the design of an extensible Internet transport-layer architecture. The architecture decouples communication services offered to applications from the underlying protocols, operating systems and platforms. This design work covers both the architecture of the NEAT Transport System and the API this system must provide to applications running on top of it. The design takes into account both: (a) a set of generic requirements a transport system must comply with, to be flexible and able to evolve; (b) specific applications related to the industry partners’ use cases. These applications cover a wide range of scenarios where the NEAT approach may offer benefits, from web browsing on mobile terminals to distributed storage solutions.

In the second year, a strong effort was put on developing a reference, open-source implementation of the core NEAT Transport System. This activity started by designing a set of core components. Core components include generic functionalities that are needed regardless of the use cases, like for instance an API code framework, mechanisms for discovering end-to-end support of some functions, or a policy manager. A first prototype implementation of these core components was made, as a user-space software library that implements the NEAT architecture and API. The code has been released as open-source software. In parallel, work has been underway to develop extended components, with the goal of providing either performance optimisations, better support of the project’s industry partners’ use cases, or a simpler migration path for legacy applications. This activity has resulted in the publication of several research papers.

The third main activity since the project started has been in the standardisation area. To facilitate the broad adoption of NEAT outcomes, the project consortium is promoting its results at the Internet Engineering Task Force (IETF), in relevant working groups such as the Transport Services Working Group (TAPS) and the Transport Area Working Group (TSVWG). To date, project participants have co-authored ten Internet Drafts, of which two have already been published as IETF Request for Comments (RFC) documents, with another three adopted as Working Group Items – a first important step towards publication as RFCs.

Final results

Because the large majority of applications is statically bound to a single transport protocol (TCP), the whole Internet infrastructure has evolved to better support TCP. Thus, applications face difficulties when they try to use a new protocol; this problem is now commonly referred to as “network ossification”.

There exist a range of point or partway solutions that try to solve problems related to the ossification of the network infrastructure or of typical communication APIs, but many of these solutions have had little or no impact on the Internet. One important reason for this is that “de-ossifying” the Internet transport layer to re-enable its evolution is a multi-dimensional problem. This requires the enhancement of multiple components of the end-to-end communication, and effective integration of different techniques. To the best of our knowledge, no concrete, cohesive system has been built to date that provides an overall solution.

A truly evolvable and flexible Internet transport architecture requires a comprehensive transport layer framework that can facilitate integration and cooperation of transport-layer solutions in an application-independent and flexible way. NEAT provides such a transport framework.

Building an in-house transport system can yield the best performance for applications that have special network requirements, and this is the path taken by a few industry giants. However, this path cannot be afforded by most software developers and is fraught with many technical hurdles. By contributing to a free open-source transport system with a large set of functions for efficient communication, NEAT contributes to a more level playing field for innovative small companies, from which novel Internet applications often come. NEAT will make it much easier for European software developers to write and deploy applications that efficiently communicate across the Internet, and will enable innovations across the Internet protocol stack.

Website & more info

More info: https://www.neat-project.org/.