Reflections on the Big Data Thematic

Reflections on the big data thematic

Abstract:

“Big Data” is one of the most heard buzz terms within today's IT and Data community.  This presentation reflects on some aspects of the big data hype and addresses some key issues as they are perceived by the data providers and the users. An important aspect in this discussion is the notion that users typically need data in order to get answers to their questions – which as such is not a new issue - however, in the big data era the generation of such answers is due to the exponential growth of the base data representing a significant challenge to both providers and users.

The question is on how and to what extend a resolution of this challenge could be supported by the Data providers and others.

An overview is therefore presented on how EUMETSAT – the European Organization for the Exploitation of Meteorological Satellites - considers those aspects within the context of its existing operational data services but also the intended strategic big data related evolutions of its data services portfolio. In this context the different models of data delivery (push – pull & near-real-time – online/offline) are discussed and in particular the service bridge a data provider might build in order to make steps towards the user for easier access to the actual information the user requires.