Big Streaming Data Streaming Languages (slangs)
An Outlook to Declarative Languagesfor Big Steaming Data
Declarative Languages for Big Streaming Data
Authors (over time)
- Riccardo Tommasini - Politecnico di Milano - site
- Sherif Sackr - University of Tartu - site
- Marco Balduini - Politecnico di Milano
- Emanuele Della Valle- Politecnico di Milano - site
- Hojjat Jafarpour, Confluent
Abstract
Data streaming systems have been introduced to tame velocity and enable reactive decision making in the Big Data Context. However, approaching such systems is still too complex due to the paradigm shift they require, i.e., moving from scalable batch processing to continuous analysis and detection. Initially, modern big stream processing systems (e.g., Flink, Spark, Storm) have been lacking the support of declarative languages to express the streaming-based data processing tasks and have been mainly relying on providing low-level APIs for the end-users to implement their tasks. However, recently, this fact has been changing and most of them started to provide SQL-like languages for their end-users. In general, declarative Languages are playing a crucial role in fostering the adoption of Stream Processing. This tutorial focuses on introducing various approaches for declarative querying of the state-of-the-art big data streaming frameworks. In addition, we provide guidelines and practical examples on developing and deploying Stream Processing applications using a variety of SQL-like languages, such as Flink-SQL, KSQL and Spark Streaming SQL.