Jason Taaffe - Academia.edu (original) (raw)

Uploads

Papers by Jason Taaffe

Research paper thumbnail of Exploratory Analysis of Spark Structured Streaming

In the Big Data era, stream processing has become a common requirement for many data-intensive ap... more In the Big Data era, stream processing has become a common requirement for many data-intensive applications. This has lead to many advances in the development and adaption of large scale streaming systems. Spark and Flink have become a popular choice for many developers as they combine both batch and streaming capabilities in a single system. However, introducing the Spark Structured Streaming in version 2.0 opened up completely new features for SparkSQL, which are alternatively only available in Apache Calcite. This work focuses on the new Spark Structured Streaming and analyses it by diving into its internal functionalities. With the help of a micro-benchmark consisting of streaming queries, we perform initial experiments evaluating the technology. Our results show that Spark Structured Streaming is able to run multiple queries successfully in parallel on data with changing velocity and volume sizes.

Research paper thumbnail of Wirtschafts- und Unternehmensethik zwischen normativer Oekonomik und angewandter Philosophie – Zum Stand der Ethik im Curriculum der Wirtschaftswissenschaften (On the Current State of Ethics in the Curriculum of Economics and Business Administration)

Zeitschrift Fur Wirtschafts Und Unternehmensethik Journal For Business Economics Ethics, 2014

Research paper thumbnail of Exploratory Analysis of Spark Structured Streaming

In the Big Data era, stream processing has become a common requirement for many data-intensive ap... more In the Big Data era, stream processing has become a common requirement for many data-intensive applications. This has lead to many advances in the development and adaption of large scale streaming systems. Spark and Flink have become a popular choice for many developers as they combine both batch and streaming capabilities in a single system. However, introducing the Spark Structured Streaming in version 2.0 opened up completely new features for SparkSQL, which are alternatively only available in Apache Calcite. This work focuses on the new Spark Structured Streaming and analyses it by diving into its internal functionalities. With the help of a micro-benchmark consisting of streaming queries, we perform initial experiments evaluating the technology. Our results show that Spark Structured Streaming is able to run multiple queries successfully in parallel on data with changing velocity and volume sizes.

Research paper thumbnail of Wirtschafts- und Unternehmensethik zwischen normativer Oekonomik und angewandter Philosophie – Zum Stand der Ethik im Curriculum der Wirtschaftswissenschaften (On the Current State of Ethics in the Curriculum of Economics and Business Administration)

Zeitschrift Fur Wirtschafts Und Unternehmensethik Journal For Business Economics Ethics, 2014

Log In