Spark Structured Streaming - File-to-File Real-time Streaming (3/3)
CSV File to JSON File Real Time Streaming Example
In this post we will see how to build a simple application to process file to file real time processing.
Data Engineering
Spark Structured Streaming - Socket Word Count (2/3)
Socket Word Count demo for Spark Structured Streaming
Structured Streaming is a new of looking at realtime streaming. In this post we will see how to build our very first Structured Streaming app to perform Word Count over network.
Spark Structured Streaming - Introduction (1/3)
A brief introduction to Spark Structured Streaming
Structured Streaming is a new of looking at realtime streaming. With abstraction on DataFrame and DataSets, structured streaming provides alternative for the well known Spark Streaming. Structured Streaming is built on top of Spark SQL Engine. Some of the main features of Structured Streaming are -
