Tag

big data

Ingesting Data from Files with Spark, Part 2

By Jean Georges Perrin

This is the second in a series of 4 articles on the topic of ingesting data from files with Spark. This section deals with ingesting a JSON file.

Ingesting Data from Files with Spark, Part 1

From Spark in Action, 2nd Ed. by Jean Georges Perrin

This is the first in a series of 4 articles on the topic of ingesting data from files with Spark. This section deals with ingesting data from CSV.

The Majestic Role of the Dataframe in Spark

From Spark with Java by Jean Georges Perrin

In this article, you’ll learn what a dataframe is, how it’s organized, and about immutability.

Build a Full-Featured Data Solution


slideshare-build-a-full-featured-data-solution

From Fusion in Action by Guy Sperry

What Happens behind the Scenes with Spark

From Spark with Java by Jean Georges Perrin

You’ve probably seen a simple use-case where Spark ingests data from a CSV file, then performs a simple operation, and then stores the result in the database. In this article, you’re going to see what happened behind the scenes.

What do Cooking Pasta and Data Science Have in Common?

From Data Science at Scale with Python and Dask by Jesse C. Daniel

This article discusses Dask, how it compares to Apache Spark, and how to create and understand directed acyclic graphs using the example of the delicious Italian pasta dish bucatini all’Amatriciana.

Streaming Data with KSQL

From Kafka Streams in Action by Bill Bejeck

This article discusses KSQL, a brand-new open source, Apache 2.0 streaming SQL engine that enables stream processing with Kafka. Basically, it makes it easy to read, write, and process streaming data in real-time, at scale, using SQL-like semantics.

Using Apache Spark with Java


slideshare-using-apache-spark-with-java

From Spark with Java
By Jean Georges Perrin

Getting up and Running with Spark


slideshare-getting-up-and-running-with-spark

From Spark in Motion
By Jason Kolter

Say Hello to Kafka


slideshare-say-hello-to-kafka
From Kafka in Action
By Dylan Scott

© 2018 Manning — Design Credits