Apache Spark Fundamentals

The ever-connected world we live in is creating more data than Moore's Law can keep up with. This means that we need to make better decisions about how to analyze the data. We used Hadoop's MapReduce framework to batch process, but the modern demands for big data processing have outgrown that framework. Apache Spark is the answer. It boasts speeds up to 10-100x faster that Hadoop and holds the world record for large-scale sorting. Spark's general abstraction allows it to do more than batch processing. It can also perform iterative algorithms at lightning speed and streaming semantics at once. This course will teach you Spark from the beginning. You'll start with its history and create a Wikipedia analysis app to help you learn a large portion of its core API. This core knowledge will allow you to explore Spark's other libraries such as the streaming or SQL APIs. You'll also learn how to avoid some common pitfalls in Spark. You will leave this course with a tool belt capable of creating your own performance-maximized Spark application.