Setup Big Data Development Environment for Spark and Hadoop

Setup Big Data Development Environment to develop Spark and Hadoop Applications using EMR and Databricks

What you’ll learn:

• Understand how to setup development environment to learn big data technologies.
• Setup EMR Cluster using AWS for Development
• Connect AWS EMR Cluster and validate AWS CLI and Spark CLIs such as spark-shell, pyspark and spark-sql
• Setup Visual Studio Code and install Remote Development Extension Pack
• Setup Project Workspace using Visual Studio Code leveraging AWS EMR Cluster
• Understand Spark Application Development and Deployment Life Cycle using Spark on AWS EMR

One of the key aspects to work on Big Data projects using technologies such as Spark and Hadoop is to have an appropriate development environment. By the end of the course, one will have the development environment ready to build Spark-based applications leveraging the power of multi-node clusters such as EMR, Databricks, etc.

https://www.classcentral.com/course/udemy-setup-big-data-development-environment-105272