Tuesday, August 23, 2016

Setting up Apache Spark 2.0 with Intellij Community edition



Apache spark is currently one of the hottest projects in the open source community, and as it evolves over the years the supported tooling and peripherals connected to this project evolve also with it.

This article will provide a step by step guidance of how to set up "Intellij IDEA community edition" to locally run Apache Spark 2.0 applications on your computer and to gain all of the advantages of running Apache Spark applications on a modern integrated development environment . 

During the steps of the article you will perform the following steps:

  • Download and install latest intellij IDEA community edition
  • Download and install the latest Oracle/Sun JDK
  • Set up your JAVA_HOME variable
  • Start intellij IDEA community edition
  • Install Scala and SBT plugins for Intellij 
  • Create and configure a new Scala and SBT project
  • Configure libraries for the newly created project
  • Validate your configuration
  • Test your setup

The full document is available at this location click here