Spark SQL deployment with Hive

Hive is a data warehouse based on Hadoop. Spark SQL is to use Hive SQL Parser to transfer Hive statement to RDD.

Step1: Install

You must have Hadoop, Spark and Hive.

Step2: Configuration

  1. spark-default.conf
  2. spark-env.sh
  3. hive-site.xml
Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s