IntelliJ IDEA 创建 spark 项目
1.创建新项目：
2.选择 Maven ——》选择SDK ——》Next
3.起好名字
4.右键在 Main 文件夹下的 java 源码包（蓝色为源码包，灰色为普通文件夹）
右键 java ——》new 发现没有 scala class 选项。
5.点击此选项，导入 scala SDK
6.然后右键在 Main 文件夹下的 java 源码包，发现可以新建 scala class 了
7.为了便于管理，不再 java 源码包下新建 scala class，右键 main，创建 Directory
8.将新建的 scala 目录改成 源码包，右键 scala
9.然后右键 scala 源码包，新建scala class
10.打开 pom.xml 添加配置信息从而导入相关包
配置信息为：
4.0.0
SparkBusinessInAction
SparkBusinessInAction
1.0-SNAPSHOT
2.1.0
2.11.8
2.8.2
1.2.14
9.2.5.v20141112
2.17
1.8
scala-tools.org
Scala-Tools Maven2 Repository
http://scala-tools.org/repo-Releases
scala-tools.org
Scala-Tools Maven2 Repository
http://scala-tools.org/repo-Releases
javax.ws.rs
javax.ws.rs-api
2.0
org.scala-lang
scala-compiler
${scala.version}
org.scala-lang
scala-reflect
${scala.version}
org.scala-lang
scalap
${scala.version}
junit
junit
4.4
test
org.specs
specs
1.2.5
test
org.apache.spark
spark-core_2.11
${spark.version}
org.apache.spark
spark-launcher_2.11
2.1.0
org.apache.spark
spark-network-shuffle_2.11
2.1.0
org.apache.spark
spark-sql_2.11
${spark.version}
org.apache.spark
spark-hive_2.11
2.1.0
org.apache.spark
spark-catalyst_2.11
2.1.0
org.apache.spark
spark-streaming-flume-assembly_2.11
2.1.0
org.apache.spark
spark-streaming_2.11
${spark.version}
org.apache.spark
spark-graphx_2.11
2.1.0
org.scalanlp
breeze_2.11
0.11.2
compile
junit
junit
commons-math3
org.apache.commons
org.apache.commons
commons-math3
3.4.1
compile
org.apache.spark
spark-mllib_2.11
2.1.0
org.apache.spark
spark-mllib-local_2.11
2.1.0
compile
org.apache.spark
spark-mllib-local_2.11
2.1.0
test-jar
test
org.apache.spark
spark-repl_2.11
2.1.0
org.apache.spark
spark-streaming-kafka-0-8_2.10
2.1.0
org.apache.spark
spark-streaming-flume_2.11
${spark.version}
mysql
mysql-connector-java
5.1.6
org.apache.hive
hive-jdbc
1.2.1
org.apache.httpcomponents
httpclient
4.4.1
org.apache.httpcomponents
httpcore
4.4.1
org.apache.hadoop
hadoop-common
2.6.0
org.apache.hadoop
hadoop-client
2.6.0
org.apache.hadoop
hadoop-hdfs
2.6.0
redis.clients
jedis
${jedis.version}
fastutil
fastutil
5.0.9
org.eclipse.jetty
jetty-server
${jetty.version}
org.eclipse.jetty
jetty-servlet
${jetty.version}
org.eclipse.jetty
jetty-util
${jetty.version}
org.glassfish.jersey.core
jersey-server
${container.version}
org.glassfish.jersey.containers
jersey-container-servlet-core
${container.version}
org.glassfish.jersey.containers
jersey-container-jetty-http
${container.version}
org.apache.hadoop
hadoop-mapreduce-client-core
2.6.0
org.antlr
antlr4-runtime
4.5.3
src/config
**/*.properties
maven-assembly-plugin
dist
true
jar-with-dependencies
make-assembly
package
single
maven-compiler-plugin
1.7
1.7
net.alchim31.maven
scala-maven-plugin
3.2.2
scala-compile-first
process-resources
compile
${scala.version}
incremental
true
-unchecked
-deprecation
-feature
-Xms1024m
-Xmx1024m
-source
${java.version}
-target
${java.version}
-Xlint:all,-serial,-path
org.antlr
antlr4-maven-plugin
4.3
antlr
antlr4
none
src/test/java
true
true
11.然后导包
