IDEA 打jar，提交spark集群运行

1、idea打开file,选择projectstructure,点击Artifacts,如下图 选择add JAREmpty

然后点击OK

 

2、选择bulid Artifacts

点击bulid 就会打成jar

3、通过winSCP把jar上传到服务器/var/lib/hadoop-hdfs/application/bash/jar/testjjp.jar

4、编写spark submit脚本

#!/bin/bash

spark-submit  \

--class com.jjp.test_Bayes \

--master yarn-client \

--jars/var/lib/hadoop-hdfs/application/bash/jar/ojdbc7.jar \

/var/lib/hadoop-hdfs/application/bash/jar/testjjp.jar\

5、直接运行脚本就是把testjjp类提交到spark集群上运行了。