Spark 开发环境搭建（1）IDEA Gradle的安装部署、使用

Spark 开发环境搭建（1）使用IDEA Gradle的方式

1，JAVA环境检查

 C:\Windows\System32>java -version
java version "1.8.0_121"
Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)

C:\Windows\System32>

2，gradle下载安装

下载地址：https://gradle.org/releases
安装版本：gradle v3.5
下载到本地：G:\1.BeiJingSpark\201704BeiJingSetupTools
将gradle-3.5-all.zip文件解压缩，并将文件复制到E:\Program Files目录下，
进入bin目录E:\Program Files\gradle-3.5-all\gradle-3.5\bin>
验证测试：
E:\Program Files\gradle-3.5-all\gradle-3.5\bin>gradle -version


------------------------------------------------------------
Gradle 3.5
------------------------------------------------------------


Build time:   2017-04-10 13:37:25 UTC
Revision:     b762622a185d59ce0cfc9cbc6ab5dd22469e18a6


Groovy:       2.4.10
Ant:          Apache Ant(TM) version 1.9.6 compiled on June 29 2015
JVM:          1.8.0_121 (Oracle Corporation 25.121-b13)
OS:           Windows 7 6.1 amd64


E:\Program Files\gradle-3.5-all\gradle-3.5\bin>

3， 设置gradle环境变量

我的电脑-高级系统属性-环境变量-设置绝对路径：
GRADLE_HOME  E:\Program Files\gradle-3.5-all\gradle-3.5 
PATH  E:\Program Files\gradle-3.5-all\gradle-3.5\bin; 

4,重启电脑，检查gradle安装成功

C:\Windows\System32>gradle -version


------------------------------------------------------------
Gradle 3.5
------------------------------------------------------------


Build time:   2017-04-10 13:37:25 UTC
Revision:     b762622a185d59ce0cfc9cbc6ab5dd22469e18a6


Groovy:       2.4.10
Ant:          Apache Ant(TM) version 1.9.6 compiled on June 29 2015
JVM:          1.8.0_121 (Oracle Corporation 25.121-b13)
OS:           Windows 7 6.1 amd64


C:\Windows\System32>

5，在IDEA中创建gradle 项目

6，IDEA gradle 使用测试案例

单项目构建的一个例子：

settings.gradle文件：  

rootProject.name = 'SparkUseGradle'
println 'BeiJing This is executed during the initialization phase.'

build.gradle文件配置： 

group 'SparkUseGradle'
version '1.0-SNAPSHOT'
apply plugin: 'java'
sourceCompatibility = 1.5
repositories {
    mavenCentral()
}
dependencies {
    testCompile group: 'junit', name: 'junit', version: '4.11'
}
//////////////////////
println 'BeiJing This is executed during the configuration phase.'
task configured {
    println 'BeiJing This is also executed during the configuration phase.'
}
task BeiJingtest << {
    println 'BeiJing This is executed during the execution phase.'
}
task BeiJingtestBoth {
    doFirst {
        println 'BeiJing This is executed first during the execution phase.'
    }
    doLast {
        println 'BeiJing This is executed last during the execution phase.'
    }
    println 'BeiJing This is executed during the configuration phase as well.'
}
分别在IDEA和windows cmd命令行中运行结果如下：

Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use --status for details
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.
	at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
:help

Welcome to Gradle 3.5.

To run a build, run gradle  ...

To see a list of available tasks, run gradle tasks

To see a list of command-line options, run gradle --help

To see more detail about a task, run gradle help --task 

BUILD SUCCESSFUL

Total time: 10.028 secs

Process finished with exit code 0
在cmd中运行如下：

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle BeiJingtest BeiJingtestB
oth
Starting a Gradle Daemon, 1 incompatible Daemon could not be reused, use --statu
s for details
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
:BeiJingtest
BeiJing This is executed during the execution phase.
:BeiJingtestBoth
BeiJing This is executed first during the execution phase.
BeiJing This is executed last during the execution phase.

BUILD SUCCESSFUL

Total time: 8.68 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

7,Gradle构建基础
    
    
    
    

     
     
     
     
task hello {
    doLast {
        println 'task hello :   Hello world,Hello BeiJing !'
    }
}

//这是快捷写法，用<<替换doLast，后面解释
task hl << {
    println 'task h1 <<:   Hello world!,Welcome to BeiJing!'
}

//创建upper的task，使用Groovy语言编写
task upper << {
    String someString = 'mY_nAmE_beijING'
    println "task upper Original:   " + someString
    println "task Upper case: " + someString.toUpperCase()
}
     
     
     
     

      
      
      
      

     
     
     
     
在windows cmd中分别运行：
     
     
     
     

     
     
     
     
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle upper
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
:upper
task upper Original:   mY_nAmE_beijING
task Upper case: MY_NAME_BEIJING

BUILD SUCCESSFUL

Total time: 2.338 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle hl
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
:hl
task h1 <<:   Hello world!,Welcome to BeiJing!

BUILD SUCCESSFUL

Total time: 2.324 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle hello
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
:hello
task hello :   Hello world,Hello BeiJing !

BUILD SUCCESSFUL

Total time: 2.549 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>
     
     
     
     
在IDEA可以指定运行的脚本任务
    
    
    
    
    
    
    
    

     
     
     
     
     
     
     
     

    
    
    
    

 在idea中运行如下：

BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.
	at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
:upper
task upper Original:   mY_nAmE_beijING
task Upper case: MY_NAME_BEIJING

BUILD SUCCESSFUL

task有无action的区别，如果task没有加<<则这个任务在脚本初始化initialization阶段 被执行，如果加了<<则在gradle actionTask后才执行。如下：

//有Action的task
task actionTask << {
    println 'I am actionTask'
}
//无Action的task
task noActionTask {
    println 'I am noActionTask'
}

在idea中运行如下：

 BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.
	at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:actionTask
I am actionTask

BUILD SUCCESSFUL

Total time: 3.046 secs

Process finished with exit code 0

8，任务task依赖：

一个build.gradle文件中多个task如果互相没有关系，则在gradle命令配置task参数运行；
如果多个任务之间如果有依赖关系，如下：

task taskX(dependsOn: 'taskY') << {
    println 'taskX'
}
task taskY << {
    println 'taskY'
}

在IDEA中运行结果如下：

BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.
	at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:taskY
taskY
:taskX
taskX

BUILD SUCCESSFUL

Total time: 2.839 secs

Process finished with exit code 0

9，动态任务task： 

task count << {
    4.times { print "$it " }
}

4.times { counter ->
    task "task$counter" << {
        println "I'm task number $counter"
    }
}

在idea中运行如下

BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.
	at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:task2
I'm task number 2

在windows cmd中运行

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle task0
Starting a Gradle Daemon, 1 incompatible and 2 stopped Daemons could not be reus
ed, use --status for details
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:task0
I'm task number 0

BUILD SUCCESSFUL

Total time: 8.221 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle task3
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:task3
I'm task number 3

BUILD SUCCESSFUL

Total time: 2.339 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

使用已存在任务task：

4.times { counter ->
    task "task$counter" << {
        println "I'm task number $counter"
    }
}
task0.dependsOn task2, task3

在cmd中运行

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle task0
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:22)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:task2
I'm task number 2
:task3
I'm task number 3
:task0
I'm task number 0

BUILD SUCCESSFUL

Total time: 2.53 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

可以通过API为任务加入一些新行为，如下：

task hello2 << {
    println 'Hello Earth'
}
hello2.doFirst {
    println 'Hello Venus'
}
hello2.doLast {
    println 'Hello Mars'
}
hello2 << {
    println 'Hello Jupiter'
}

在IDEA中运行

:hello2
Hello Venus
Hello Earth
Hello Mars
Hello Jupiter

任务task短标记：：

task hello3 << {
    println 'Hello world!'
}
hello3.doLast {
    println "Greetings from the $hello3.name task."
}

在IDEA中运行

:hello3
Hello world!
Greetings from the hello3 task.

自定义任务task属性：

task myTask {
    ext.myProperty = "myValue"
}

task printTaskProperties << {
    println myTask.myProperty
}

在IDEA中运行

:printTaskProperties
myValue

BUILD SUCCESSFUL

Total time: 3.01 secs

定义默认任务task：

defaultTasks 'clean1', 'run1'

task clean1 << {
    println 'Default Cleaning!'
}

task run1 << {
    println 'Default Running!'
}

task other1 << {
    println "I'm not a default task!"
}

在idea中运行

:clean1
Default Cleaning!
:run1
Default Running!

BUILD SUCCESSFUL

Total time: 2.782 secs

10，Gradle依赖管理基础：

Gradle依赖声明：

group 'SparkUseGradle'
version '1.0-SNAPSHOT'

apply plugin: 'java'

sourceCompatibility = 1.5

repositories {
    mavenCentral()
}

dependencies {
    testCompile group: 'junit', name: 'junit', version: '4.11'
}

compile 
用来编译项目源代码的依赖；

runtime 
在运行时被生成的类需要的依赖，默认项，包含编译时的依赖；

testCompile
编译测试代码依赖，默认项，包含生成的类运行所需的依赖和编译源代码的依赖；


Gradle外部依赖：external dependency：是在当前构建之外的一种依赖，一般存放在远程（Maven）或本地的仓库里。如下是一个外部依赖的例子：

dependencies {
    // https://mvnrepository.com/artifact/org.apache.spark/spark-core_2.11
    compile group: 'org.apache.spark', name: 'spark-core_2.11', version: '2.1.0'
    testCompile group: 'junit', name: 'junit', version: '4.11'
}

保存，自动下载

Gradle仓库：Gradle在一个仓库（repository）里找依赖文件 

repositories {
    mavenCentral()
}

远程库

repositories {
    maven {
        url "http://repo.mycompany.com/maven2"
    }
}

本地文件系统

repositories {
    ivy {
        // URL can refer to a local directory
        url "../local-repo"
    }
}

Gradle发布artifacts：

apply plugin: 'maven'

uploadArchives {
    repositories {
        mavenDeployer {
            repository(url: "file://E:/SparkGradle2017/tmp/myRepo/")
        }
    }
}

Gradle命令
gradle projects命令：列出子项目名称列表。
gradle tasks命令：列出项目中所有任务。
gradle help –task someTask命令：可以显示指定任务的详细信息。
gradle dependencies命令：列出项目的依赖列表，所有依赖会根据任务区分，以树型结构展示。

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle projects
Starting a Gradle Daemon, 1 incompatible and 1 stopped Daemons could not be reus
ed, use --status for details
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:37)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:projects

------------------------------------------------------------
Root project
------------------------------------------------------------

Root project 'SparkUseGradle'
No sub-projects

To see a list of the tasks of a project, run gradle :tasks
For example, try running gradle :tasks

BUILD SUCCESSFUL

Total time: 9.097 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle tasks
BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be re
moved in Gradle 5.0. Please use Task.doLast(Action) instead.
        at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJi
ngWorkSpace2017\build.gradle:37)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:tasks

------------------------------------------------------------
All tasks runnable from root project
------------------------------------------------------------

Default tasks: clean1, run1

Build tasks
-----------
assemble - Assembles the outputs of this project.
build - Assembles and tests this project.
buildDependents - Assembles and tests this project and all projects that depend
on it.
buildNeeded - Assembles and tests this project and all projects it depends on.
classes - Assembles main classes.
clean - Deletes the build directory.
jar - Assembles a jar archive containing the main classes.
testClasses - Assembles test classes.

Build Setup tasks
-----------------
init - Initializes a new Gradle build.
wrapper - Generates Gradle wrapper files.

Documentation tasks
-------------------
javadoc - Generates Javadoc API documentation for the main source code.

Help tasks
----------
buildEnvironment - Displays all buildscript dependencies declared in root projec
t 'SparkUseGradle'.
components - Displays the components produced by root project 'SparkUseGradle'.
[incubating]
dependencies - Displays all dependencies declared in root project 'SparkUseGradl
e'.
dependencyInsight - Displays the insight into a specific dependency in root proj
ect 'SparkUseGradle'.
dependentComponents - Displays the dependent components of components in root pr
oject 'SparkUseGradle'. [incubating]
help - Displays a help message.
model - Displays the configuration model of root project 'SparkUseGradle'. [incu
bating]
projects - Displays the sub-projects of root project 'SparkUseGradle'.
properties - Displays the properties of root project 'SparkUseGradle'.
tasks - Displays the tasks runnable from root project 'SparkUseGradle'.

Upload tasks
------------
uploadArchives - Uploads all artifacts belonging to configuration ':archives'

Verification tasks
------------------
check - Runs all checks.
test - Runs the unit tests.

Rules
-----
Pattern: clean: Cleans the output files of a task.
Pattern: build: Assembles the artifacts of a configuration.
Pattern: upload: Assembles and uploads the artifacts belongin
g to a configuration.

To see all tasks and more detail, run gradle tasks --all

To see more detail about a task, run gradle help --task 

BUILD SUCCESSFUL

Total time: 2.682 secs
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>

 查看依赖关系

G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017>gradle dependencies >d:\2017042
2.txt

依赖关系结果如下

BeiJing This is executed during the initialization phase.
BeiJing This is executed during the configuration phase.
BeiJing This is also executed during the configuration phase.
The Task.leftShift(Closure) method has been deprecated and is scheduled to be removed in Gradle 5.0. Please use Task.doLast(Action) instead.
	at build_cr0krl6jlk6alidgsygy2xps7.run(G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\build.gradle:37)
BeiJing This is executed during the configuration phase as well.
I am noActionTask
:dependencies

------------------------------------------------------------
Root project
------------------------------------------------------------

apiElements - API elements for main. (n)
No dependencies

archives - Configuration for archive artifacts.
No dependencies

compile - Dependencies for source set 'main' (deprecated, use 'implementation ' instead).
\--- org.apache.spark:spark-core_2.11:2.1.0
     +--- org.apache.avro:avro-mapred:1.7.7
     |    +--- org.apache.avro:avro-ipc:1.7.7
     |    |    +--- org.apache.avro:avro:1.7.7
     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
     |    |    |    +--- org.apache.commons:commons-compress:1.4.1
     |    |    |    |    \--- org.tukaani:xz:1.0
     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     +--- com.twitter:chill_2.11:0.8.0
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- com.twitter:chill-java:0.8.0
     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
     |    |         +--- com.esotericsoftware:minlog:1.3.0
     |    |         \--- org.objenesis:objenesis:2.1
     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
     +--- com.twitter:chill-java:0.8.0 (*)
     +--- org.apache.xbean:xbean-asm5-shaded:4.4
     +--- org.apache.hadoop:hadoop-client:2.2.0
     |    +--- org.apache.hadoop:hadoop-common:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- org.apache.commons:commons-math:2.1
     |    |    +--- xmlenc:xmlenc:0.52
     |    |    +--- commons-httpclient:commons-httpclient:3.1
     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-net:commons-net:3.1
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- commons-configuration:commons-configuration:1.6
     |    |    |    +--- commons-collections:commons-collections:3.2.1
     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
     |    |    |    +--- commons-digester:commons-digester:1.8
     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-api:1.7.16
     |    |    |    \--- log4j:log4j:1.2.17
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    +--- commons-codec:commons-codec:1.4
     |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
     |    |    |    \--- jline:jline:0.9.94
     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    \--- xmlenc:xmlenc:0.52
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
     |    |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    |    \--- com.google.inject:guice:3.0
     |    |    |    |    |         +--- javax.inject:javax.inject:1
     |    |    |    |    |         +--- aopalliance:aopalliance:1.0
     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
     +--- org.apache.spark:spark-launcher_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0
     |    |    +--- org.scalatest:scalatest_2.11:2.2.6
     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
     |    |    \--- org.spark-project.spark:unused:1.0.0
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-common_2.11:2.1.0
     |    +--- io.netty:netty-all:4.0.42.Final
     |    +--- org.apache.commons:commons-lang3:3.5
     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2
     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-unsafe_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    +--- com.twitter:chill_2.11:0.8.0 (*)
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- net.java.dev.jets3t:jets3t:0.7.1
     |    +--- commons-codec:commons-codec:1.3 -> 1.4
     |    \--- commons-httpclient:commons-httpclient:3.1 (*)
     +--- org.apache.curator:curator-recipes:2.4.0
     |    +--- org.apache.curator:curator-framework:2.4.0
     |    |    +--- org.apache.curator:curator-client:2.4.0
     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    \--- com.google.guava:guava:14.0.1
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    \--- com.google.guava:guava:14.0.1
     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    \--- com.google.guava:guava:14.0.1
     +--- javax.servlet:javax.servlet-api:3.1.0
     +--- org.apache.commons:commons-lang3:3.5
     +--- org.apache.commons:commons-math3:3.4.1
     +--- com.google.code.findbugs:jsr305:1.3.9
     +--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jul-to-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jcl-over-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- log4j:log4j:1.2.17
     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
     +--- com.ning:compress-lzf:1.0.3
     +--- org.xerial.snappy:snappy-java:1.1.2.6
     +--- net.jpountz.lz4:lz4:1.3.0
     +--- org.roaringbitmap:RoaringBitmap:0.5.11
     +--- commons-net:commons-net:2.2 -> 3.1
     +--- org.scala-lang:scala-library:2.11.8
     +--- org.json4s:json4s-jackson_2.11:3.2.11
     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    +--- org.json4s:json4s-core_2.11:3.2.11
     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
     |    |    \--- org.scala-lang:scalap:2.11.0
     |    |         \--- org.scala-lang:scala-compiler:2.11.0
     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
     +--- org.glassfish.jersey.core:jersey-client:2.22.2
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    |    +--- javax.annotation:javax.annotation-api:1.2
     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
     |    |    |    +--- javax.inject:javax.inject:1
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
     |    |    |    |    \--- javax.inject:javax.inject:1
     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
     |    |    |    \--- org.javassist:javassist:3.18.1-GA
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     +--- org.glassfish.jersey.core:jersey-server:2.22.2
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- javax.annotation:javax.annotation-api:1.2
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    \--- javax.validation:validation-api:1.1.0.Final
     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
     +--- io.netty:netty-all:4.0.42.Final
     +--- io.netty:netty:3.8.0.Final
     +--- com.clearspring.analytics:stream:2.7.0
     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     +--- io.dropwizard.metrics:metrics-jvm:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-json:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-graphite:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |         \--- com.thoughtworks.paranamer:paranamer:2.6
     +--- org.apache.ivy:ivy:2.4.0
     +--- oro:oro:2.0.8
     +--- net.razorvine:pyrolite:4.13
     +--- net.sf.py4j:py4j:0.10.4
     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     +--- org.apache.commons:commons-crypto:1.0.0
     \--- org.spark-project.spark:unused:1.0.0

compileClasspath - Compile classpath for source set 'main'.
\--- org.apache.spark:spark-core_2.11:2.1.0
     +--- org.apache.avro:avro-mapred:1.7.7
     |    +--- org.apache.avro:avro-ipc:1.7.7
     |    |    +--- org.apache.avro:avro:1.7.7
     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
     |    |    |    +--- org.apache.commons:commons-compress:1.4.1
     |    |    |    |    \--- org.tukaani:xz:1.0
     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     +--- com.twitter:chill_2.11:0.8.0
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- com.twitter:chill-java:0.8.0
     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
     |    |         +--- com.esotericsoftware:minlog:1.3.0
     |    |         \--- org.objenesis:objenesis:2.1
     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
     +--- com.twitter:chill-java:0.8.0 (*)
     +--- org.apache.xbean:xbean-asm5-shaded:4.4
     +--- org.apache.hadoop:hadoop-client:2.2.0
     |    +--- org.apache.hadoop:hadoop-common:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- org.apache.commons:commons-math:2.1
     |    |    +--- xmlenc:xmlenc:0.52
     |    |    +--- commons-httpclient:commons-httpclient:3.1
     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-net:commons-net:3.1
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- commons-configuration:commons-configuration:1.6
     |    |    |    +--- commons-collections:commons-collections:3.2.1
     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
     |    |    |    +--- commons-digester:commons-digester:1.8
     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-api:1.7.16
     |    |    |    \--- log4j:log4j:1.2.17
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    +--- commons-codec:commons-codec:1.4
     |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
     |    |    |    \--- jline:jline:0.9.94
     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    \--- xmlenc:xmlenc:0.52
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
     |    |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    |    \--- com.google.inject:guice:3.0
     |    |    |    |    |         +--- javax.inject:javax.inject:1
     |    |    |    |    |         +--- aopalliance:aopalliance:1.0
     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
     +--- org.apache.spark:spark-launcher_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0
     |    |    +--- org.scalatest:scalatest_2.11:2.2.6
     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
     |    |    \--- org.spark-project.spark:unused:1.0.0
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-common_2.11:2.1.0
     |    +--- io.netty:netty-all:4.0.42.Final
     |    +--- org.apache.commons:commons-lang3:3.5
     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2
     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-unsafe_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    +--- com.twitter:chill_2.11:0.8.0 (*)
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- net.java.dev.jets3t:jets3t:0.7.1
     |    +--- commons-codec:commons-codec:1.3 -> 1.4
     |    \--- commons-httpclient:commons-httpclient:3.1 (*)
     +--- org.apache.curator:curator-recipes:2.4.0
     |    +--- org.apache.curator:curator-framework:2.4.0
     |    |    +--- org.apache.curator:curator-client:2.4.0
     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    \--- com.google.guava:guava:14.0.1
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    \--- com.google.guava:guava:14.0.1
     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    \--- com.google.guava:guava:14.0.1
     +--- javax.servlet:javax.servlet-api:3.1.0
     +--- org.apache.commons:commons-lang3:3.5
     +--- org.apache.commons:commons-math3:3.4.1
     +--- com.google.code.findbugs:jsr305:1.3.9
     +--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jul-to-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jcl-over-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- log4j:log4j:1.2.17
     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
     +--- com.ning:compress-lzf:1.0.3
     +--- org.xerial.snappy:snappy-java:1.1.2.6
     +--- net.jpountz.lz4:lz4:1.3.0
     +--- org.roaringbitmap:RoaringBitmap:0.5.11
     +--- commons-net:commons-net:2.2 -> 3.1
     +--- org.scala-lang:scala-library:2.11.8
     +--- org.json4s:json4s-jackson_2.11:3.2.11
     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    +--- org.json4s:json4s-core_2.11:3.2.11
     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
     |    |    \--- org.scala-lang:scalap:2.11.0
     |    |         \--- org.scala-lang:scala-compiler:2.11.0
     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
     +--- org.glassfish.jersey.core:jersey-client:2.22.2
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    |    +--- javax.annotation:javax.annotation-api:1.2
     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
     |    |    |    +--- javax.inject:javax.inject:1
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
     |    |    |    |    \--- javax.inject:javax.inject:1
     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
     |    |    |    \--- org.javassist:javassist:3.18.1-GA
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     +--- org.glassfish.jersey.core:jersey-server:2.22.2
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- javax.annotation:javax.annotation-api:1.2
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    \--- javax.validation:validation-api:1.1.0.Final
     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
     +--- io.netty:netty-all:4.0.42.Final
     +--- io.netty:netty:3.8.0.Final
     +--- com.clearspring.analytics:stream:2.7.0
     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     +--- io.dropwizard.metrics:metrics-jvm:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-json:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-graphite:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |         \--- com.thoughtworks.paranamer:paranamer:2.6
     +--- org.apache.ivy:ivy:2.4.0
     +--- oro:oro:2.0.8
     +--- net.razorvine:pyrolite:4.13
     +--- net.sf.py4j:py4j:0.10.4
     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     +--- org.apache.commons:commons-crypto:1.0.0
     \--- org.spark-project.spark:unused:1.0.0

compileOnly - Compile only dependencies for source set 'main'.
No dependencies

default - Configuration for default artifacts.
\--- org.apache.spark:spark-core_2.11:2.1.0
     +--- org.apache.avro:avro-mapred:1.7.7
     |    +--- org.apache.avro:avro-ipc:1.7.7
     |    |    +--- org.apache.avro:avro:1.7.7
     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
     |    |    |    +--- org.apache.commons:commons-compress:1.4.1
     |    |    |    |    \--- org.tukaani:xz:1.0
     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     +--- com.twitter:chill_2.11:0.8.0
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- com.twitter:chill-java:0.8.0
     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
     |    |         +--- com.esotericsoftware:minlog:1.3.0
     |    |         \--- org.objenesis:objenesis:2.1
     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
     +--- com.twitter:chill-java:0.8.0 (*)
     +--- org.apache.xbean:xbean-asm5-shaded:4.4
     +--- org.apache.hadoop:hadoop-client:2.2.0
     |    +--- org.apache.hadoop:hadoop-common:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- org.apache.commons:commons-math:2.1
     |    |    +--- xmlenc:xmlenc:0.52
     |    |    +--- commons-httpclient:commons-httpclient:3.1
     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-net:commons-net:3.1
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- commons-configuration:commons-configuration:1.6
     |    |    |    +--- commons-collections:commons-collections:3.2.1
     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
     |    |    |    +--- commons-digester:commons-digester:1.8
     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-api:1.7.16
     |    |    |    \--- log4j:log4j:1.2.17
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    +--- commons-codec:commons-codec:1.4
     |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
     |    |    |    \--- jline:jline:0.9.94
     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    \--- xmlenc:xmlenc:0.52
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
     |    |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    |    \--- com.google.inject:guice:3.0
     |    |    |    |    |         +--- javax.inject:javax.inject:1
     |    |    |    |    |         +--- aopalliance:aopalliance:1.0
     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
     +--- org.apache.spark:spark-launcher_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0
     |    |    +--- org.scalatest:scalatest_2.11:2.2.6
     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
     |    |    \--- org.spark-project.spark:unused:1.0.0
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-common_2.11:2.1.0
     |    +--- io.netty:netty-all:4.0.42.Final
     |    +--- org.apache.commons:commons-lang3:3.5
     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2
     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-unsafe_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    +--- com.twitter:chill_2.11:0.8.0 (*)
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- net.java.dev.jets3t:jets3t:0.7.1
     |    +--- commons-codec:commons-codec:1.3 -> 1.4
     |    \--- commons-httpclient:commons-httpclient:3.1 (*)
     +--- org.apache.curator:curator-recipes:2.4.0
     |    +--- org.apache.curator:curator-framework:2.4.0
     |    |    +--- org.apache.curator:curator-client:2.4.0
     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    \--- com.google.guava:guava:14.0.1
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    \--- com.google.guava:guava:14.0.1
     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    \--- com.google.guava:guava:14.0.1
     +--- javax.servlet:javax.servlet-api:3.1.0
     +--- org.apache.commons:commons-lang3:3.5
     +--- org.apache.commons:commons-math3:3.4.1
     +--- com.google.code.findbugs:jsr305:1.3.9
     +--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jul-to-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jcl-over-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- log4j:log4j:1.2.17
     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
     +--- com.ning:compress-lzf:1.0.3
     +--- org.xerial.snappy:snappy-java:1.1.2.6
     +--- net.jpountz.lz4:lz4:1.3.0
     +--- org.roaringbitmap:RoaringBitmap:0.5.11
     +--- commons-net:commons-net:2.2 -> 3.1
     +--- org.scala-lang:scala-library:2.11.8
     +--- org.json4s:json4s-jackson_2.11:3.2.11
     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    +--- org.json4s:json4s-core_2.11:3.2.11
     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
     |    |    \--- org.scala-lang:scalap:2.11.0
     |    |         \--- org.scala-lang:scala-compiler:2.11.0
     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
     +--- org.glassfish.jersey.core:jersey-client:2.22.2
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    |    +--- javax.annotation:javax.annotation-api:1.2
     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
     |    |    |    +--- javax.inject:javax.inject:1
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
     |    |    |    |    \--- javax.inject:javax.inject:1
     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
     |    |    |    \--- org.javassist:javassist:3.18.1-GA
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     +--- org.glassfish.jersey.core:jersey-server:2.22.2
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- javax.annotation:javax.annotation-api:1.2
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    \--- javax.validation:validation-api:1.1.0.Final
     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
     +--- io.netty:netty-all:4.0.42.Final
     +--- io.netty:netty:3.8.0.Final
     +--- com.clearspring.analytics:stream:2.7.0
     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     +--- io.dropwizard.metrics:metrics-jvm:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-json:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-graphite:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |         \--- com.thoughtworks.paranamer:paranamer:2.6
     +--- org.apache.ivy:ivy:2.4.0
     +--- oro:oro:2.0.8
     +--- net.razorvine:pyrolite:4.13
     +--- net.sf.py4j:py4j:0.10.4
     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     +--- org.apache.commons:commons-crypto:1.0.0
     \--- org.spark-project.spark:unused:1.0.0

implementation - Implementation only dependencies for source set 'main'. (n)
No dependencies

runtime - Runtime dependencies for source set 'main' (deprecated, use 'runtimeOnly ' instead).
\--- org.apache.spark:spark-core_2.11:2.1.0
     +--- org.apache.avro:avro-mapred:1.7.7
     |    +--- org.apache.avro:avro-ipc:1.7.7
     |    |    +--- org.apache.avro:avro:1.7.7
     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
     |    |    |    +--- org.apache.commons:commons-compress:1.4.1
     |    |    |    |    \--- org.tukaani:xz:1.0
     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     +--- com.twitter:chill_2.11:0.8.0
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- com.twitter:chill-java:0.8.0
     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
     |    |         +--- com.esotericsoftware:minlog:1.3.0
     |    |         \--- org.objenesis:objenesis:2.1
     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
     +--- com.twitter:chill-java:0.8.0 (*)
     +--- org.apache.xbean:xbean-asm5-shaded:4.4
     +--- org.apache.hadoop:hadoop-client:2.2.0
     |    +--- org.apache.hadoop:hadoop-common:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- org.apache.commons:commons-math:2.1
     |    |    +--- xmlenc:xmlenc:0.52
     |    |    +--- commons-httpclient:commons-httpclient:3.1
     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-net:commons-net:3.1
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- commons-configuration:commons-configuration:1.6
     |    |    |    +--- commons-collections:commons-collections:3.2.1
     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
     |    |    |    +--- commons-digester:commons-digester:1.8
     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-api:1.7.16
     |    |    |    \--- log4j:log4j:1.2.17
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    +--- commons-codec:commons-codec:1.4
     |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
     |    |    |    \--- jline:jline:0.9.94
     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    \--- xmlenc:xmlenc:0.52
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
     |    |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    |    \--- com.google.inject:guice:3.0
     |    |    |    |    |         +--- javax.inject:javax.inject:1
     |    |    |    |    |         +--- aopalliance:aopalliance:1.0
     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
     +--- org.apache.spark:spark-launcher_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0
     |    |    +--- org.scalatest:scalatest_2.11:2.2.6
     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
     |    |    \--- org.spark-project.spark:unused:1.0.0
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-common_2.11:2.1.0
     |    +--- io.netty:netty-all:4.0.42.Final
     |    +--- org.apache.commons:commons-lang3:3.5
     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2
     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-unsafe_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    +--- com.twitter:chill_2.11:0.8.0 (*)
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- net.java.dev.jets3t:jets3t:0.7.1
     |    +--- commons-codec:commons-codec:1.3 -> 1.4
     |    \--- commons-httpclient:commons-httpclient:3.1 (*)
     +--- org.apache.curator:curator-recipes:2.4.0
     |    +--- org.apache.curator:curator-framework:2.4.0
     |    |    +--- org.apache.curator:curator-client:2.4.0
     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    \--- com.google.guava:guava:14.0.1
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    \--- com.google.guava:guava:14.0.1
     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    \--- com.google.guava:guava:14.0.1
     +--- javax.servlet:javax.servlet-api:3.1.0
     +--- org.apache.commons:commons-lang3:3.5
     +--- org.apache.commons:commons-math3:3.4.1
     +--- com.google.code.findbugs:jsr305:1.3.9
     +--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jul-to-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jcl-over-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- log4j:log4j:1.2.17
     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
     +--- com.ning:compress-lzf:1.0.3
     +--- org.xerial.snappy:snappy-java:1.1.2.6
     +--- net.jpountz.lz4:lz4:1.3.0
     +--- org.roaringbitmap:RoaringBitmap:0.5.11
     +--- commons-net:commons-net:2.2 -> 3.1
     +--- org.scala-lang:scala-library:2.11.8
     +--- org.json4s:json4s-jackson_2.11:3.2.11
     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    +--- org.json4s:json4s-core_2.11:3.2.11
     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
     |    |    \--- org.scala-lang:scalap:2.11.0
     |    |         \--- org.scala-lang:scala-compiler:2.11.0
     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
     +--- org.glassfish.jersey.core:jersey-client:2.22.2
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    |    +--- javax.annotation:javax.annotation-api:1.2
     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
     |    |    |    +--- javax.inject:javax.inject:1
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
     |    |    |    |    \--- javax.inject:javax.inject:1
     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
     |    |    |    \--- org.javassist:javassist:3.18.1-GA
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     +--- org.glassfish.jersey.core:jersey-server:2.22.2
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- javax.annotation:javax.annotation-api:1.2
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    \--- javax.validation:validation-api:1.1.0.Final
     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
     +--- io.netty:netty-all:4.0.42.Final
     +--- io.netty:netty:3.8.0.Final
     +--- com.clearspring.analytics:stream:2.7.0
     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     +--- io.dropwizard.metrics:metrics-jvm:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-json:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-graphite:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |         \--- com.thoughtworks.paranamer:paranamer:2.6
     +--- org.apache.ivy:ivy:2.4.0
     +--- oro:oro:2.0.8
     +--- net.razorvine:pyrolite:4.13
     +--- net.sf.py4j:py4j:0.10.4
     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     +--- org.apache.commons:commons-crypto:1.0.0
     \--- org.spark-project.spark:unused:1.0.0

runtimeClasspath - Runtime classpath of source set 'main'.
\--- org.apache.spark:spark-core_2.11:2.1.0
     +--- org.apache.avro:avro-mapred:1.7.7
     |    +--- org.apache.avro:avro-ipc:1.7.7
     |    |    +--- org.apache.avro:avro:1.7.7
     |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
     |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
     |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
     |    |    |    +--- org.apache.commons:commons-compress:1.4.1
     |    |    |    |    \--- org.tukaani:xz:1.0
     |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
     |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
     |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     +--- com.twitter:chill_2.11:0.8.0
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- com.twitter:chill-java:0.8.0
     |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
     |    |         +--- com.esotericsoftware:minlog:1.3.0
     |    |         \--- org.objenesis:objenesis:2.1
     |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
     +--- com.twitter:chill-java:0.8.0 (*)
     +--- org.apache.xbean:xbean-asm5-shaded:4.4
     +--- org.apache.hadoop:hadoop-client:2.2.0
     |    +--- org.apache.hadoop:hadoop-common:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- org.apache.commons:commons-math:2.1
     |    |    +--- xmlenc:xmlenc:0.52
     |    |    +--- commons-httpclient:commons-httpclient:3.1
     |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-net:commons-net:3.1
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- commons-configuration:commons-configuration:1.6
     |    |    |    +--- commons-collections:commons-collections:3.2.1
     |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
     |    |    |    +--- commons-digester:commons-digester:1.8
     |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
     |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-api:1.7.16
     |    |    |    \--- log4j:log4j:1.2.17
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    +--- commons-codec:commons-codec:1.4
     |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
     |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
     |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
     |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
     |    |    |    \--- jline:jline:0.9.94
     |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
     |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
     |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
     |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
     |    |    +--- commons-cli:commons-cli:1.2
     |    |    +--- commons-codec:commons-codec:1.4
     |    |    +--- commons-io:commons-io:2.1
     |    |    +--- commons-lang:commons-lang:2.5
     |    |    +--- log4j:log4j:1.2.17
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
     |    |    \--- xmlenc:xmlenc:0.52
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
     |    |    |    |    +--- log4j:log4j:1.2.17
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
     |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    |    \--- com.google.inject:guice:3.0
     |    |    |    |    |         +--- javax.inject:javax.inject:1
     |    |    |    |    |         +--- aopalliance:aopalliance:1.0
     |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
     |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
     |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
     |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
     |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    |    +--- commons-io:commons-io:2.1
     |    |    |    |    \--- com.google.inject:guice:3.0 (*)
     |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
     |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
     |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
     |    |    +--- com.google.protobuf:protobuf-java:2.5.0
     |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
     |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
     |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
     +--- org.apache.spark:spark-launcher_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0
     |    |    +--- org.scalatest:scalatest_2.11:2.2.6
     |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
     |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
     |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
     |    |    \--- org.spark-project.spark:unused:1.0.0
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-common_2.11:2.1.0
     |    +--- io.netty:netty-all:4.0.42.Final
     |    +--- org.apache.commons:commons-lang3:3.5
     |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
     |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
     |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
     |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2
     |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- org.apache.spark:spark-unsafe_2.11:2.1.0
     |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     |    +--- com.twitter:chill_2.11:0.8.0 (*)
     |    +--- com.google.code.findbugs:jsr305:1.3.9
     |    \--- org.spark-project.spark:unused:1.0.0
     +--- net.java.dev.jets3t:jets3t:0.7.1
     |    +--- commons-codec:commons-codec:1.3 -> 1.4
     |    \--- commons-httpclient:commons-httpclient:3.1 (*)
     +--- org.apache.curator:curator-recipes:2.4.0
     |    +--- org.apache.curator:curator-framework:2.4.0
     |    |    +--- org.apache.curator:curator-client:2.4.0
     |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
     |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    |    \--- com.google.guava:guava:14.0.1
     |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    |    \--- com.google.guava:guava:14.0.1
     |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
     |    \--- com.google.guava:guava:14.0.1
     +--- javax.servlet:javax.servlet-api:3.1.0
     +--- org.apache.commons:commons-lang3:3.5
     +--- org.apache.commons:commons-math3:3.4.1
     +--- com.google.code.findbugs:jsr305:1.3.9
     +--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jul-to-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- org.slf4j:jcl-over-slf4j:1.7.16
     |    \--- org.slf4j:slf4j-api:1.7.16
     +--- log4j:log4j:1.2.17
     +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
     +--- com.ning:compress-lzf:1.0.3
     +--- org.xerial.snappy:snappy-java:1.1.2.6
     +--- net.jpountz.lz4:lz4:1.3.0
     +--- org.roaringbitmap:RoaringBitmap:0.5.11
     +--- commons-net:commons-net:2.2 -> 3.1
     +--- org.scala-lang:scala-library:2.11.8
     +--- org.json4s:json4s-jackson_2.11:3.2.11
     |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    +--- org.json4s:json4s-core_2.11:3.2.11
     |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
     |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
     |    |    \--- org.scala-lang:scalap:2.11.0
     |    |         \--- org.scala-lang:scala-compiler:2.11.0
     |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
     |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
     |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
     |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
     |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
     +--- org.glassfish.jersey.core:jersey-client:2.22.2
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
     |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    |    +--- javax.annotation:javax.annotation-api:1.2
     |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
     |    |    |    +--- javax.inject:javax.inject:1
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
     |    |    |    |    \--- javax.inject:javax.inject:1
     |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
     |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
     |    |    |    \--- org.javassist:javassist:3.18.1-GA
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     +--- org.glassfish.jersey.core:jersey-server:2.22.2
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
     |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
     |    +--- javax.annotation:javax.annotation-api:1.2
     |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
     |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
     |    \--- javax.validation:validation-api:1.1.0.Final
     +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
     |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
     |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
     |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
     |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
     |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
     +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
     +--- io.netty:netty-all:4.0.42.Final
     +--- io.netty:netty:3.8.0.Final
     +--- com.clearspring.analytics:stream:2.7.0
     +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     +--- io.dropwizard.metrics:metrics-jvm:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-json:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- io.dropwizard.metrics:metrics-graphite:3.1.2
     |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
     |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
     +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
     |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
     |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
     |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
     |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
     |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
     |         \--- com.thoughtworks.paranamer:paranamer:2.6
     +--- org.apache.ivy:ivy:2.4.0
     +--- oro:oro:2.0.8
     +--- net.razorvine:pyrolite:4.13
     +--- net.sf.py4j:py4j:0.10.4
     +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
     +--- org.apache.commons:commons-crypto:1.0.0
     \--- org.spark-project.spark:unused:1.0.0

runtimeElements - Elements of runtime for main. (n)
No dependencies

runtimeOnly - Runtime only dependencies for source set 'main'. (n)
No dependencies

testCompile - Dependencies for source set 'test' (deprecated, use 'testImplementation ' instead).
+--- org.apache.spark:spark-core_2.11:2.1.0
|    +--- org.apache.avro:avro-mapred:1.7.7
|    |    +--- org.apache.avro:avro-ipc:1.7.7
|    |    |    +--- org.apache.avro:avro:1.7.7
|    |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
|    |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
|    |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
|    |    |    |    +--- org.apache.commons:commons-compress:1.4.1
|    |    |    |    |    \--- org.tukaani:xz:1.0
|    |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
|    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
|    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    +--- com.twitter:chill_2.11:0.8.0
|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    +--- com.twitter:chill-java:0.8.0
|    |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
|    |    |         +--- com.esotericsoftware:minlog:1.3.0
|    |    |         \--- org.objenesis:objenesis:2.1
|    |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
|    +--- com.twitter:chill-java:0.8.0 (*)
|    +--- org.apache.xbean:xbean-asm5-shaded:4.4
|    +--- org.apache.hadoop:hadoop-client:2.2.0
|    |    +--- org.apache.hadoop:hadoop-common:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
|    |    |    +--- commons-cli:commons-cli:1.2
|    |    |    +--- org.apache.commons:commons-math:2.1
|    |    |    +--- xmlenc:xmlenc:0.52
|    |    |    +--- commons-httpclient:commons-httpclient:3.1
|    |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
|    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    +--- commons-io:commons-io:2.1
|    |    |    +--- commons-net:commons-net:3.1
|    |    |    +--- log4j:log4j:1.2.17
|    |    |    +--- commons-lang:commons-lang:2.5
|    |    |    +--- commons-configuration:commons-configuration:1.6
|    |    |    |    +--- commons-collections:commons-collections:3.2.1
|    |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
|    |    |    |    +--- commons-digester:commons-digester:1.8
|    |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
|    |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.16
|    |    |    |    \--- log4j:log4j:1.2.17
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
|    |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    |    +--- log4j:log4j:1.2.17
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
|    |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
|    |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
|    |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
|    |    |    |    \--- jline:jline:0.9.94
|    |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
|    |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
|    |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
|    |    |    +--- commons-cli:commons-cli:1.2
|    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    +--- commons-io:commons-io:2.1
|    |    |    +--- commons-lang:commons-lang:2.5
|    |    |    +--- log4j:log4j:1.2.17
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
|    |    |    \--- xmlenc:xmlenc:0.52
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
|    |    |    |    |    +--- log4j:log4j:1.2.17
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
|    |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    |    \--- com.google.inject:guice:3.0
|    |    |    |    |    |         +--- javax.inject:javax.inject:1
|    |    |    |    |    |         +--- aopalliance:aopalliance:1.0
|    |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
|    +--- org.apache.spark:spark-launcher_2.11:2.1.0
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0
|    |    |    +--- org.scalatest:scalatest_2.11:2.2.6
|    |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
|    |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
|    |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
|    |    |    \--- org.spark-project.spark:unused:1.0.0
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-network-common_2.11:2.1.0
|    |    +--- io.netty:netty-all:4.0.42.Final
|    |    +--- org.apache.commons:commons-lang3:3.5
|    |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
|    |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
|    |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
|    |    +--- com.google.code.findbugs:jsr305:1.3.9
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
|    |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2
|    |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-unsafe_2.11:2.1.0
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    +--- com.twitter:chill_2.11:0.8.0 (*)
|    |    +--- com.google.code.findbugs:jsr305:1.3.9
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- net.java.dev.jets3t:jets3t:0.7.1
|    |    +--- commons-codec:commons-codec:1.3 -> 1.4
|    |    \--- commons-httpclient:commons-httpclient:3.1 (*)
|    +--- org.apache.curator:curator-recipes:2.4.0
|    |    +--- org.apache.curator:curator-framework:2.4.0
|    |    |    +--- org.apache.curator:curator-client:2.4.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    |    \--- com.google.guava:guava:14.0.1
|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    \--- com.google.guava:guava:14.0.1
|    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    \--- com.google.guava:guava:14.0.1
|    +--- javax.servlet:javax.servlet-api:3.1.0
|    +--- org.apache.commons:commons-lang3:3.5
|    +--- org.apache.commons:commons-math3:3.4.1
|    +--- com.google.code.findbugs:jsr305:1.3.9
|    +--- org.slf4j:slf4j-api:1.7.16
|    +--- org.slf4j:jul-to-slf4j:1.7.16
|    |    \--- org.slf4j:slf4j-api:1.7.16
|    +--- org.slf4j:jcl-over-slf4j:1.7.16
|    |    \--- org.slf4j:slf4j-api:1.7.16
|    +--- log4j:log4j:1.2.17
|    +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
|    +--- com.ning:compress-lzf:1.0.3
|    +--- org.xerial.snappy:snappy-java:1.1.2.6
|    +--- net.jpountz.lz4:lz4:1.3.0
|    +--- org.roaringbitmap:RoaringBitmap:0.5.11
|    +--- commons-net:commons-net:2.2 -> 3.1
|    +--- org.scala-lang:scala-library:2.11.8
|    +--- org.json4s:json4s-jackson_2.11:3.2.11
|    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    +--- org.json4s:json4s-core_2.11:3.2.11
|    |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
|    |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
|    |    |    \--- org.scala-lang:scalap:2.11.0
|    |    |         \--- org.scala-lang:scala-compiler:2.11.0
|    |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
|    |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
|    |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
|    |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
|    +--- org.glassfish.jersey.core:jersey-client:2.22.2
|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
|    |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    |    +--- javax.annotation:javax.annotation-api:1.2
|    |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
|    |    |    |    +--- javax.inject:javax.inject:1
|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
|    |    |    |    |    \--- javax.inject:javax.inject:1
|    |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
|    |    |    |    \--- org.javassist:javassist:3.18.1-GA
|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    +--- org.glassfish.jersey.core:jersey-server:2.22.2
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
|    |    +--- javax.annotation:javax.annotation-api:1.2
|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    |    \--- javax.validation:validation-api:1.1.0.Final
|    +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
|    |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
|    |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
|    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
|    +--- io.netty:netty-all:4.0.42.Final
|    +--- io.netty:netty:3.8.0.Final
|    +--- com.clearspring.analytics:stream:2.7.0
|    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    +--- io.dropwizard.metrics:metrics-jvm:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- io.dropwizard.metrics:metrics-json:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- io.dropwizard.metrics:metrics-graphite:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
|    |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
|    |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    |         \--- com.thoughtworks.paranamer:paranamer:2.6
|    +--- org.apache.ivy:ivy:2.4.0
|    +--- oro:oro:2.0.8
|    +--- net.razorvine:pyrolite:4.13
|    +--- net.sf.py4j:py4j:0.10.4
|    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    +--- org.apache.commons:commons-crypto:1.0.0
|    \--- org.spark-project.spark:unused:1.0.0
\--- junit:junit:4.11
     \--- org.hamcrest:hamcrest-core:1.3

testCompileClasspath - Compile classpath for source set 'test'.
+--- org.apache.spark:spark-core_2.11:2.1.0
|    +--- org.apache.avro:avro-mapred:1.7.7
|    |    +--- org.apache.avro:avro-ipc:1.7.7
|    |    |    +--- org.apache.avro:avro:1.7.7
|    |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
|    |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
|    |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
|    |    |    |    +--- org.apache.commons:commons-compress:1.4.1
|    |    |    |    |    \--- org.tukaani:xz:1.0
|    |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
|    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
|    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    +--- com.twitter:chill_2.11:0.8.0
|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    +--- com.twitter:chill-java:0.8.0
|    |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
|    |    |         +--- com.esotericsoftware:minlog:1.3.0
|    |    |         \--- org.objenesis:objenesis:2.1
|    |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
|    +--- com.twitter:chill-java:0.8.0 (*)
|    +--- org.apache.xbean:xbean-asm5-shaded:4.4
|    +--- org.apache.hadoop:hadoop-client:2.2.0
|    |    +--- org.apache.hadoop:hadoop-common:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
|    |    |    +--- commons-cli:commons-cli:1.2
|    |    |    +--- org.apache.commons:commons-math:2.1
|    |    |    +--- xmlenc:xmlenc:0.52
|    |    |    +--- commons-httpclient:commons-httpclient:3.1
|    |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
|    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    +--- commons-io:commons-io:2.1
|    |    |    +--- commons-net:commons-net:3.1
|    |    |    +--- log4j:log4j:1.2.17
|    |    |    +--- commons-lang:commons-lang:2.5
|    |    |    +--- commons-configuration:commons-configuration:1.6
|    |    |    |    +--- commons-collections:commons-collections:3.2.1
|    |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
|    |    |    |    +--- commons-digester:commons-digester:1.8
|    |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
|    |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.16
|    |    |    |    \--- log4j:log4j:1.2.17
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
|    |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    |    +--- log4j:log4j:1.2.17
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
|    |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
|    |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
|    |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
|    |    |    |    \--- jline:jline:0.9.94
|    |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
|    |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
|    |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
|    |    |    +--- commons-cli:commons-cli:1.2
|    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    +--- commons-io:commons-io:2.1
|    |    |    +--- commons-lang:commons-lang:2.5
|    |    |    +--- log4j:log4j:1.2.17
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
|    |    |    \--- xmlenc:xmlenc:0.52
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
|    |    |    |    |    +--- log4j:log4j:1.2.17
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
|    |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    |    \--- com.google.inject:guice:3.0
|    |    |    |    |    |         +--- javax.inject:javax.inject:1
|    |    |    |    |    |         +--- aopalliance:aopalliance:1.0
|    |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
|    +--- org.apache.spark:spark-launcher_2.11:2.1.0
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0
|    |    |    +--- org.scalatest:scalatest_2.11:2.2.6
|    |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
|    |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
|    |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
|    |    |    \--- org.spark-project.spark:unused:1.0.0
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-network-common_2.11:2.1.0
|    |    +--- io.netty:netty-all:4.0.42.Final
|    |    +--- org.apache.commons:commons-lang3:3.5
|    |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
|    |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
|    |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
|    |    +--- com.google.code.findbugs:jsr305:1.3.9
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
|    |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2
|    |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-unsafe_2.11:2.1.0
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    +--- com.twitter:chill_2.11:0.8.0 (*)
|    |    +--- com.google.code.findbugs:jsr305:1.3.9
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- net.java.dev.jets3t:jets3t:0.7.1
|    |    +--- commons-codec:commons-codec:1.3 -> 1.4
|    |    \--- commons-httpclient:commons-httpclient:3.1 (*)
|    +--- org.apache.curator:curator-recipes:2.4.0
|    |    +--- org.apache.curator:curator-framework:2.4.0
|    |    |    +--- org.apache.curator:curator-client:2.4.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    |    \--- com.google.guava:guava:14.0.1
|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    \--- com.google.guava:guava:14.0.1
|    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    \--- com.google.guava:guava:14.0.1
|    +--- javax.servlet:javax.servlet-api:3.1.0
|    +--- org.apache.commons:commons-lang3:3.5
|    +--- org.apache.commons:commons-math3:3.4.1
|    +--- com.google.code.findbugs:jsr305:1.3.9
|    +--- org.slf4j:slf4j-api:1.7.16
|    +--- org.slf4j:jul-to-slf4j:1.7.16
|    |    \--- org.slf4j:slf4j-api:1.7.16
|    +--- org.slf4j:jcl-over-slf4j:1.7.16
|    |    \--- org.slf4j:slf4j-api:1.7.16
|    +--- log4j:log4j:1.2.17
|    +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
|    +--- com.ning:compress-lzf:1.0.3
|    +--- org.xerial.snappy:snappy-java:1.1.2.6
|    +--- net.jpountz.lz4:lz4:1.3.0
|    +--- org.roaringbitmap:RoaringBitmap:0.5.11
|    +--- commons-net:commons-net:2.2 -> 3.1
|    +--- org.scala-lang:scala-library:2.11.8
|    +--- org.json4s:json4s-jackson_2.11:3.2.11
|    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    +--- org.json4s:json4s-core_2.11:3.2.11
|    |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
|    |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
|    |    |    \--- org.scala-lang:scalap:2.11.0
|    |    |         \--- org.scala-lang:scala-compiler:2.11.0
|    |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
|    |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
|    |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
|    |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
|    +--- org.glassfish.jersey.core:jersey-client:2.22.2
|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
|    |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    |    +--- javax.annotation:javax.annotation-api:1.2
|    |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
|    |    |    |    +--- javax.inject:javax.inject:1
|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
|    |    |    |    |    \--- javax.inject:javax.inject:1
|    |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
|    |    |    |    \--- org.javassist:javassist:3.18.1-GA
|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    +--- org.glassfish.jersey.core:jersey-server:2.22.2
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
|    |    +--- javax.annotation:javax.annotation-api:1.2
|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    |    \--- javax.validation:validation-api:1.1.0.Final
|    +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
|    |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
|    |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
|    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
|    +--- io.netty:netty-all:4.0.42.Final
|    +--- io.netty:netty:3.8.0.Final
|    +--- com.clearspring.analytics:stream:2.7.0
|    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    +--- io.dropwizard.metrics:metrics-jvm:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- io.dropwizard.metrics:metrics-json:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- io.dropwizard.metrics:metrics-graphite:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
|    |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
|    |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    |         \--- com.thoughtworks.paranamer:paranamer:2.6
|    +--- org.apache.ivy:ivy:2.4.0
|    +--- oro:oro:2.0.8
|    +--- net.razorvine:pyrolite:4.13
|    +--- net.sf.py4j:py4j:0.10.4
|    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    +--- org.apache.commons:commons-crypto:1.0.0
|    \--- org.spark-project.spark:unused:1.0.0
\--- junit:junit:4.11
     \--- org.hamcrest:hamcrest-core:1.3

testCompileOnly - Compile only dependencies for source set 'test'.
No dependencies

testImplementation - Implementation only dependencies for source set 'test'. (n)
No dependencies

testRuntime - Runtime dependencies for source set 'test' (deprecated, use 'testRuntimeOnly ' instead).
+--- org.apache.spark:spark-core_2.11:2.1.0
|    +--- org.apache.avro:avro-mapred:1.7.7
|    |    +--- org.apache.avro:avro-ipc:1.7.7
|    |    |    +--- org.apache.avro:avro:1.7.7
|    |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
|    |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
|    |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
|    |    |    |    +--- org.apache.commons:commons-compress:1.4.1
|    |    |    |    |    \--- org.tukaani:xz:1.0
|    |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
|    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
|    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    +--- com.twitter:chill_2.11:0.8.0
|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    +--- com.twitter:chill-java:0.8.0
|    |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
|    |    |         +--- com.esotericsoftware:minlog:1.3.0
|    |    |         \--- org.objenesis:objenesis:2.1
|    |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
|    +--- com.twitter:chill-java:0.8.0 (*)
|    +--- org.apache.xbean:xbean-asm5-shaded:4.4
|    +--- org.apache.hadoop:hadoop-client:2.2.0
|    |    +--- org.apache.hadoop:hadoop-common:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
|    |    |    +--- commons-cli:commons-cli:1.2
|    |    |    +--- org.apache.commons:commons-math:2.1
|    |    |    +--- xmlenc:xmlenc:0.52
|    |    |    +--- commons-httpclient:commons-httpclient:3.1
|    |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
|    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    +--- commons-io:commons-io:2.1
|    |    |    +--- commons-net:commons-net:3.1
|    |    |    +--- log4j:log4j:1.2.17
|    |    |    +--- commons-lang:commons-lang:2.5
|    |    |    +--- commons-configuration:commons-configuration:1.6
|    |    |    |    +--- commons-collections:commons-collections:3.2.1
|    |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
|    |    |    |    +--- commons-digester:commons-digester:1.8
|    |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
|    |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.16
|    |    |    |    \--- log4j:log4j:1.2.17
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
|    |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    |    +--- log4j:log4j:1.2.17
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
|    |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
|    |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
|    |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
|    |    |    |    \--- jline:jline:0.9.94
|    |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
|    |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
|    |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
|    |    |    +--- commons-cli:commons-cli:1.2
|    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    +--- commons-io:commons-io:2.1
|    |    |    +--- commons-lang:commons-lang:2.5
|    |    |    +--- log4j:log4j:1.2.17
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
|    |    |    \--- xmlenc:xmlenc:0.52
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
|    |    |    |    |    +--- log4j:log4j:1.2.17
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
|    |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    |    \--- com.google.inject:guice:3.0
|    |    |    |    |    |         +--- javax.inject:javax.inject:1
|    |    |    |    |    |         +--- aopalliance:aopalliance:1.0
|    |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
|    +--- org.apache.spark:spark-launcher_2.11:2.1.0
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0
|    |    |    +--- org.scalatest:scalatest_2.11:2.2.6
|    |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
|    |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
|    |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
|    |    |    \--- org.spark-project.spark:unused:1.0.0
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-network-common_2.11:2.1.0
|    |    +--- io.netty:netty-all:4.0.42.Final
|    |    +--- org.apache.commons:commons-lang3:3.5
|    |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
|    |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
|    |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
|    |    +--- com.google.code.findbugs:jsr305:1.3.9
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
|    |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2
|    |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-unsafe_2.11:2.1.0
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    +--- com.twitter:chill_2.11:0.8.0 (*)
|    |    +--- com.google.code.findbugs:jsr305:1.3.9
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- net.java.dev.jets3t:jets3t:0.7.1
|    |    +--- commons-codec:commons-codec:1.3 -> 1.4
|    |    \--- commons-httpclient:commons-httpclient:3.1 (*)
|    +--- org.apache.curator:curator-recipes:2.4.0
|    |    +--- org.apache.curator:curator-framework:2.4.0
|    |    |    +--- org.apache.curator:curator-client:2.4.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    |    \--- com.google.guava:guava:14.0.1
|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    \--- com.google.guava:guava:14.0.1
|    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    \--- com.google.guava:guava:14.0.1
|    +--- javax.servlet:javax.servlet-api:3.1.0
|    +--- org.apache.commons:commons-lang3:3.5
|    +--- org.apache.commons:commons-math3:3.4.1
|    +--- com.google.code.findbugs:jsr305:1.3.9
|    +--- org.slf4j:slf4j-api:1.7.16
|    +--- org.slf4j:jul-to-slf4j:1.7.16
|    |    \--- org.slf4j:slf4j-api:1.7.16
|    +--- org.slf4j:jcl-over-slf4j:1.7.16
|    |    \--- org.slf4j:slf4j-api:1.7.16
|    +--- log4j:log4j:1.2.17
|    +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
|    +--- com.ning:compress-lzf:1.0.3
|    +--- org.xerial.snappy:snappy-java:1.1.2.6
|    +--- net.jpountz.lz4:lz4:1.3.0
|    +--- org.roaringbitmap:RoaringBitmap:0.5.11
|    +--- commons-net:commons-net:2.2 -> 3.1
|    +--- org.scala-lang:scala-library:2.11.8
|    +--- org.json4s:json4s-jackson_2.11:3.2.11
|    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    +--- org.json4s:json4s-core_2.11:3.2.11
|    |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
|    |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
|    |    |    \--- org.scala-lang:scalap:2.11.0
|    |    |         \--- org.scala-lang:scala-compiler:2.11.0
|    |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
|    |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
|    |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
|    |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
|    +--- org.glassfish.jersey.core:jersey-client:2.22.2
|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
|    |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    |    +--- javax.annotation:javax.annotation-api:1.2
|    |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
|    |    |    |    +--- javax.inject:javax.inject:1
|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
|    |    |    |    |    \--- javax.inject:javax.inject:1
|    |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
|    |    |    |    \--- org.javassist:javassist:3.18.1-GA
|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    +--- org.glassfish.jersey.core:jersey-server:2.22.2
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
|    |    +--- javax.annotation:javax.annotation-api:1.2
|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    |    \--- javax.validation:validation-api:1.1.0.Final
|    +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
|    |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
|    |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
|    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
|    +--- io.netty:netty-all:4.0.42.Final
|    +--- io.netty:netty:3.8.0.Final
|    +--- com.clearspring.analytics:stream:2.7.0
|    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    +--- io.dropwizard.metrics:metrics-jvm:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- io.dropwizard.metrics:metrics-json:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- io.dropwizard.metrics:metrics-graphite:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
|    |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
|    |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    |         \--- com.thoughtworks.paranamer:paranamer:2.6
|    +--- org.apache.ivy:ivy:2.4.0
|    +--- oro:oro:2.0.8
|    +--- net.razorvine:pyrolite:4.13
|    +--- net.sf.py4j:py4j:0.10.4
|    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    +--- org.apache.commons:commons-crypto:1.0.0
|    \--- org.spark-project.spark:unused:1.0.0
\--- junit:junit:4.11
     \--- org.hamcrest:hamcrest-core:1.3

testRuntimeClasspath - Runtime classpath of source set 'test'.
+--- org.apache.spark:spark-core_2.11:2.1.0
|    +--- org.apache.avro:avro-mapred:1.7.7
|    |    +--- org.apache.avro:avro-ipc:1.7.7
|    |    |    +--- org.apache.avro:avro:1.7.7
|    |    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13
|    |    |    |    |    \--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    |    +--- com.thoughtworks.paranamer:paranamer:2.3 -> 2.6
|    |    |    |    +--- org.xerial.snappy:snappy-java:1.0.5 -> 1.1.2.6
|    |    |    |    +--- org.apache.commons:commons-compress:1.4.1
|    |    |    |    |    \--- org.tukaani:xz:1.0
|    |    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
|    |    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    +--- org.codehaus.jackson:jackson-core-asl:1.9.13
|    |    +--- org.codehaus.jackson:jackson-mapper-asl:1.9.13 (*)
|    |    \--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    +--- com.twitter:chill_2.11:0.8.0
|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    +--- com.twitter:chill-java:0.8.0
|    |    |    \--- com.esotericsoftware:kryo-shaded:3.0.3
|    |    |         +--- com.esotericsoftware:minlog:1.3.0
|    |    |         \--- org.objenesis:objenesis:2.1
|    |    \--- com.esotericsoftware:kryo-shaded:3.0.3 (*)
|    +--- com.twitter:chill-java:0.8.0 (*)
|    +--- org.apache.xbean:xbean-asm5-shaded:4.4
|    +--- org.apache.hadoop:hadoop-client:2.2.0
|    |    +--- org.apache.hadoop:hadoop-common:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-annotations:2.2.0
|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
|    |    |    +--- commons-cli:commons-cli:1.2
|    |    |    +--- org.apache.commons:commons-math:2.1
|    |    |    +--- xmlenc:xmlenc:0.52
|    |    |    +--- commons-httpclient:commons-httpclient:3.1
|    |    |    |    \--- commons-codec:commons-codec:1.2 -> 1.4
|    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    +--- commons-io:commons-io:2.1
|    |    |    +--- commons-net:commons-net:3.1
|    |    |    +--- log4j:log4j:1.2.17
|    |    |    +--- commons-lang:commons-lang:2.5
|    |    |    +--- commons-configuration:commons-configuration:1.6
|    |    |    |    +--- commons-collections:commons-collections:3.2.1
|    |    |    |    +--- commons-lang:commons-lang:2.4 -> 2.5
|    |    |    |    +--- commons-digester:commons-digester:1.8
|    |    |    |    |    \--- commons-beanutils:commons-beanutils:1.7.0
|    |    |    |    \--- commons-beanutils:commons-beanutils-core:1.8.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.16
|    |    |    |    \--- log4j:log4j:1.2.17
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
|    |    |    +--- org.apache.avro:avro:1.7.4 -> 1.7.7 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.apache.hadoop:hadoop-auth:2.2.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    |    +--- log4j:log4j:1.2.17
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5
|    |    |    |    +--- org.slf4j:slf4j-api:1.6.1 -> 1.7.16
|    |    |    |    +--- org.slf4j:slf4j-log4j12:1.6.1 -> 1.7.16 (*)
|    |    |    |    +--- log4j:log4j:1.2.15 -> 1.2.17
|    |    |    |    \--- jline:jline:0.9.94
|    |    |    \--- org.apache.commons:commons-compress:1.4.1 (*)
|    |    +--- org.apache.hadoop:hadoop-hdfs:2.2.0
|    |    |    +--- com.google.guava:guava:11.0.2 -> 14.0.1
|    |    |    +--- org.mortbay.jetty:jetty-util:6.1.26
|    |    |    +--- commons-cli:commons-cli:1.2
|    |    |    +--- commons-codec:commons-codec:1.4
|    |    |    +--- commons-io:commons-io:2.1
|    |    |    +--- commons-lang:commons-lang:2.5
|    |    |    +--- log4j:log4j:1.2.17
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.codehaus.jackson:jackson-core-asl:1.8.8 -> 1.9.13
|    |    |    \--- xmlenc:xmlenc:0.52
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-app:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0
|    |    |    |    |    +--- log4j:log4j:1.2.17
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0
|    |    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    |    \--- com.google.inject:guice:3.0
|    |    |    |    |    |         +--- javax.inject:javax.inject:1
|    |    |    |    |    |         +--- aopalliance:aopalliance:1.0
|    |    |    |    |    |         \--- org.sonatype.sisu.inject:cglib:2.2.1-v20090111
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-client:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-common:2.2.0 (*)
|    |    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0
|    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-nodemanager:2.2.0
|    |    |    |    |    +--- org.apache.hadoop:hadoop-yarn-server-common:2.2.0 (*)
|    |    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    |    +--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    |    +--- commons-io:commons-io:2.1
|    |    |    |    |    \--- com.google.inject:guice:3.0 (*)
|    |    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
|    |    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    +--- org.apache.hadoop:hadoop-yarn-api:2.2.0 (*)
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-core:2.2.0 (*)
|    |    +--- org.apache.hadoop:hadoop-mapreduce-client-jobclient:2.2.0
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-common:2.2.0 (*)
|    |    |    +--- org.apache.hadoop:hadoop-mapreduce-client-shuffle:2.2.0 (*)
|    |    |    +--- com.google.protobuf:protobuf-java:2.5.0
|    |    |    +--- org.slf4j:slf4j-api:1.7.5 -> 1.7.16
|    |    |    \--- org.slf4j:slf4j-log4j12:1.7.5 -> 1.7.16 (*)
|    |    \--- org.apache.hadoop:hadoop-annotations:2.2.0
|    +--- org.apache.spark:spark-launcher_2.11:2.1.0
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0
|    |    |    +--- org.scalatest:scalatest_2.11:2.2.6
|    |    |    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    |    |    +--- org.scala-lang:scala-reflect:2.11.7
|    |    |    |    |    \--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    |    |    \--- org.scala-lang.modules:scala-xml_2.11:1.0.2
|    |    |    |         \--- org.scala-lang:scala-library:2.11.1 -> 2.11.8
|    |    |    \--- org.spark-project.spark:unused:1.0.0
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-network-common_2.11:2.1.0
|    |    +--- io.netty:netty-all:4.0.42.Final
|    |    +--- org.apache.commons:commons-lang3:3.5
|    |    +--- org.fusesource.leveldbjni:leveldbjni-all:1.8
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5
|    |    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.0 -> 2.6.5
|    |    |    \--- com.fasterxml.jackson.core:jackson-core:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
|    |    +--- com.google.code.findbugs:jsr305:1.3.9
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-network-shuffle_2.11:2.1.0
|    |    +--- org.apache.spark:spark-network-common_2.11:2.1.0 (*)
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2
|    |    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- org.apache.spark:spark-unsafe_2.11:2.1.0
|    |    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    |    +--- com.twitter:chill_2.11:0.8.0 (*)
|    |    +--- com.google.code.findbugs:jsr305:1.3.9
|    |    \--- org.spark-project.spark:unused:1.0.0
|    +--- net.java.dev.jets3t:jets3t:0.7.1
|    |    +--- commons-codec:commons-codec:1.3 -> 1.4
|    |    \--- commons-httpclient:commons-httpclient:3.1 (*)
|    +--- org.apache.curator:curator-recipes:2.4.0
|    |    +--- org.apache.curator:curator-framework:2.4.0
|    |    |    +--- org.apache.curator:curator-client:2.4.0
|    |    |    |    +--- org.slf4j:slf4j-api:1.6.4 -> 1.7.16
|    |    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    |    \--- com.google.guava:guava:14.0.1
|    |    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    |    \--- com.google.guava:guava:14.0.1
|    |    +--- org.apache.zookeeper:zookeeper:3.4.5 (*)
|    |    \--- com.google.guava:guava:14.0.1
|    +--- javax.servlet:javax.servlet-api:3.1.0
|    +--- org.apache.commons:commons-lang3:3.5
|    +--- org.apache.commons:commons-math3:3.4.1
|    +--- com.google.code.findbugs:jsr305:1.3.9
|    +--- org.slf4j:slf4j-api:1.7.16
|    +--- org.slf4j:jul-to-slf4j:1.7.16
|    |    \--- org.slf4j:slf4j-api:1.7.16
|    +--- org.slf4j:jcl-over-slf4j:1.7.16
|    |    \--- org.slf4j:slf4j-api:1.7.16
|    +--- log4j:log4j:1.2.17
|    +--- org.slf4j:slf4j-log4j12:1.7.16 (*)
|    +--- com.ning:compress-lzf:1.0.3
|    +--- org.xerial.snappy:snappy-java:1.1.2.6
|    +--- net.jpountz.lz4:lz4:1.3.0
|    +--- org.roaringbitmap:RoaringBitmap:0.5.11
|    +--- commons-net:commons-net:2.2 -> 3.1
|    +--- org.scala-lang:scala-library:2.11.8
|    +--- org.json4s:json4s-jackson_2.11:3.2.11
|    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    +--- org.json4s:json4s-core_2.11:3.2.11
|    |    |    +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |    +--- org.json4s:json4s-ast_2.11:3.2.11
|    |    |    |    \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |    +--- com.thoughtworks.paranamer:paranamer:2.6
|    |    |    \--- org.scala-lang:scalap:2.11.0
|    |    |         \--- org.scala-lang:scala-compiler:2.11.0
|    |    |              +--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    |              +--- org.scala-lang:scala-reflect:2.11.0 -> 2.11.7 (*)
|    |    |              +--- org.scala-lang.modules:scala-xml_2.11:1.0.1 -> 1.0.2 (*)
|    |    |              \--- org.scala-lang.modules:scala-parser-combinators_2.11:1.0.1
|    |    |                   \--- org.scala-lang:scala-library:2.11.0 -> 2.11.8
|    |    \--- com.fasterxml.jackson.core:jackson-databind:2.3.1 -> 2.6.5 (*)
|    +--- org.glassfish.jersey.core:jersey-client:2.22.2
|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2
|    |    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    |    +--- javax.annotation:javax.annotation-api:1.2
|    |    |    +--- org.glassfish.jersey.bundles.repackaged:jersey-guava:2.22.2
|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34
|    |    |    |    +--- javax.inject:javax.inject:1
|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34
|    |    |    |    |    \--- javax.inject:javax.inject:1
|    |    |    |    \--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2.external:aopalliance-repackaged:2.4.0-b34
|    |    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    |    |    +--- org.glassfish.hk2:hk2-utils:2.4.0-b34 (*)
|    |    |    |    \--- org.javassist:javassist:3.18.1-GA
|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    \--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    +--- org.glassfish.jersey.core:jersey-server:2.22.2
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    +--- org.glassfish.jersey.core:jersey-client:2.22.2 (*)
|    |    +--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.media:jersey-media-jaxb:2.22.2
|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    |    |    \--- org.glassfish.hk2:osgi-resource-locator:1.0.1
|    |    +--- javax.annotation:javax.annotation-api:1.2
|    |    +--- org.glassfish.hk2:hk2-api:2.4.0-b34 (*)
|    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    +--- org.glassfish.hk2:hk2-locator:2.4.0-b34 (*)
|    |    \--- javax.validation:validation-api:1.1.0.Final
|    +--- org.glassfish.jersey.containers:jersey-container-servlet:2.22.2
|    |    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2
|    |    |    +--- org.glassfish.hk2.external:javax.inject:2.4.0-b34
|    |    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
|    |    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    |    +--- org.glassfish.jersey.core:jersey-common:2.22.2 (*)
|    |    +--- org.glassfish.jersey.core:jersey-server:2.22.2 (*)
|    |    \--- javax.ws.rs:javax.ws.rs-api:2.0.1
|    +--- org.glassfish.jersey.containers:jersey-container-servlet-core:2.22.2 (*)
|    +--- io.netty:netty-all:4.0.42.Final
|    +--- io.netty:netty:3.8.0.Final
|    +--- com.clearspring.analytics:stream:2.7.0
|    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    +--- io.dropwizard.metrics:metrics-jvm:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- io.dropwizard.metrics:metrics-json:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.4.2 -> 2.6.5 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- io.dropwizard.metrics:metrics-graphite:3.1.2
|    |    +--- io.dropwizard.metrics:metrics-core:3.1.2 (*)
|    |    \--- org.slf4j:slf4j-api:1.7.7 -> 1.7.16
|    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    +--- com.fasterxml.jackson.module:jackson-module-scala_2.11:2.6.5
|    |    +--- org.scala-lang:scala-library:2.11.7 -> 2.11.8
|    |    +--- org.scala-lang:scala-reflect:2.11.7 (*)
|    |    +--- com.fasterxml.jackson.core:jackson-core:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-annotations:2.6.5
|    |    +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    |    \--- com.fasterxml.jackson.module:jackson-module-paranamer:2.6.5
|    |         +--- com.fasterxml.jackson.core:jackson-databind:2.6.5 (*)
|    |         \--- com.thoughtworks.paranamer:paranamer:2.6
|    +--- org.apache.ivy:ivy:2.4.0
|    +--- oro:oro:2.0.8
|    +--- net.razorvine:pyrolite:4.13
|    +--- net.sf.py4j:py4j:0.10.4
|    +--- org.apache.spark:spark-tags_2.11:2.1.0 (*)
|    +--- org.apache.commons:commons-crypto:1.0.0
|    \--- org.spark-project.spark:unused:1.0.0
\--- junit:junit:4.11
     \--- org.hamcrest:hamcrest-core:1.3

testRuntimeOnly - Runtime only dependencies for source set 'test'. (n)
No dependencies

(*) - dependencies omitted (listed previously)

BUILD SUCCESSFUL

Total time: 3.358 secs

11，编写Gradle脚本：

Gradle是以 Groovy语言为基础，基于DSL语法的自动化构建工具，一个构建脚本能够包含任何Groovy语言元素，每个脚本都是UTF-8编码的文件。

Project对象API

println name
println project.name
println project.path
println project.projectDir

在idea中运行

BeiJing This is executed during the initialization phase.
SparkUseGradle
SparkUseGradle
:
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017

Project对象提供了一些标准的属性，我们可以在构建脚本中很方便的使用他们，如下：

Name	Type	Default Value
project	Project	Project实例对象
name	String	项目目录的名称
path	String	项目的绝对路径
description	String	项目描述
projectDir	File	包含构建脚本的目录
build	File	projectDir/build
group	Object	未具体说明
version	Object	未具体说明
ant	AntBuilder	Ant实例对象

 给出Project的apply方法的一个例子，这里自己循环加载，不断循环，StackOverflowError了， 如下：

println rootProject.getRootDir().getAbsolutePath()
apply from: rootProject.getRootDir().getAbsolutePath() + "/common.gradle"

在idea中运行如下：

BeiJing This is executed during the initialization phase.
SparkUseGradle
SparkUseGradle
:

:
...
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017
G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017


FAILURE: Build failed with an exception.
BUILD FAILED


* Where:
Total time: 6.36 secs
Script 'G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\common.gradle' line: 21

* What went wrong:
A problem occurred evaluating script.
> java.lang.StackOverflowError (no error message)

 Gradle对象API 

println "test :  " + gradle.gradleVersion
println "test :  " + gradle.gradleHomeDir

在idea中运行

test :  3.5
test :  E:\Program Files\gradle-3.5-all\gradle-3.5

 Gradle变量声明

在Gradle脚本中有两种类型的变量可以声明，如下：
局部变量
扩展变量

def dest = "dest"

task copy(type: Copy) {
    from "source"
    into dest

}

在idea中运行

:copy NO-SOURCE

在Gradle中所有被增强的对象可以拥有自定义属性（譬如projects、tasks、source sets等），使用ext扩展块可以一次添加多个属性。如下：

ext {
    sparkVersion = "spark 1.6.0 Version"

}

sourceSets.all { ext.purpose = null }

sourceSets {
    main {
        purpose = "production"
    }
    test {
        purpose = "test"
    }
    plugin {
        purpose = "production"
    }
}

task printProperties << {
    println sparkVersion
    sourceSets.matching { it.purpose == "production" }.each { println it.name}
} 

在idea中运行

:printProperties
spark 1.6.0 Version
main
plugin

BUILD SUCCESSFUL

Total time: 4.832 secs

12，Gradle文件操作基础 

Project.file()方法来定位一个文件获取File对象

//相对路径
File configFile = file('src/config.xml')
//绝对路径
println " configFile.absolutePath:  " + configFile.absolutePath
File configFile1 = file(configFile.absolutePath)
//项目路径的文件对象
File configFile2 = file(new File('src/config.xml'))

在idea中运行

configFile.absolutePath:  G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\config.xml

文件集合： Gradle使用FileCollection接口表示文件集合 

FileCollection collection = files('src/file1.txt',
        new File('src/file2.txt'),
        ['src/file3.txt', 'src/file4.txt'])

// 对文件集合进行迭代
collection.each {File file ->
    println file.name
}

// 转换文件集合为其他类型
Set set = collection.files
Set set2 = collection as Set
List list = collection as List
String path = collection.asPath
//File file = collection.singleFile
//File file2 = collection as File

// 增加和减少文件集合
def union = collection + files('src/file3.txt')
def different = collection - files('src/file3.txt')

println union
println different

在idea中运行结果如下

file1.txt
file2.txt
file3.txt
file4.txt
file collection
file collection

向files()方法传递闭包或者可回调的实例参数

task list << {
    File srcDir

    // 使用闭合创建一个文件集合
    collection = files { srcDir.listFiles() }

    srcDir = file('src')
    println "Contents of $srcDir.name"
    collection.collect { relativePath(it) }.sort().each { println it }

    srcDir = file('src2')
    println "Contents of $srcDir.name"
    collection.collect { relativePath(it) }.sort().each { println it }
}

在idea中运行

:list
Contents of src
Contents of src2

之前的工程这里没有src，src2目录，因此打印不出详细目录。我们先建立一个目录，使用以下配置

apply plugin: 'idea'
apply plugin: 'java'
apply plugin: 'scala'
sourceSets {
    main {
        scala {
            srcDirs = ['src/main/scala', 'src/main/java']
            srcDirs = ['src2/main/scalaIMF', 'src2/main/javaIMF']
        }
        java {
            srcDirs = []
        }
    }
    task "createProject" {
        sourceSets*.scala.srcDirs*.each { it.mkdirs() }
        sourceSets*.java.srcDirs*.each { it.mkdirs() }
        sourceSets*.resources.srcDirs*.each { it.mkdirs() }
    }

    jar {
        zip64 true
        from { configurations.compile.collect { it.isDirectory() ? it : zipTree(it) } }
        exclude 'META-INF/*.RSA', 'META-INF/*.SF', 'META-INF/*.DSA'
        manifest {
            attributes "Main-Class": "com.test.myClass"
        }
    }
}

运行的结果如下，自动创建了src src2目录

在idea中运行结果

:list2
Contents of src
src\main
src\test
Contents of src2
src2\main

BUILD SUCCESSFUL

Total time: 2.594 secs

文件树：文件树可以代表一个目录树结构或一个ZIP压缩文件的内容

//以一个基准目录创建一个文件树
FileTree tree = fileTree(dir: 'src/main')

// 添加包含和排除规则
tree.include '**/*.java'
tree.exclude '**/Abstract*'

// 使用路径创建一个树
tree = fileTree('src').include('**/*.java')

// 使用闭合创建一个数
tree = fileTree('src') {
    include '**/*.java'
}

// 使用map创建一个树
tree = fileTree(dir: 'src', include: '**/*.java')
tree = fileTree(dir: 'src', includes: ['**/*.java', '**/*.xml'])
tree = fileTree(dir: 'src', include: '**/*.java', exclude: '**/*test*/**')

// 遍历文件树
tree.each {File file ->
    println "tree.each File file:   "  + file
}

// 过滤文件树
FileTree filtered = tree.matching {
    include 'org/gradle/api/**'
}

// 合并文件树A
FileTree sum = tree + fileTree(dir: 'src/test')

// 访问文件数的元素
tree.visit {element ->
    println  "tree.visit  element:    "   +  "$element.relativePath => $element.file"
}

在idea中运行

tree.visit  element:    main => G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\main
tree.visit  element:    main/java => G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\main\java
tree.visit  element:    main/resources => G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\main\resources
tree.visit  element:    main/scala => G:\IMFBigDataSpark2017\SparkBeiJingWorkSpace2017\src\main\scala

 使用ZIP或TAR等压缩文件的内容作为文件树

// 使用路径创建一个ZIP文件
FileTree zip = zipTree('someFile.zip')

// 使用路径创建一个TAR文件
FileTree tar = tarTree('someFile.tar')

//TarTree可以根据文件扩展名得到压缩方式，如果我们想明确的指定压缩方式则可以如下操作
FileTree someTar = tarTree(resources.gzip('someTar.ext'))

复制文件
 

task copyTask(type: Copy) {
    from 'src/main/java'
    into 'build/explodedWar'
}

task anotherCopyTask(type: Copy) {
    //复制src/main/webapp目录下的所有文件
    from 'src/main/webapp'
    //复制一个单独文件
    from 'src/staging/index.html'
    //复制一个任务输出的文件
    from copyTask
    //显式使用任务的outputs属性复制任务的输出文件
    //from copyTaskWithPatterns.outputs
    //复制一个ZIP压缩文件的内容
    from zipTree('src/main/assets.zip')
    //指定目标目录
    into { getDestDir() }
}

task copyTaskWithPatterns(type: Copy) {
    from 'src/main/webapp'
    into 'build/explodedWar'
    include '**/*.html'
    include '**/*.jsp'
    exclude { details -> details.file.name.endsWith('.html') &&
            details.file.text.contains('staging') }
}

task copyMethod << {
    copy {
        from 'src/main/java'
        into 'src2/main/java/test2'
        include '**/*'

    }
}

//在复制时重命名文件
task rename(type: Copy) {
    from 'src/main/webapp'
    into 'build/explodedWar'
    //使用闭包映射文件名
    rename { String fileName ->
        fileName.replace('-staging-', '')
    }
    // 使用正则表达式映射文件名
    rename '(.+)-staging-(.+)', '$1$2'
    rename(/(.+)-staging-(.+)/, '$1$2')
}

运行结果

文件同步任务：

task libs(type: Sync) {
    from configurations.runtime
    into "$buildDir/libs"
}

结果：

:libs NO-SOURCE

Gradle的Java插件构建实例

加入上面插件以后Gradle默认希望能在src/main/java路径下找到源代码，在 src/test/java路径下找到测试代码，任何src/main/resources路径的文件都会被包含在JAR文件里，任何src/test/resources路径的文件都会被加入到classpath中以运行测试代码，所有的输出文件将会被创建在构建目录里，JAR文件存放在 build/libs文件夹里。


加入Java插件后我们可以通过gradle tasks命令来列出项目的所有任务，这样就可以知道Java插件添加了哪些task。常用的task如下：


build task 
当运行gradle build命令时Gradle将会编译和测试你的代码，并且创建一个包含类和资源的JAR文件。


clean task 
当运行gradle clean命令时Gradle将会删除build生成的目录和所有生成的文件。


assemble task 
当运行gradle assemble命令时Gradle将会编译并打包代码，但是并不运行单元测试。


check task 
当运行gradle check命令时Gradle将会编译并测试你的代码，其他的插件会加入更多的检查步骤。

sourceCompatibility = 1.5

repositories {
    mavenCentral()
}

dependencies {
    // https://mvnrepository.com/artifact/org.apache.spark/spark-core_2.11
    compile group: 'org.apache.spark', name: 'spark-core_2.11', version: '2.1.0'
    compile group: 'commons-collections', name: 'commons-collections', version: '3.2'
    testCompile group: 'junit', name: 'junit', version: '4.11'


}
jar {
    manifest {
        attributes 'Implementation-Title': 'Gradle Quickstart', 'Implementation-Version': version
    }
}

test {
    systemProperties 'property': 'value'
}

//uploadArchives task
uploadArchives {
    repositories {
        flatDir {
            dirs 'repos'
        }
    }
}

博学之，审问之，慎思之，明辨之，笃行之。有弗学，思之弗得，弗措也；有弗辨，辨之弗明，弗措也；有弗行，行之弗笃，弗措也。人一能之，已百之；人十能之，已千之。果能此道矣，虽愚必明，虽柔必强。 

《礼记·中庸》十九章