Hadoop Yarn常用命令
文章目录
- Hadoop Yarn常用命令
-
- 1 查看任务
-
- 1.1 yarn application -list
- 1.2 yarn application -list -appStates
- 1.3 kill 调Application
- 2. yarn logs 查看
-
- 2.1 查看application日志
- 2.2 查询 Container 日志
- 3 查看尝试运行的任务
-
- 3.1 列出所有 Application 尝试的列表
- 3.2 打印 ApplicationAttemp 状态
- 4 yarn container 查看容器
-
- 4.1 列出所有 Container
- 4.2 打印 Container 状态
- 5 其他指令
-
- 5.1 yarn node 查看节点状态
- 5.2 yarn rmadmin 更新配置
- 5.3 yarn queue 查看队列
Hadoop Yarn常用命令
1 查看任务
1.1 yarn application -list
[develop@hadoop102 ~]$ yarn application -list
2021-10-20 09:55:16,497 INFO client.RMProxy: Connecting to ResourceManager at hadoop102/192.168.10.102:8032
Total number of applications (application-types: [], states: [SUBMITTED, ACCEPTED, RUNNING] and tags: []):0
Application-Id Application-Name Application-Type User Queue State Final-State Progress Tracking-URL
1.2 yarn application -list -appStates
根据 Application 状态过滤：yarn application -list -appStates （所有状态：ALL、NEW、NEW_SAVING、SUBMITTED、ACCEPTED、RUNNING、FINISHED、FAILED、KILLED）
[develop@hadoop102 ~]$ yarn application -list -appStates FINISHED
2021-10-20 09:57:30,688 INFO client.RMProxy: Connecting to ResourceManager at hadoop102/192.168.10.102:8032
Total number of applications (application-types: [], states: [FINISHED] and tags: []):0
Application-Id Application-Name Application-Type User Queue State Final-State Progress Tracking-URL
1.3 kill 调Application
# yarn application -kill 2. yarn logs 查看
2.1 查看application日志
# yarn logs -applicationId 2.2 查询 Container 日志
# yarn logs -applicationId -containerId
yarn logs -applicationId application_1612577921195_0001 -containerId container_1612577921195_0001_01_000001
3 查看尝试运行的任务
3.1 列出所有 Application 尝试的列表
# yarn applicationattempt -list 3.2 打印 ApplicationAttemp 状态
# yarn applicationattempt -status 4 yarn container 查看容器
注意：只有在任务跑的途中才能看到 container 的状态
4.1 列出所有 Container
# yarn container -list 4.2 打印 Container 状态
# yarn container -list 5 其他指令
5.1 yarn node 查看节点状态
# yarn node -list -all
[develop@hadoop102 ~]$ yarn node -list -all
2021-10-20 10:15:02,236 INFO client.RMProxy: Connecting to ResourceManager at hadoop102/192.168.10.102:8032
Total Nodes:3
Node-Id Node-State Node-Http-Address Number-of-Running-Containers
hadoop102:46859 RUNNING hadoop102:8042 0
hadoop101:35827 RUNNING hadoop101:8042 0
hadoop103:39244 RUNNING hadoop103:8042 0
5.2 yarn rmadmin 更新配置
加载队列配置：yarn rmadmin -refreshQueues
# yarn rmadmin -refreshQueues
[develop@hadoop102 ~]$ yarn rmadmin -refreshQueues
2021-10-20 10:16:00,157 INFO client.RMProxy: Connecting to ResourceManager at hadoop102/192.168.10.102:8033
5.3 yarn queue 查看队列
打印队列信息：yarn queue -status
[develop@hadoop102 ~]$ yarn queue -status default
2021-10-20 10:17:10,487 INFO client.RMProxy: Connecting to ResourceManager at hadoop102/192.168.10.102:8032
Queue Information :
Queue Name : default
State : RUNNING
Capacity : 100.0%
Current Capacity : .0%
Maximum Capacity : 100.0%
Default Node Label expression : <DEFAULT_PARTITION>
Accessible Node Labels : *
Preemption : disabled
Intra-queue Preemption : disabled