hadoop2.7.1单机部署

一、设置主机名

127.0.0.1 test

二、配置免密登录。

[root@master ~]# ssh-keygen
Generating public/private rsa key pair.
Enter file in which to save the key (/root/.ssh/id_rsa): 
/root/.ssh/id_rsa already exists.
Enter passphrase (empty for no passphrase): 
Enter same passphrase again: 
Your identification has been saved in /root/.ssh/id_rsa.
Your public key has been saved in /root/.ssh/id_rsa.pub.
The key fingerprint is:
d3:0b:e3:78:12:32:a9:b6:4c:36:d0:f0:cb:58:03:ff root@htzh208
The key's randomart image is:
+--[ RSA 2048]----+
|                 |
|                 |
|o                |
| *   .   .       |
|. * + . S .      |
| = = o + + .     |
|. O E o o .      |
| = o   o         |
|  o              |
+-----------------+

cd ~/.ssh

cat id_rsa.pub >> authorized_keys

三、安装Hadoop。

解压至目录 /data/

cd /data/hadoop-2.7.1/etc/hadoop

1.配置文件

    ①配置文件：core-site.xml

<configuration>
<property>
        <name>hadoop.tmp.dirname>
        <value>/data/hadoop-data/hadoop/apps/temp/hadoop-${user.name}value>
property>
<property>
        <name>fs.default.namename>
        <value>hdfs://127.0.0.1:9000value>
property>
configuration>

       ②配置文件：yarn-site.xml

<property>
  <name>yarn.resourcemanager.addressname>
      <value>127.0.0.1:8032value>
property>
<property>
      <name>yarn.resourcemanager.scheduler.addressname>
      <value>127.0.0.1:8030value>
property>
<property>
      <name>yarn.resourcemanager.resource-tracker.addressname>
      <value>127.0.0.1:8031value>
property>
<property>
      <name>yarn.nodemanager.aux-servicesname>
      <value>mapreduce_shufflevalue>
property>

   ③配置文件：hdfs-site.xml

<configuration>
<property>
        <name>dfs.replicationname>
        <value>1value>
property>
<property>
        <name>dfs.name.dirname>
        <value>/data/hadoop-data/hadoop/hdfs/namevalue>  
property>         
<property>
        <name>dfs.data.dirname>                                                                                                                
        <value>/data/hadoop-data/hadoop/hdfs/datavalue>
property>
configuration>

        ④配置文件：hadoop-env.sh

export JAVA_HOME=/usr/java/default  //修改为本机java目录

2.格式化

bin/hadoop namenode -format 

3.启动和停止

sbin/start-all.sh
sbin/stop-all.sh

4.看到以下进程则说明配置成功

5036 DataNode
5230 SecondaryNameNode
5538 NodeManager
14551 Jps
4894 NameNode
5414 ResourceManager