ubuntu14.04 hadoop2.7.1 伪分布式

一。基础环境搭建


1.首先安装好虚拟机VM12


2.安装ubuntu14.04


二。安装jdk并配置环境变量


        一。安装jdk，并改名


    1.sudo tar -zxvf /home/hadoop/jdk-8u111-linux-x64.tar.gz -C /usr/local


    2.sudo mv /usr/local/jdk1.8.0_111/   jdk


        二。配置环境变量


1.sudo vi /etc/environment
    在上一行插入:


2.JAVA_HOME=/usr/local/jdk


   HADOOP_INSTALL=/usr/local/hadoop


    在path最后添加:


3./usr/local/jdk/bin:/usr/local/hadoop/sbin/:/usr/local/hadoop/bin


4.    :wq!


5.source /etc/environment


6.java -version


7.echo $PATH


8.echo $JAVA_HOME


9.sudo tar -zxvf /home/hadoop/hadoop-2.7.1.tar.gz


10.cd /usr/local/


11.sudo mv hadoop-2.7.1/ hadoop


12.sudo chown -R 777 hadoop/


13.sudo chmod -R 777 hadoop/


14.sudo chown -R 777 jdk/


15.sudo chmod -R 777 jdk/


16.cd hadoop


17.sudo mkdir tmp


18.sudo chown -R 777 tmp/


19.sudo chmod -R 777 tmp/


20.sudo apt-get install openssh-server


21.ssh-keygen -t rsa


22.cd ~/.ssh


23.cat id_rsa.pub >> authorized_keys


24.cd etc/hadoop


25.sudo vi core-site.xml


    修改如下:


   
       
                fs.defaultFS
                hdfs://localhost:9000
       
       
                hadoop.tmp.dir
                file:/usr/local/hadoop/tmp
       



26.   :wq!


27.sudo vi hdfs-site.xml


    修改如下:


   

dfs.replication
1


dfs.namenode.name.dir
file:/usr/local/hadoop/tmp/dfs/name


dfs.datanode.data.dir
file:/usr/local/hadoop/tmp/dfs/data




28.     :wq!


29.sudo mv mapred-site.xml.template mapred-site.xml


30.sudo vi mapred-site.xml


    修改如下:


   

mapreduce.framework.name
yarn




31.    :wq!


32.sudo vi yarn-site.xml


    修改如下:
   

mapreduce.framework.name
yarn




33.    :wq!


34.cd /usr/local/hadoop


35.bin/hdfs namenode -format