hadoop lzo & Elephant Bird

http://www.linuxidc.com/Linux/2014-05/101090.htm

https://github.com/kevinweil/hadoop-lzo

https://github.com/twitter/elephant-bird

https://github.com/twitter/elephant-bird/wiki/How-to-use-Elephant-Bird-with-Hive

http://search.maven.org/#search|gav|1|g%3A%22com.twitter.elephantbird%22%20AND%20a%3A%22elephant-bird%22

http://blog.csdn.net/zhangzhaokun/article/details/17595325

 

 

（1）安装LZO

wget http://www.oberhumer.com/opensource/lzo/download/lzo-2.06.tar.gz
tar -zxvf lzo-2.06.tar.gz 
./configure -enable-shared -prefix=/usr/local/hadoop/lzo/
make && make test && make install

（2）安装LZOP
wget http://www.lzop.org/download/lzop-1.03.tar.gz
tar -zxvf lzop-1.03.tar.gz 
./configure -enable-shared -prefix=/usr/local/hadoop/lzop
make  && make install

（3）把lzop复制到/usr/bin/
    ln -s /usr/local/hadoop/lzop/bin/lzop /usr/bin/lzop

（4）测试lzop
   lzop /home/hadoop/data/access_20131219.log