为了研究HBase,在Hadoop-0.20.2上安装HBase-0.90.4,结果出了很多问题。
先找了几虚拟机练练手,配置如下:
133.133.134.116 masster
133.133.134.115 slave1
133.133.134.80 slave2
当然事先已经装好了hadoop-0.20.2。
1、官网上下载hbase-0.90.4.tar.gz后解压到master节点上。
2、修改conf下的配置文件
2.1 修改hbase-site.xml如下
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://master:9000/hbase</value>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.master.port</name>
<value>60000</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>master,slave1,slave2</value>
</property>
</configuration>
2.2 修改regionservers如下
slave1
slave2
2.3.修改hbase-env.sh
将export JAVA_HOME前#去掉,设置值
将export HBASE_MANAGES_ZK=true前#去掉
完成。
3 启动hbase
start-hbase.sh
结果在master上jps看到
root@master:~/hbase-0.90.4/conf# jps
4575 NameNode
5900 Jps
4744 SecondaryNameNode
5729 HQuorumPeer
4823 JobTracker
没有HMaster
salve节点上倒是很正常
root@slave1:~/hbase-0.90.4/conf# jps
4145 DataNode
5312 Jps
5090 HQuorumPeer
5219 HRegionServer
4278 TaskTracker
查找log后发现报的错是
2011-10-19 21:57:34,425 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.
org.apache.hadoop.ipc.RPC$VersionMismatch: Protocol org.apache.hadoop.hdfs.protocol.ClientProtocol version mismatch. (client = 42, server = 41)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:364)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:113)
坑爹啊,版本不对,所以没启动HMaster。
好吧,明天换个版本试试。
P.S.之前安装后,进入hbase shell,输入list命令后,报错
ERROR: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default). Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can. See HTable's javadoc for more information.
解决方式是修改/etc/hosts
将127.0.0.1之类的全删了,留下这样的:
133.133.134.116 master
133.133.134.115 slave1
133.133.134.80 slave2
即可。
分享到:
相关推荐
文章介绍了hadoop-0.20.2安装手册以及相关的使用方法
hadoop-0.20.2-eclipse-pluginhadoop-0.20.2-eclipse-pluginhadoop-0.20.2-eclipse-pluginhadoop-0.20.2-eclipse-pluginhadoop-0.20.2-eclipse-pluginhadoop-0.20.2-eclipse-pluginhadoop-0.20.2-eclipse-plugin
Hadoop-0.20.2版本的hadoop是比较老的版本,但是很多教程中都是以hadoop-0.20.2为例子讲述的,所以我在这里分享一下,供大家下载!
hadoop-0.20.2-cdh3u6.rar
可以导进去编程的时候了解实现 hadoop-core-0.20.2 源码 hadoop-2.5.1-src.tar.gz 源码
基于apache发布的FTPserver实现的基于hadoop-0.20.2的FTP服务器,可以直接使用,但要进行hadoop网址的基本配置,另外只有一个匿名用户,除了几个我设定的系统文件夹不能删除外,基本具有所有权限。当然,您可以在此...
export CLASSPATH="$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:${HADOOP_HOME}/lib/commons-logging-1.0.4.jar:${HADOOP_HOME}/lib/guava-r09-jarjar.jar:${HADOOP_HOME}/hadoop-core-0.20.2-cdh3u3.jar:/usr/...
hadoop-0.20.2的chm帮助文档
把压缩文件解压之后可以防止sqoop-1.2.0版本下的lib中,使得sqoop在安装了hadoop-0,20,2版本的hadoop环境下也能运行。
hadoop-0.20.2-eclipse-plugin 经典插件
hadoop-0.20.2的安装配置,其他环境为JDK1.7.0_25,Ubuntu-12.04
Hadoop安装包,适用于linux,内含eclipse插件.
hadoop-2.7.2-hbase-jar.tar.gz hadoop-2.7.2-hbase-jar.tar.gz hadoop-2.7.2-hbase-jar.tar.gz
hadoop-0.20.2.part1.rar
hadoop-0.20.2.part2.rar
hadoop-0.20.2-cdh3u6 cloudera
hadoop-0.20.2-cdh3u4 clouera
CentOS下Hadoop-0.20.2集群配置文档