不知道为什么bin/addwar.sh里面说只支持0.20.x,
于是修改这个文件,addhadoopjar函数里面添加内容,修改后的函数为:
#get the list of hadoop jars that will be injected based on the hadoop version
function getHadoopJars() {
version=$1
hadoopVer=$version
if [ "${version}" = "0.20.1" ]; then
#List is separated by ":"
hadoopJars="hadoop*core*.jar"
elif [ "${version}" = "0.20.2" ]; then
#List is separated by ":"
hadoopJars="hadoop*core*.jar"
elif [ "${version}" = "0.20.104" ]; then
#List is separated by ":"
hadoopJars="hadoop*core*.jar:jackson-core-asl-*.jar:jackson-mapper-asl-*.jar"
elif [ "${version}" = "0.20.200" ]; then
#List is separated by ":"
hadoopJars="hadoop*core*.jar:jackson-core-asl-*.jar:jackson-mapper-asl-*.jar:commons-configuration-*.jar"
elif [ "${version}" = "2.0.1-alpha" ]; then
#List is separated by ":"
hadoopJars="hadoop-common-${version}.jar:hadoop-hdfs-${version}.jar:hadoop-mapreduce-${version}.jar:hadoop-mapreduce-client-app-${version}.jar:hadoop-mapreduce-client-common-${version}.jar:hadoop-mapreduce-client-core-${version}.jar:hadoop-mapreduce-client-hs-${version}.jar:hadoop-mapreduce-client-jobclient-${version}.jar:hadoop-mapreduce-client-shuffle-${version}.jar::hadoop-yarn-api-${version}.jar:hadoop-yarn-applications-distributedshell-${version}.jar:hadoop-yarn-common-${version}.jar:hadoop-yarn-server-common-${version}.jar:hadoop-yarn-server-nodemanager-${version}.jar:hadoop-yarn-server-resourcemanager-${version}.jar:hadoop-yarn-server-web-proxy-${version}.jar:hadoop-yarn-site-${version}.jar::hadoop-archives-${version}.jar:hadoop-distcp-${version}.jar:hadoop-extras-${version}.jar:hadoop-rumen-${version}.jar:hadoop-streaming-${version}.jar:jackson-core-asl-*.jar:jackson-mapper-asl-*.jar:commons-configuration-*.jar"
else
echo
echo "Exiting: Unsupported Hadoop version '${hadoopVer}', supported versions: 0.20.1, 0.20.2, 0.20.104 0.20.200 and 2.0.1-alpha"
echo
cleanUp
exit -1;
fi
}
分享到:
相关推荐
spark-3.2.0-bin-hadoop3-without-hive
spark-3.2.0-bin-hadoop3.2.tgz
sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.gz
hadoop-3.2.0 eclipse内含hadoop-eclipse-plugin 插件 本地测试所需必要的hadoop-3.2.0对应的bin
sqoop-1.4.6.bin__hadoop-2.0.4-alpha.tar.zip
sqoop-1.4.6.bin__hadoop-2.0.4-alpha.zip。。。。。。。。。。。。。。。。
flink-1.0.3-bin-hadoop27-scala_2flink-1.0.3-bin-hadoop27-scala_2
hadoop-annotations-3.1.1.jar hadoop-common-3.1.1.jar hadoop-mapreduce-client-core-3.1.1.jar hadoop-yarn-api-3.1.1.jar hadoop-auth-3.1.1.jar hadoop-hdfs-3.1.1.jar hadoop-mapreduce-client-hs-3.1.1.jar ...
Sqoop是一个用于在Hadoop和关系数据库或大型机之间传输数据的工具。您可以使用Sqoop将关系数据库管理系统(RDBMS)中的数据导入Hadoop分布式文件系统(HDFS),转换Hadoop MapReduce中的数据,然后将数据导出回RDBMS...
hadoop-3.0.0-alpha1-src.tar.gz 源码
赠送jar包:hbase-hadoop2-compat-1.2.12.jar; 赠送原API文档:hbase-hadoop2-compat-1.2.12-javadoc.jar; 赠送源代码:hbase-hadoop2-compat-1.2.12-sources.jar; 赠送Maven依赖信息文件:hbase-hadoop2-compat-...
赠送jar包:hbase-hadoop2-compat-1.1.3.jar; 赠送原API文档:hbase-hadoop2-compat-1.1.3-javadoc.jar; 赠送源代码:hbase-hadoop2-compat-1.1.3-sources.jar; 赠送Maven依赖信息文件:hbase-hadoop2-compat-...
hadoop2.6-common-bin 解决在Windows上操作hadoop出现 Could not locate executable问题
sqoop-1.4.6.bin__hadoop-2.0.4-alpha 导入导出工具,, 可以去官网下载, 也可以用这个
hadoop3.3.0-winutils所有bin文件,亲测有效
timelineservice jar包
Oozie由Cloudera公司贡献给Apache的基于工作流引擎的开源框架,是用于Hadoop平台的开源的工作流调度引擎,是用来管理Hadoop作业,属于web应用程序,由Oozie client和Oozie Server两个组件构成,Oozie Server运行于Java ...
赠送jar包:hadoop-mapreduce-client-jobclient-2.6.5.jar; 赠送原API文档:hadoop-mapreduce-client-jobclient-2.6.5-javadoc.jar; 赠送源代码:hadoop-mapreduce-client-jobclient-2.6.5-sources.jar; 赠送...
赠送jar包:hadoop-yarn-client-2.6.5.jar; 赠送原API文档:hadoop-yarn-client-2.6.5-javadoc.jar; 赠送源代码:hadoop-yarn-client-2.6.5-sources.jar; 赠送Maven依赖信息文件:hadoop-yarn-client-2.6.5.pom;...