${HADOOP_HOME}/conf目录下的配置文件:
core-site.xml
hadoop.tmp.dir: A base for other temporary directories(用来存储其他临时目录的根目录)
fs.default.name: The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri's scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri's authority is used to determine the host, port, etc. for a filesystem.
hdfs-site.xml
dfs.name.dir: Determines where on the local filesystem the DFS name node should store the name table(fsimage). If this is a comma-delimited list of directories then the name table is replicated in all of the directories, for redundancy.
dfs.data.dir: Determines where on the local filesystem an DFS data node should store its blocks. If this is a comma-delimited list of directories, then data will be stored in all named directories, typically on different devices. Directories that do not exist are ignored.
mapred-site.xml
mapred.job.tracker: The host and port that the MapReduce job tracker runs at. If "local", then jobs are run in-process as a single map and reduce task.
mapred.system.dir: The shared directory where MapReduce stores control files.
mapred.local.dir: The local directory where MapReduce stores intermediate data files. May be a comma-separated list of directories on different devices in order to spread disk i/o. Directories that do not exist are ignored.
slaves
List all slave hostnames or IP addresses in your conf/slaves file, one per line.
Start Hadoop
./${HADOOP_HOME}/bin/start-all.sh
Stop Hadoop
./${HADOOP_HOME}/bin/stop-all.sh
分享到:
相关推荐
hadoop配置文件hadoop配置文件hadoop配置文件hadoop配置文件hadoop配置文件hadoop配置文件hadoop配置文件hadoop配置文件hadoop配置文件
hadoop配置文件详解,core-site.xml是全局配置,hdfs-site.xml和mapred-site.xml分别是hdfs和mapred的局部配置。
HADOOP配置文件-有注释版,里面附带源码,方便进行复制粘贴改动
hadoop2.2.0单机伪分布式配置文件实例。
本专题专门针对 IDH(Intel distribution Hadoop)而出,主要介绍 IDH 中所使用的配置,以 及配置文件所使用的默认值和相关描述。
Hadoop配置文件
NULL 博文链接:https://oaksun.iteye.com/blog/1939794
hadoop配置文件参数详解1
本文档列出了hadoop的常用配置说明,对hadoop的学习很有帮助。
指导手册01安装Hadoop 配置文件,core-site,hdfs-site,mapred-site,profile,yarn-site...
Hadoop配置文件,包括core-site.xml、hadoop-evn.sh、hdfs-site.xml、map-red.xml、yarn-site.xml等配置文件各个选项及对应的功能配置
配置hadoop的配置文件修改,如core-site.xml等
4.Hadoop配置文件的更改 !!!!!!!!!!!!!!!!!!!! ps 请特别注意以下几个问题: 1.hostname 默认改成master ,如果不想修改,请在run.sh 中注释sudo ./change_hostname 2.集群的IP地址 默认为...
经过多次反复试验,完全可用的hadoop配置,有0.19的版本,也有0.20的版本。并且有脚本可以在两个版本之间切换,无需格式化文件系统。Without "hadoop namenode -format" 目录结构: /data/hadoop 为工作目录,实际为...
Hadoop HA 集群搭建所需要的配置文件:core-site,hdfs-site,mapred-site,yarn-site四个xml文件和一个slaves文件
Hadoop的4个xml配置文件core-site.xml、hdfs-site.xml配置、mapred-site.xml配置、yarn-site.xml配置
此压缩包主要包含的是是hadoop的7个主要的配置文件,core-site.xml、hdfs-site.xml、mapred-site.xml、yarn-site.xml、hadoop-env.sh、mapred-env.sh、yarn-env.sh精简配置优化性能,具体相关参数根据集群规模适当...