marsorp
- 浏览: 214691 次
- 性别:
- 来自: 北京
-
文章分类
- 全部博客 (114)
- hbase (3)
- akka (7)
- hdfs (6)
- mapreduce (1)
- hive (0)
- zookeeper (8)
- storm (0)
- geese (0)
- leaf (0)
- stormbase (0)
- scala (2)
- oozie (11)
- zeromq (1)
- netty (3)
- mongodb (0)
- sqoop (2)
- flume (3)
- mahout (1)
- redis (0)
- lucene (1)
- solr (1)
- ganglia (3)
- 分布式理论 (2)
- hadoop (42)
- others (14)
- mq (1)
- clojure (3)
- flume ng (1)
- linux (1)
- esper (0)
最新评论
-
javalogo：
[b][i][u]引用[list]
[*][*][flash= ...
什么是Flume -
leibnitz：
what are they meanings
Hadoop Ganglia Metric Item -
di1984HIT：
没用过啊。
akka 介绍-Actor 基础 -
di1984HIT：
写的不错。
Hadoop管理-集群维护 -
developerinit：
很好，基本上介绍了
什么是Flume
dfs.FSDirectory.files_deleted
dfs.FSNamesystem.BlockCapacity
dfs.FSNameSystem.BlocksTotal
dfs.FSNamesystem.CapacityRemainingGB
dfs.FSNamesystem.CapacityTotalGB
dfs.FSnamesystem.CapacityUsedGB
dfs.FSnamesystem.CorruptBlocks
dfs.FSnamesystem.ExcessBlocks
dfs.FSnamesystem.FilesTotal
dfs.FSNameSystem.MissingBlocks
dfs.FSNamesystem.PendingDeletionBlocks
dfs.FSNamesystem.PendingReplicationBlocks
dfs.FSnamesystem.ScheduledReplicationBlocks
dfs.FSnamesystem.TotalLoad
dfs.FSNamesystem.UnderReplicatedBlocks
dfs.datanode.blockChecksumOp_avg_time
dfs.datanode.blockChecksumOp_num_ops
dfs.datanode.blockChecksumOp_avg_time
dfs.datanode.blockReports_num_ops
dfs.datanode.blockReports_avg_time
dfs.datanode.block_verification_failures
dfs.datanode.blocks_read
dfs.datanode.blocks_removed
dfs.datanode.blocks_replicated
dfs.datanode.blocks_verified
dfs.datanode.blocks_written
dfs.datanode.bytes_read
dfs.datanode.bytes_written
dfs.datanode.copyBlockOp_avg_time
dfs.datanode.copyBlockOp_num_ops
dfs.datanode.heartBeats_avg_time
dfs.datanode.heartbeats_num_ops
dfs.datanode.readBlockOp_avg_time
dfs.datanode.readBlockOp_num_ops
dfs.datanode.reads_from_local_client
dfs.datanode.reads_from_remote_client
dfs.datanode.replcaceBlockOp_avg_time
dfs.datanode.replaceBlockOp_num_ops
dfs.datanode.volumeFailures
dfs.datanode.writeBlockOp_avg_time
dfs.datanode.writeBlockOp_num_ops
dfs.datanode.writes_from_local_client
dfs.datanode.writes_from_remote_client
dfs.namenode.AddBlockOps
dfs.namenode.CreateFileOps
dfs.namenode.DeleteFileOps
dfs.namenode.FileInfoOps
dfs.namenode.FilesAppended
dfs.namenode.FilesCreated
dfs.namenode.FilesInGetListingOps
dfs.namenode.FilesRenamed
dfs.namenode.GetBlockLocations
dfs.namenode.GetListingOps
dfs.namenode.JournalTransactionsBatchedinSync
dfs.namenode.SafemodeTime
dfs.namenode.Syncs_avg_time
dfs.namenode.Syncs_num_ops
dfs.namenode.Transactions_avg_time
dfs.namenode.Transactions_num_ops
dfs.namenode.blockReport_avg_time
dfs.namenode.blockReport_num_ops
dfs.namenode.fsImageLoadTime
hbase.regionserver.blockCacheCount
hbase.regionserver.blockCacheEvictedCount
hbase.regionserver.blockCacheFree
hbase.regionserver.blockCacheHitCachingRatio
hbase.regionserver.blockCacheHitCount
hbase.regionserver.blockCacheHitCachingRatio
hbase.regionserver.blockCacheHitCount
hbase.regionserver.blockCacheHitRatio
hbase.regionserver.blockCacheMissCount
hbase.regionserver.blockCacheSize
hbase.regionserver.compactionQueueSize
hbase.regionserver.compactionSize_avg_time
hbase.regionserver.compactionSize_num_ops
hbase.regionserver.compactionTime_avg_time
hbase.regionserver.compactionTime_num_ops
hbase.regionserver.flushQueueSize
hbase.regionsrever.flushSize_avg_time
hbase.regionserver.flushsize_num_ops
hbase.regionserver.flushTime_avg_time
hbase.regionserver.flushTime_num_ops
hbase.regionesrver.sReadLatency_avg_time
hbase.regionserver.fsReadLatency_num_ops
hbase.regionserver.fsSyncLatency_avg_time
hbase.regionserver.fsSyncLatency_num_ops
hbase.regionserver.fsWriteLatency_avg_time
hbase.regionserver.fsWritLatency_num_ops
hbase.regionserver.hdfsBlocksLocalityIndex
hbase.regionserver.memstoreSizeMB
hbase.regionserver.readRequestsCount
hbase.regionserver.regions
hbase.regionserver.requests
hbase.regionserver.rootIndexSizeKB
hbase.regionserver.storefileIndexSizeMB
hbase.regionserver.storefiles
hbase.rgionserver.stores
hbase.regionserver.totalStaticBloomSizeKB
hbase.regionserver.totalStaticIndexSizeKB
hbase.regionserver.writeRequestsCount
rpc.metrics.ReceivedBytes
rpc.metrics.RpcProcessingTime_avg_time
rpc.metrics.RpcProcessingTime_num_ops
rpc.metrics.RpcQueueTime_avg_time
rpc.metrics.RpcQueueTime_num_ops
rpc.metrics.RpcSlowResponse_avg_time
rpc.metrics.RpcSlowResponse_num_ops
rpc.metrics.SentBytes
rpc.metrics.abort.aboveOnSec._avg_time
rpc.metrics.abort.aboveOnSec._num_ops
rpc.metrics.about_avg_time
rpc.metrics.about_num_ops
rpc.metrics.addColumn_avg_time
rpc.metrics.addColumn_num_ops
rpc.metrics.addtoOnlineRegions.aboveOneSec._avg_time
rpc.metrics.addToOnlineRegions_num_ops
rpc.metrics.assign_avg_time
rpc.metrics.assign_num_ops
rpc.metrics.balanceSwitch_avg_time
rpc.metrics.balanceSwitch_num_ops
rpc.metrics.balance_avg_time
rpc.metrics.balance_num_ops
rpc.metrics.bulkLoadHFiles.aboveOneSec._avg_time
rpc.metrics.bulkLoadHfiles.aboveOneSec._num_ops
rpc.metrics.bulkLoadHFiles_avg_time
rpc.metrics.bulkLoadHFiles_num_ops
rpc.metrics.callQueueLen
rpc.metrics.checkAndDelete.aboveOneSec._avg_time
rpc.metrics.checkAndDelete.aboveOneSec._num_ops
rpc.metrics.checkAndDelete_avg_time
rpc.metrics.checkAndDelete_num_ops
rpc.metrics.checkAndDelete_num_ops
rpc.metrics.checkAdnPut.aboveOneSec._avg_time
rpc.metrics.checkAndPut.aboveOneSec._num_ops
rpc.metrics.checkAndPut_avg_time
rpc.metrics.checkAndPut_num_ops
rpc.metrics.checkOOME.aboveOneSec._avg_time
rpc.metrics.checkOOME_num_ops
rpc.metrics.close.aboveOneSec._avg_time
rpc.metrics.closeRegion.aboveOneSec._num_ops
rpc.metrics.closeRegion_avg_time
rpc.metrics.closeRegion_num_ops
rpc.metrics.close_avg_time
rpc.metrics.compactRegion.aboveOneSec._num_ops
rpc.metrics.compactRegion_avg_time
rpc.metrics.compactRegion_num_ops
rpc.metrics.delete.aboveOneSec._avg_time
rpc.metrics.delete.aboveOneSec._num_ops
rpc.metrics.deleteColumn_avg_time
rpc.metrics.deleteColumn_num_ops
rpc.metrics.deleteTable_avg_time
rpc.metrics.deleteTable_num_ops
rpc.metrics.delete_avg_time
rpc.metrics.delete_num_ops
rpc.metrics.disableTable_avg_time
rpc.metrics.disabletable_num_ops
rpc.metrics.enableTable_avg_time
rpc.metrics.enableTable_num_ops
rpc.metric.execCoprocessor.aboveOneSec._avg_time
rpc.metrics.execCoprocessor.aboveOneSec._num_ops
rpc.metrics.execCoprocessor_avg_time
rpc.metrics.execCoprocessor_num_ops
rpc.metrics.exists.aboveOneSec._avg_time
rpc.metrics.exists.aboveOneSec._num_ops
rpc.metrics.exists_avg_time
rpc.metrics.exists_num_ops
rpc.metrics.flushRegion.aboveOneSec._avg_time
rpc.metrics.flushRegion.aboveOneSec._num_ops
rpc.metrics.flushRegion_avg_time
rpc.metrics.flushRegion_num_ops
rpc.metrics.get.aboveOneSec._avg_time
rpc.metrics.get.aboveOneSec._num_ops
rpc.metrics.getAlterStattus_avg_time
rpc.metrics.getAlterStatus_num_ops
rpc.metrics.getBlockCacheColumnFamilySummaries.aboveOneSec._avg_time
rpc.metrics.getblockCacheColumnfamilySummaries.aboveOneSec._num_ops
rpc.metrics.getBlockCacheColumnFamilySummaries_num_ops
rpc.metrics.getCatalogTracker.aboveOneSec._avg_time
rpc.metrics.getCatalogTracker.aboveOneSec._num_ops
rpc.metrics.getCatalogTracker_avg_time
rpc.metrics.getCatalogTracker_num_ops
rpc.metrics.getClosestRowBefore.aboveOneSec._avg_time
rpc.metrics.getClosestRowBefore.aboveOneSec._num_ops
rpc.metrics.getClosestRowBefore_avg_time
rpc.metrics.getClusterStatus_num_ops
rpc.metrics.getConfiguration.aboveOneSec._avg_time
rcp.metrics.getConfiguration.aboveOneSec._num_ops
rpc.metrics.getConfiguration_avg_time
rpc.metrics.getConfiguration_num_ops
rpc.metrics.getFromOnlineRegions.aboveOneSec._avg_time
rpc.metrics.getFromOnlineRegions.aboveOneSec._num_ops
rpc.metrics.getFromOnlineRegions_avg_time
rpc.metrics.getFromOnlineRegions_num_ops
rpc.metrics.getHServerInfo.aboveOneSec.-avg_time
rpc.metrics.getHServerInfo.aboveOneSec._num_ops
rpc.metrics.getHServerInfo_avg_time
rpc.metrics.getHServerInfo_num_ops
rpc.metrics.getHTableDescriptors_avg_time
rpc.metrics.getHTableDescriptors_num_ops
rpc.metrics.getOnlineRegions.aoveOneSec._avg_time
rpc.metrics.getOnlineregions_num_ops
rpc.metrics.getProtocolSignature.aboveOneSec.-avg_time
rpc.metrics.getProtocolSignature.aboveOneSec._num_ops
rpc.metrics.getProtocolSignature_avg_time
rpc.metrics.getProtocolSignature_num_ops
rpc.metrics.getProtocolVersion.aboveOneSec._avg_time
rpc.metrics.getProtocolVersion.aboveOneSec._num_ops
rpc.metrics.getProtocolVersion_avg_time
rpc.metrics.getProtocolVersion_num_ops
rpc.metrics.getregionInfo.aboveOneSec._avg_time
rpc./metrics.getRegionInfo.aboveOneSec._num_ops
rpc.metrics.getRegionInfo_avg_time
rpc.metrics.getRegionInfo_num_ops
rpc.metrics.unlockRow_num_ops
rpc.metrics.unlockRow_avg_time
rpc.metrics.unlockrow.aboveOneSec._num_ops
rpc.metrics.unlockrow.aboveOneSec._avg_time
rpc.metrics.unassign_num_ops
rpc.metris.unassign_ag_time
rpc.metrics.stop_num_ops
rpc.metrics.stopMaster_num_ops
rpc.metrics.stop_avg_time
rpc.metrics.splitRegion_num_ops
rpc.metrics.stop.aboveOneSec._avg_time
rpc.metrics.splitRegion_num_ops
rpc.metrics.stop.aboveOneSec._avg_time
rpc.metrics.splitRegion.aboveOneSec._num_ops
rpc.metrics.splitRegion_avg_time
rc.metrics.shutdown_num_ops
rpc.metrics.splitRegion.aboveOneSec._avg_time
rpc.metrics.rpcAuthorizationSuccesses
rpc.metrics.shutdown_avg_time
rpc.metrics.rpcAuthenticationSuccesses
rpc.metrics.rpcAuthorizationFailures
rpc.metrics.rpcAuthorizationFailures
rc.metrics.rpcAuthenticationSuccesses
rpc.metrics.rpcAuthenticationFailures
rpc.metrics.rollHLogWriter_num_ops
rpc.metrics.rollHLogWriter_avg_time
rpc.metrics.rollHLogWriter.aboveOneSec._num_ops
rpc.metrics.rollHLogWriter.aboveOneSec._avg_time
rpc.metrics.reportRSFatalError_num_ops
rpc.metrics.replicateLogEntries_ num_ops
rpc.metrics.replicateLogEntries_avg_time
rpc.metrics.replicateLogEntries.aboveOneSec._num_ops
rpc.metrics.removeFromOnlineRegions_num_ops
rpc.metrics.removefromonlineRegions_avg_time
rpc.mettrics.removeFromOnlineregions.aboveOneSec._num_ops
rpc.metrics.regionServerStartup_avg_time
rpc.metrics.regionServerReport_num_ops
rpc.metrics.regionServerReport_avg_time
rpc.metrics.getServername.aboveOneSec._num_ops
rpc.metrics.getServerName_avg_time
rpc.metrics.getServerName_num_ops
rpc.metrics.getZookeeper.aboveOneSec._avg_time
rpc.metrics.getZookeeper.aboveOneSec._num_ops
rpc.metrics.getZookeeper_avg_time
rpc.metrics.getZooKeeper_ num_ops
rpc.metrics.get_avg_time
tpc.metrics.get_num_ops
rpc.metrics.increment.aboveOneSec._avg_time
rpc.metrics.increment.aboveOneSec._num_ops
rpc.metrics.incrementColumnValue.aboveOneSec.-avg_time
rpc.metrics.incremen tColumnValue.aboveOneSec_num_ops
rpc.metrics.isMasterRunning_avg_time
rpc.metrics.isMasterRunning_num_ops
rpc.metrics.isStopped.aboveoneSec._avg_time
rpc.metrics.isStopped.aboveOneSec._num_ops
rpc.metrics.isStopped_avg_time
rpc.metrics.isAborted.aboveOneSec._avg_time
分享到：
发表评论
-
Hadoop TestDFSIO
2013-04-21 21:02 2403@VM [bigdata@bigdata hadoo ... -
Hadoop NNBENCH
2013-04-21 20:46 1604@VM [bigdata@bigdata hadoop]$ ... -
Hadoop 安装手册
2013-04-08 15:47 1165Hadoop 安装手册 软件准备 ... -
What do real life hadoop workloads look like
2012-09-10 15:52 791http://www.cloudera.com/blog/20 ... -
CDH4 HA 切换时间
2012-09-05 15:15 4304blocksize:35M filesize 96M zk-s ... -
CDH4 HA 切换
2012-09-05 10:51 1339HA 切换问题 切换时间太长。。。 copy 0 ... ... -
Hadoop CDh4 Standby HA 启动过程
2012-08-02 11:40 2834根据日志: StandBy NN启动过程 1.获得Active ... -
CDH4 HA test
2012-08-01 14:55 2583场景： NN HA 设置成功，HA切换客户端出现异 ... -
Hadoop TextOutput
2012-07-29 21:08 878TextOutputFormat 分隔符参数: mapredu ... -
Hadoop SteamXMLRecordReader
2012-07-28 23:59 673StreamXmlRecordReader 设置属性 str ... -
Hadoop NLineInputFormat
2012-07-28 23:52 1604NLineInputFormat 重写了splits 设置 ... -
KeyValueTextInputFormat
2012-07-28 23:40 925key/value 分割符 mapreduce.input. ... -
Hadoop 控制split尺寸
2012-07-28 23:08 1297三个参数决定Map的Split尺寸 1.mapred.min ... -
Setting up Disks for Hadoop
2012-07-22 12:13 846Setting up Disks for Hadoop He ... -
Upgrade hadoop need think about it
2012-07-21 17:17 842Compatibility When movin ... -
Hadoop 0.23 config differ from 0.20.205
2012-07-21 17:14 900http://hadoop.apache.org/common ... -
Hadoop hdfs block 状态
2012-07-15 13:37 6931.In Service -
Hadoop 配置不当引起集群不稳
2012-07-05 15:35 988配置不当内容 资源配置不当:内存、文件句柄数量、磁盘空间 ... -
Hadoop管理-集群维护
2012-07-03 15:27 49591.检查HDFS状态 fsck命令 1)f ... -
Hadoop 参数
2012-06-27 10:05 988转发自：http://www.cnblogs.com/g ...
相关推荐
ganglia the monitor tools for hadoop and so on
HADOOP监控GANGLIA安装文档，可以生成图表数据，包括cup，io，mapreduce 带宽
NULL 博文链接：https://cctype.iteye.com/blog/2035345
在您的 hadoop-env.sh 文件（通常在 /etc/hadoop/conf/ 中）中，将 GraphiteContext.jar 文件的位置添加到 HADOOP_CLASSPATH 示例：export HADOOP_CLASSPATH="/[path_to]/GraphiteMaven-1.1-SNAPSHOT.jar 配置： ...
在windows环境下开发hadoop时，需要配置HADOOP_HOME环境变量，变量值D:\hadoop-common-2.7.3-bin-master，并在Path追加%HADOOP_HOME%\bin，有可能出现如下错误： org.apache.hadoop.io.nativeio.NativeIO$Windows....
基于JMX和Ganglia的Hadoop性能监控平台，孙元成，李文生，Hadoop作为一个开源分布式系统架构，实现了分布式文件系统HDFS和MapReduce分布式计算框架。由于越来越多的网络应用使用Hadoop集群进行计��
基于ItemCF协同过滤、hadoop-mapreduce的商品推荐系统下载地址。 基于ItemCF的协同过滤 物品推荐系统 Collaborative filtering goods recommendation system based on ItemCF Step1.run(config, paths); // 格式化 ...
《Hadoop大数据开发实战》教学教案—01初识Hadoop.pdf《Hadoop大数据开发实战》教学教案—01初识Hadoop.pdf《Hadoop大数据开发实战》教学教案—01初识Hadoop.pdf《Hadoop大数据开发实战》教学教案—01初识Hadoop.pdf...
Hadoop 是一个处理、存储和分析海量的分布式、非结构化数据的开源框架。最初由 Yahoo 的工程师 Doug Cutting 和 Mike Cafarella Hadoop 是一个处理、存储和分析海量的分布式、非结构化数据的开源框架。最初由 Yahoo...
Hadoop是一个由Apache基金会所开发的分布式系统基础架构。用户可以在不了解分布式底层细节的情况下，开发分布式程序。充分利用集群的威力进 Hadoop是一个由Apache基金会所开发的分布式系统基础架构。用户可以在不...
org.apache.hadoop.metrics2.sink.ganglia org.apache.hadoop.metrics2.source org.apache.hadoop.metrics2.util org.apache.hadoop.net org.apache.hadoop.record org.apache.hadoop.record.compiler org....
本书从hadoop的缘起开始，由浅入深，结合理论和实践，全方位地介绍hado叩这一高性能处理海量数据集的理想工具。全书共14章，3个附录，涉及的主题包括：haddoop简介：mapreduce简介：hadoop分布式文件系统；hadoop的i...
hadoop-annotations-3.1.1.jar hadoop-common-3.1.1.jar hadoop-mapreduce-client-core-3.1.1.jar hadoop-yarn-api-3.1.1.jar hadoop-auth-3.1.1.jar hadoop-hdfs-3.1.1.jar hadoop-mapreduce-client-hs-3.1.1.jar ...
NULL 博文链接：https://daxiangwanju.iteye.com/blog/1962175
hadoop_tutorial hadoop入门经典 Hadoop 是一个能够对大量数据进行分布式处理的软件框架。Hadoop 是可靠的，因为它假设计算元素和存储会失败，因此它维护多个工作数据副本，确保能够针对失败的节点重新分布处理。...
hadoop2.7.3 Winutils.exe hadoop.dll
hadoop的dll文件 hadoop.zip
Hadoop 集群配置详解 Hadoop_Hadoop集群（第1期）_CentOS安装配置 Hadoop_Hadoop集群（第2期）_机器信息分布表 Hadoop_Hadoop集群（第4期）_SecureCRT使用 Hadoop_Hadoop集群（第5期）_Hadoop安装配置 Hadoop_Hadoop...
调用保存文件的算子，需要配置Hadoop依赖 将文件夹中的 hadoop-3.0.0 解压到电脑任意位置 在Python代码中使用os模块配置：os.environ[‘HADOOP_HOME’] = ‘HADOOP解压文件夹路径’ winutils.exe，并放入Hadoop解压...
大数据平台监控Ganglia加Nagios