https://github.com/jrkinley/flume-interceptor-analytics
ylzhj02
- 浏览: 235575 次
- 性别:
- 来自: 成都
-
文章分类
- 全部博客 (294)
- Hadoop (34)
- mysql (9)
- operatingsystem (13)
- Hive (8)
- Hue (8)
- Pig (11)
- oozie (8)
- ZooKeeper (1)
- HBase (1)
- Spark (4)
- Impala (1)
- Lily (0)
- Solr (41)
- RS (0)
- Sqoop (10)
- Avro (0)
- Thrift (0)
- HDP (0)
- Bigtop (0)
- Redis (7)
- Java (6)
- Tez (6)
- Ambari (1)
- Mahout (25)
- MongoDB (9)
- Lucene (9)
- Nutch (1)
- Katta (1)
- UIMA (0)
- MediaProcess (1)
- linux (1)
- Design (2)
- AI (1)
- RTR (1)
- Docker (1)
- Splunk (0)
- OpenNLP (1)
- Carrot (3)
- LingPipe (0)
- Weka (0)
- Hama (9)
- CloudStack (0)
- Helix (0)
- Rave (0)
- jclouds (0)
- Giraph (0)
- Drill (0)
- Tajo (0)
- Kafka (3)
- Samza (0)
- Storm (23)
- Flume (15)
- Sifarish (1)
- ML (3)
- android (2)
- Theory (2)
- 系统架构 (2)
- Kiji (1)
- Neo4j (16)
- spanner (0)
- Ejabberd (0)
- Dropwizard (1)
- Tigon (1)
- OrientDB (1)
- Kite (2)
- Jubatus (4)
- Logstash (2)
- Kibana (0)
- Cassandra (0)
- Curator (1)
最新评论
-
oldrat：
https://github.com/oldratlee/tr ...
Kafka: High Qulity Posts
分享到：
发表评论
-
Flume: morphline sink with solr 5.1.0
2015-05-21 16:38 11551. down flume 1.5.2 source c ... -
Flume: avro source and sink
2015-04-17 11:12 739In order to flow the data acro ... -
Flume: hbase sink
2015-04-16 17:04 2870flume.conf a1.sinks.hbase-si ... -
Kafka: compile source code
2015-01-10 17:40 586#tar xzf kafka-0.8.1.1-src.tgz ... -
Real-time Clickstream Analytics using Flume, Avro, Kite Morphlines and Impala
2014-12-30 14:16 554http://techkites.blogspot.com/2 ... -
Data ETL tools for hadoop ecosystem Morphlines
2014-12-25 11:39 1315when i use there is a err ... -
open replicator
2014-12-22 20:35 537http://blog.csdn.net/men ... -
data replication from different databases
2014-12-22 10:22 552tungsten-replicator-3.0.0-524-s ... -
Flume: flume-ng-sql-source
2014-12-19 17:02 12091. download #git clone https ... -
flume source using mysql-replication-listener to realtime copy data from mysql
2014-12-18 11:46 681https://bitbucket.org/winebar ... -
Flume: compile source code and install
2014-12-18 11:44 11711. download source code #git ... -
Flume: high qulity blogs
2014-12-17 18:02 411基于Flume的美团日志收集系统(一)架构和设计 http ... -
Flume: books
2014-12-09 15:54 460Using Flume Flexible, Scalable ... -
Architecture of Flume NG
2014-12-05 12:29 488https://blogs.apache.org/flum ...
相关推荐
注意：flume-interceptor-1.0-SNAPSHOT.jar flume-interceptor-1.0-SNAPSHOT.jar flume-interceptor-1.0-SNAPSHOT.jar flume-interceptor-1.0-SNAPSHOT.jar flume-interceptor-1.0-SNAPSHOT.jar flume-interceptor-...
flume拦截器 保留binlog es、data、database、table、type字段 分区字段名称: eventDate 放入 /opt/cloudera/parcels/CDH/lib/flume-ng/lib目录重启flume即可
思路步骤：1、获取body数据（放到header ：将body里的数据根据类型，写到header）--->2、获取header--->3、向header中添加值--->追加数据值
flume-1.5.0-cdh5.3.6。 大数据日志收集工具 flume-1.5.0-cdh5.3.6。 大数据日志收集工具flume-1.5.0-cdh5.3.6。 大数据日志收集工具flume-1.5.0-cdh5.3.6。 大数据日志收集工具flume-1.5.0-cdh5.3.6。 大数据日志...
Flume-ng-1.6.0-cdh.zip 内压缩了 3 个项目，分别为：flume-ng-1.6.0-cdh5.5.0.tar.gz、flume-ng-1.6.0-cdh5.7.0.tar.gz 和 flume-ng-1.6.0-cdh5.10.1.tar.gz，选择你需要的版本。
flume-ng-sql-source-1.5.2.jar从数据库中增量读取数据到hdfs中的jar包
flume-ng安装
flume-ng-1.6.0-cdh5.5.0.tar.gz
flume-ng-sql-source-release-1.5.2.jar 用flume-ng-sql-source 从数据库抽取数据到kafka，支持sql
flume-ng-sql-source-1.5.3.jar，flume采集mysql数据jar包，将此文件拖入FLUME_HOME/lib目录下，如果是CM下CDH版本的flume，则放到/opt/cloudera/parcels/CDH-xxxx/lib/flume-ng/lib下，同样需要的包还有mysql-...
flume断点续传覆盖jar，使用组件flume-taildir-source-1.9.0覆盖flume/bin目录下的jar即可
flume-ng-sql-source-1.5.2源码
flume-ng-1.5.0-cdh5.3.6.rarflume-ng-1.5.0-cdh5.3.6.rar flume-ng-1.5.0-cdh5.3.6.rar flume-ng-1.5.0-cdh5.3.6.rar flume-ng-1.5.0-cdh5.3.6.rar flume-ng-1.5.0-cdh5.3.6.rar flume-ng-1.5.0-cdh5.3.6.rar flume...
flume-ng-sql-source-1.5.1 flume连接数据库 很好用的工具
spark-streaming-flume-sink_2.11-2.0.0.jar的jar包。
apache-flume-1.7.0-bin.tar.zip，解压后是tar包
flume-ng-1.6.0 cdh5.7.0安装包，稳定版本。大家可以自由下载
编译好的flume1.9.0，下载安装即可使用
apache旗下组件flume，用于数据的采集，主要包括数据的source、channel以及sink，提供1.7.0稳定版本