knight_black_bob
- 浏览: 824517 次
- 性别:
- 来自: 北京
-
最新评论
-
knight_black_bob：
chenhua1228 写道楼主，怎开启服务哦？Constan ...
仿QQ android 实战（学习 android 先来个QQ） -
knight_black_bob：
chenhua1228 写道楼主，怎开启服务哦？Constan ...
仿QQ android 实战（学习 android 先来个QQ） -
chenhua1228：
楼主，怎开启服务哦？Constants这个类里的 Stri ...
仿QQ android 实战（学习 android 先来个QQ） -
masuweng：
身份证 验证 -
knight_black_bob：
kevinflynn 写道看了这篇文章，受益匪浅，点赞！！！ ...
elk(日志监控系统搭建),elastic search,kibana,logstash,filebeat搭建
文章列表
问题：
[zkkafka@yanfabu2-37 ~]$ sqoop import \
> --connect jdbc:mysql://10.156.50.36:3306/mqh \
> --username root \
> --password root \
> --table device \
> --fields-terminated-by '\t' \
> --delete-target-dir \
> --num-mappers 1 \
> --hive-import \
> --hive-da ...
[sqoop1 error] Got exception running Sqoop java.lang.NullPointerException at org
问题：
[zkkafka@yanfabu2-35 tmp]$ sqoop job --create sqoop_job_device -- import --connect jdbc:mysql://10.156.50.36:3306/mqh \
> --username root \
> --password root \
> --query "select deviceid ,appi ...
0.准备工作 hadoop 服务器
10.156.50.35 yanfabu2-35.base.app.dev.yf zk1 hadoop1 master1 master
10.156.50.36 yanfabu2-36.base.app.dev.yf zk2 hadoop2 master2
10.156.50.37 yanfabu2-37.base.app.dev.yf zk3 hadoop3 slaver1
1.解压 sqoop
tar xf sqoop-1.4.7.bin__hadoop-2.6.0.tar.gz
scp sqoop-1.4.7 ...
hive-ha 安装
0.准备工作 hadoop 服务器
10.156.50.35 yanfabu2-35.base.app.dev.yf zk1 hadoop1 master1 master
10.156.50.36 yanfabu2-36.base.app.dev.yf zk2 hadoop2 master2
10.156.50.37 yanfabu2-37.base.app.dev.yf zk3 hadoop3 slaver1
1. 安装mysql
rpm -qa | grep postfix
rpm -qa | grep ...
问题
[zkkafka@yanfabu2-36 tmp]$ schematool -dbType derby -initSchema
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/zkkafka/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/zkkafka/ha ...
问题
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/zkkafka/hive/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/zkkafka/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j ...
错误日志
[zkkafka@yanfabu2-35 ~]$ hbase shell
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/zkkafka/hbase/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/zkkafka/hadoop/share/hadoop/common/li ...
[solve] [linux] Insufficient space for shared memory file
[dp@yanfabu2-31 ~]$ jps
Java HotSpot(TM) 64-Bit Server VM warning: Insufficient space for shared memory file:
/tmp/hsperfdata_dp/84289
Try using the -Djava.io.tmpdir= option to select an alternate temp location.
解决方 ...
nexus 3.0 配置
1. 修改本地maven中setting.xml 文件 修改profile仓库地址
<profile>
<id>local-nexus</id>
<repositories>
<repository>
<id>local-nexus</id>
<name>Team Nexus Repository</name>
<!--
<url>http://10.153.10.10 ...
解决 【MYSQL】Caused by java.sql.SQLException Unknown system variable 'tx_read_only'
Caused by: java.sql.SQLException: Unknown system variable 'tx_read_only'
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:996)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3887)
at co ...
【解决】mariadb-libs is obsoleted by mysql-community-libs-5.7.17-1.el6.x86_64
问题
[root@fdfs-mysql1 ~]# rpm -ivh mysql-community-libs-5.7.17-1.el6.x86_64.rpm
warning: mysql-community-libs-5.7.17-1.el6.x86_64.rpm: Header V3 DSA/SHA1 Signature, key ID 5072e1f5: NOKEY
error: Failed dependencies:
...
linux hadoop-ha 三台机器 安装
0.规定
IP hostname role
10.156.50.35 master1 主节点
10.156.50.36 master2 备份主节点
10.156.50.37 slaver1 从节点
1. 创建 zkkafka 用户
useradd zkkafka
passwd zkkafka
...
fastdfs nginx 安装
0.准备
关闭防火墙
systemctl stop firewalld.service #停止firewall
systemctl disable firewalld.service #禁止firewall开机启动
firewall-cmd --state #查看默认防火墙状态（关闭后显示notrunning，开启后显示running）
service iptables stop #临时关闭防火墙
chkconfig iptables off #永久关闭防火墙
1.依赖文件
fastdfs-nginx-module ...
错误日志
file: /usr/local/fastdfs-nginx-module/src/common.c, line: 877, stat file: /home/fdfs_storage/data/00/00/CpzruVzRFqGAQ_igAAAEPrcuF7E509.jpg fail, errno: 13, error info: Permission denied
修改
chmod 755 /etc/fdfs
/usr/bin/fdfs_trackerd /etc/fdfs/tracker.conf restart
/usr/bi ...
linux 日志kafka 写mongodb
1. 安装 java
jdk-8u151-linux-x64.tar.gz
scp -r *.tar.gz zkkafka@10.156.50.36:/home/zkkafka/
scp -r *.tar.gz zkkafka@10.156.50.37:/home/zkkafka/
tar xf jdk-8u151-linux-x64.tar.gz
vi ~/.bash_profile
export PATH
export LANG="zh_CN.utf8"
expo ...