hadoop抛出如下异常:
[INFO] Exception in createBlockOutputStream java.io.IOException: Bad connect ack with firstBadLink xxx.xxx.xxx.xxx:50010
[INFO] Abandoning block blk_6251991629364444942_18501788
同时在Datanode上看到如下异常:
INFO org.apache.hadoop.dfs.DataNode: Receiving
block blk_4171702026185885604 src: /xxx.xxx.xxx.xxx:36669
dest: /xxx.xxx.xxx.xxx:50010
INFO org.apache.hadoop.dfs.DataNode: writeBlock
blk_4171702026185885604 received exception
java.net.NoRouteToHostException: No route to host
ERROR org.apache.hadoop.dfs.DataNode:
xxx.xxx.xxx.xxx:50010:DataXceiver: java.net.NoRouteToHostException: No
route to host
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect
(SocketChannelImpl.java:574)
at sun.nio.ch.SocketAdaptor.connect(SocketAdaptor.java:100)
at org.apache.hadoop.dfs.DataNode$DataXceiver.writeBlock
(DataNode.java:1150)
at org.apache.hadoop.dfs.DataNode$DataXceiver.run(DataNode.java:994)
at java.lang.Thread.run(Thread.java:619)
经查证是做link copy connect出现的问题,关掉所有Datanode上的iptables,发现恢复正常。
分享到:
相关推荐
实战Hadoop 2.0:从云计算到大数据(第二版)
Hadoop安全:大数据平台隐私保护 Hadoop安全:大数据平台隐私保护 Hadoop安全:大数据平台隐私保护
当启动hadoop或者使用ssh时出现: 输入ifconfig指令发现:自己之前配置的ip:192.168.79.103地址已经发生了变化 怎么解决办法呢? 如下步骤: 重新修改静态ip 输入vi /etc/udev/rules.d/70-persistent-net.rules...
Hadoop实战:Hadoop in Action
大数据安全-kerberos技术-hadoop安装包,hadoop版本:hadoop-3.3.4.tar.gz
Apache Hadoop YARN:Moving beyond MapReduce and Batch Processing with Apach 2 【yarn权威指南】
Hadoop大数据:处理技术基础与实践
"Data Analytics with Hadoop: An Introduction for Data Scientists" ISBN: 1491913703 | 2016 | PDF | 288 pages | 7 MB Ready to use statistical and machine-learning techniques across large data sets? ...
NULL 博文链接:https://ouyida3.iteye.com/blog/1144326
hadoop权威指南代码 (Hadoop: The Definitive Guide code) http://www.hadoopbook.com
Hadoop安全:大数据平台隐私保护,让集群数据可以更加安全,按照文档中内容操作,可以保障集群中的数据
Hadoop databases: Hive, Impala, Spark, Presto For ORACLE DBAs
Hadoop实例:二度人脉与好友推荐,供大家一起共同分享学习。
hadoop2.7汇总:新增功能最新编译64位安装、源码包、API、eclipse插件下载
Hadoop: The Definitive Guide is a comprehensive resource for using Hadoop to build reliable, scalable, distributed systems. Programmers will find details for analyzing large datasets with Hadoop, and...
英文版,中文书名:Hadoop YARN权威指南。高清完美原书PDF版本,非MOBI版。
Big Data Processing With Hadoop
NULL 博文链接:https://mr-lili-1986-163-com.iteye.com/blog/1095200