`
liyonghui160com
  • 浏览: 761360 次
  • 性别: Icon_minigender_1
  • 来自: 北京
社区版块
存档分类
最新评论

shell判断hdfs文件目录是否存在

阅读更多

 

hadoop有提供相应的脚本去验证文件目录是否存在的:

 

-bash-3.2$ hadoop fs -help  
...  
-test -[defsz] <path>:    Answer various questions about <path>, with result via exit status.  
          -d  return 0 if <path> is a directory.  
          -e  return 0 if <path> exists.  
          -f  return 0 if <path> is a file.  
          -s  return 0 if file <path> is greater than zero bytes in size.  
          -z  return 0 if file <path> is zero bytes in size.  
        else, return 1. 

 

检验昨天产生的目录是否产生的shell脚本: 

 

yesterday=$(date -d '-1 day' '+%Y-%m-%d')  
hadoop fs -test -e /user/hive/warehouse/yhd_gmv_month/ds=$yesterday  
if [ $? -eq 0 ] ;then  
    echo 'exist'  
else  
    echo 'Error! Directory is not exist'  
fi

 

分享到:
评论

相关推荐

Global site tag (gtag.js) - Google Analytics