`

Error during job, obtaining debugging information or java.lang.ClassNotFoundExc

    博客分类:
  • hive
 
阅读更多
Total MapReduce jobs = 1
Launching Job 1 out of 1
Number of reduce tasks determined at compile time: 1
In order to change the average load for a reducer (in bytes):
  set hive.exec.reducers.bytes.per.reducer=<number>
In order to limit the maximum number of reducers:
  set hive.exec.reducers.max=<number>
In order to set a constant number of reducers:
  set mapred.reduce.tasks=<number>
Starting Job = job_201203251957_0006, Tracking URL = http://master:50030/jobdetails.jsp?jobid=job_201203251957_0006
Kill Command = /usr/local/hadoop-0.20.203.0/bin/../bin/hadoop job  -Dmapred.job.tracker=hdfs://master:9001 -kill job_201203251957_0006
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2012-03-25 23:13:27,259 Stage-1 map = 0%,  reduce = 0%
2012-03-25 23:14:06,446 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201203251957_0006 with errors
Error during job, obtaining debugging information...
Examining task ID: task_201203251957_0006_m_000002 (and more) from job job_201203251957_0006
Exception in thread "Thread-143" java.lang.RuntimeException: Error while reading from task log url
        at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:130)
        at org.apache.hadoop.hive.ql.exec.JobDebugger.showJobFailDebugInfo(JobDebugger.java:211)
        at org.apache.hadoop.hive.ql.exec.JobDebugger.run(JobDebugger.java:81)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Server returned HTTP response code: 400 for URL: http://slave2:50060/tasklog?taskid=attempt_201203251957_0006_m_000000_1&start=-8193
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1436)
        at java.net.URL.openStream(URL.java:1010)
        at org.apache.hadoop.hive.ql.exec.errors.TaskLogProcessor.getErrors(TaskLogProcessor.java:120)


如果在执行hive的查询语句时出现以上错误,并且在http://192.168.200.128:50030/jobtracker.jsp中,查看错误信息,会有以下的错误信息:


java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:431)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:371)
at org.apache.hadoop.mapred.Child$4.run(Child.java:259)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.mapred.Child.main(Child.java:253)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 9 more
Caused by: java.lang.RuntimeException: Error in configuring object
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:34)
... 14 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
... 17 more
Caused by: java.lang.RuntimeException: Map operator initialization failed
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:121)
... 22 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:406)
at org.apache.hadoop.hive.ql.exec.ExecMapper.configure(ExecMapper.java:90)
... 22 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hive.contrib.serde2.RegexSerDe
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:247)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:819)
at org.apache.hadoop.hive.ql.exec.MapOperator.initObjectInspector(MapOperator.java:233)
at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:366)
... 23 more


这是因为要在执行hive语句的时候的加上lib文件中的hive_contrib.jar,因为在建表的时候加入了正则表达式。

执行的语句为:
hive> add jar ../lib/hive_contrib.jar ;
分享到:
评论

相关推荐

    从冰山获取淡水 obtaining fresh water from icebergs.docx

    从冰山获取淡水 obtaining fresh water from icebergs.docx

    OpenGL Shading Language, Second Edition

    Obtaining Version Information Section 7.2. Creating Shader Objects Section 7.3. Compiling Shader Objects Section 7.4. Linking and Using Shaders Section 7.5. Cleaning Up Section 7.6. Query Functions ...

    ddmlib-26.2.0-alpha15.jar

    最新的 ddmlib.jar ddmlib-26.2.0.jar 包,解决 (1) E/Screenshot: Unsupported protocol: 2 (2) Unexpected error while obtaining UI hierarchy java.lang.reflect.InvocationTargetException 导致的 uiautomator...

    Learn.Java.for.Android.Development_Apress.2010+src

    The book also briefly presents most (if not all) of Java version 7''s language features, although not much is said about closures or modules (which were not finalized at the time of writing). Java ...

    uiautomatorviewer更新文件.rar

    解决uiautomatorviewer报错问题,分享给大家。 Unexpected error while obtaining UI hierarchy # 点击Details java.lang.reflect.InvocationTargetException

    java sound programmer_guide.pdf 转自sun

    javax.sound.sampled.AudioSystem is the entry point to JavaSound for obtaining resources; i.e., mixers, lines, etc. And each method of AudioSystem involves getting the providers of some service—...

    tomcat权威指南第二版.pdf

    Obtaining the Source 349 Downloading Support Libraries 351 Building Tomcat 352 10. Tomcat Clustering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 354...

    Getting an Information Security Job For Dummies

    Getting an Information Security Job For Dummies March 9, 2015 pdf和kindle azw3版本 已去除加密 by Peter H. Gregory ISBN-13: 978-1119002819 ISBN-10: 1119002818 Get prepared for your Information ...

    Embedded Linux Primer.pdf

    Embedded or Not? Section 2.2. Anatomy of an Embedded System Section 2.3. Storage Considerations Section 2.4. Embedded Linux Distributions Section 2.5. Chapter Summary Chapter 3. Processor Basics ...

    【Linux Device Driver】(3edtion).pdf

    Obtaining Large Buffers 230 Quick Reference 231 9. Communicating with Hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235 I/O Ports and I/O Memory 235 Using I/O Ports ...

    spring-framework-reference4.1.4

    3.3. Java 8 (as well as 6 and 7) ............................................................................... 17 3.4. Java EE 6 and 7 ..................................................................

    spring-framework-reference-4.1.2

    3.3. Java 8 (as well as 6 and 7) ............................................................................... 17 3.4. Java EE 6 and 7 ..................................................................

    Redis 3.0 中文版 - v1.1.pdf

    第 1 章Redis 介绍. . . . . . . . . ....第 2 章数据类型初探....字符串 (Strings) ....列表 (Lists)....集合 (Sets) ....哈希 / 散列 (Hashes) ....有序集合 (Sorted sets) ....位图 (Bitmaps) 和超重对数 (HyperLogLogs) ....

    C/C++ GUI Programming with Qt4 (S - Jasmin Blanchette),pdf

    Part I: Basic Qt 1. Getting Started. 2. Creating Dialogs. 3. Creating Main Windows. 4. Implementing Application Functionality.... Introduction to C++ for Java and C# Programmers Index

    Google C++ International Standard.pdf

    Contents Contents ii List of Tables x List of Figures xiv 1 Scope 1 2 Normative references 2 3 Terms and definitions 3 4 General principles 7 4.1 Implementation compliance . ....4.2 Structure of this ...

    RESTful_Java_with_JAX-RS

    This book teaches you how to design and develop distributed web services in Java using RESTful architectural principles on top of the HTTP protocol. It is mostly a comprehensive reference guide on the...

    using-liferay-portal-6.2.pdf

    9.5 Find out what others think or do using Polls . . . . . . . . . . . . . . . . 239 9.6 Sending Alerts and Announcements in Your Portal . . . . . . . . . . . . 242 9.7 Staying in touch with the Chat ...

    Redis V3.0 中文文档

    第 1 章Redis 介绍. . . . . . . . . ....第 2 章数据类型初探....字符串 (Strings) .... ....列表 (Lists)....集合 (Sets) ....哈希 / 散列 (Hashes) ....有序集合 (Sorted sets) ....位图 (Bitmaps) 和超重对数 (HyperLogLogs) ....

    获取当前位置—Obtaining the Current Location.

    LocationManager类拥许多方法用于接受位置数据更新,在它里面最简单的形式,注册一个时间监听,用于识别来自位置数据更新的位置管理,以及设置最小时间和间隔距离。随着时间和位置间隔的更新,回调函数...

Global site tag (gtag.js) - Google Analytics