Member since
05-24-2023
9
Posts
0
Kudos Received
0
Solutions
11-12-2023
09:17 PM
Hi @Scharan, I try it but the same error message still coming.
... View more
11-04-2023
03:44 AM
Hi All, I am upgrading cloudera manager from version 6.1.1 to 7.7.1 and when starting the cloudera-scm-server service I get the following error 2023-11-04 15:53:32,946 ERROR main:com.cloudera.enterprise.dbutil.SqlFileRunner: Exception while executing ddl scripts. com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Duplicate column name 'DISPLAY_NAME' What should I do to handle the error? please your advice for me. Thanks
... View more
Labels:
- Labels:
-
Cloudera Manager
08-14-2023
02:39 AM
Sorry took a long time to reply, I couldn't find that application_id anymore. So i try new task, just simply data insertion query with application_id = application_1690451589703_37927 In log file i think i found the error. It is written "Caused by: java.lang.RuntimeException: Map operator initialization failed at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:137) ... 22 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe not found at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:326) at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:361) at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:106) ... 22 more Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2409) at org.apache.hadoop.hive.ql.plan.PartitionDesc.getDeserializer(PartitionDesc.java:170) at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:292) ... 24 more 2023-08-14 14:41:08,061 INFO [IPC Server handler 11 on 42850] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Diagnostics report from attempt_1690451589703_37927_m_000000_1: Error: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:113) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:462) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1731) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110) ... 9 more Caused by: java.lang.RuntimeException: Error in configuring object at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:113) at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79) at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137) at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:38) ... 14 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110) ... 17 more Caused by: java.lang.RuntimeException: Map operator initialization failed at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:137) ... 22 more Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe not found at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:326) at org.apache.hadoop.hive.ql.exec.MapOperator.setChildren(MapOperator.java:361) at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.configure(ExecMapper.java:106) ... 22 more Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe not found at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2409) at org.apache.hadoop.hive.ql.plan.PartitionDesc.getDeserializer(PartitionDesc.java:170) at org.apache.hadoop.hive.ql.exec.MapOperator.getConvertedOI(MapOperator.java:292) ... 24 more" Sorry i cant share the log file.
... View more
08-01-2023
11:33 PM
Hi,
After Multi Delimiter Issue is solved. I got an error with data insertion.
So, after the data successfully inserted to text file format table with rowserde hive.contrib.serde2.MultiDelimitSerDe. Then i need to insert those data to parquet format table.
But when i ran the query to insert data, it failed.
Error message: "[FATAL] 10:25:08 vaproject.xxx tHiveRow_1 Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask".
I used this script:
"INSERT OVERWRITE TABLE ParquetTable PARTITION (datadt=dateint) SELECT * FROM TextFileTable"
What is wrong or what am i missing? Please need your help. Thank you.
Sincerely,
Gideon Maruli
IT Data Management
... View more
Labels:
07-31-2023
09:21 PM
Hi, Sorry to make you waiting. Yes, that solution resolved the issue. But i have 1 more issue. After the data successfully inserted to textfile table. Then i need to insert the data to parquet table from textfile table. But it failed insert to parquet table. Error message: "[FATAL] 10:25:08 vaproject.vmlog_0_4.VMLOG- tHiveRow_1 Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask". What is wrong or missing? Please need your help. Thank you. Sincerely, Gideon Maruli IT Data Management - Bank Mayapada
... View more
07-27-2023
09:14 PM
Hi @udeshmukh, Can you help me with another solution? Sincerely, Gideon Maruli Bank Mayapada
... View more
07-27-2023
03:18 AM
I did, but still get same error.
... View more
07-27-2023
01:33 AM
Hi @udeshmukh, Here's the output I had tried these 2 commands 1. add jar /usr/lib/hive/lib/hive-contrib-3.1.3.jar; 2. add jar /opt/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.875250/jars/hive-contrib-3.1.3.jar; Sincerely, Gideon Maruli IT Data Management - Bank Mayapada
... View more
07-26-2023
09:37 PM
Hi, I got an error when creating external table with multiple delimiter such as "||". It says "Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe". I have tried add jar hive-contribute.3.1.3.jar, but still not working and also using regex. My Cloudera Version is CDH 6.1.1. How to solve this problem so i can achieve to set multiple delimiter in hive create external table? Please help. Sincerely, Gideon Maruli Bank Mayapada
... View more
Labels:
- Labels:
-
Apache Hive
-
Cloudera Navigator