question Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe in Support Questions

Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

itdm_bmi — Thu, 27 Jul 2023 04:37:00 GMT

Hi,

I got an error when creating external table with multiple delimiter such as "||".

It says "Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe". I have tried add jar hive-contribute.3.1.3.jar, but still not working and also using regex.

My Cloudera Version is CDH 6.1.1.

How to solve this problem so i can achieve to set multiple delimiter in hive create external table?

Please help.

Sincerely,

Gideon Maruli

Bank Mayapada

Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

udeshmukh — Thu, 27 Jul 2023 08:16:41 GMT

Hi @itdm_bmi

Can you share the output of

ls -l /opt/cloudera/parcels/CDH/jars| grep -i contrib

Also, may i know what exact add command you executed ?

Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

itdm_bmi — Thu, 27 Jul 2023 08:33:36 GMT

Hi @udeshmukh,

Here's the output

I had tried these 2 commands

1. add jar /usr/lib/hive/lib/hive-contrib-3.1.3.jar;
2. add jar /opt/cloudera/parcels/CDH-6.1.1-1.cdh6.1.1.p0.875250/jars/hive-contrib-3.1.3.jar;

Sincerely,

Gideon Maruli

IT Data Management - Bank Mayapada

Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

udeshmukh — Thu, 27 Jul 2023 08:41:17 GMT

Hi @itdm_bmi

Please try to add the 2nd jar "hive-contrib-2.1.1-cdh6.1.1.jar"

Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

itdm_bmi — Thu, 27 Jul 2023 10:18:23 GMT

I did, but still get same error.

Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

itdm_bmi — Fri, 28 Jul 2023 04:14:12 GMT

Hi @udeshmukh,

Can you help me with another solution?

Sincerely,

Gideon Maruli

Bank Mayapada

Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

udeshmukh — Fri, 28 Jul 2023 06:39:09 GMT

Hi @itdm_bmi

After adding the jar ,

Instead of

ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerde'

Please try

ROW FORMAT SERDE 'org.apache.hadoop.hive.contrib.serde2.MultiDelimitSerDe'

Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

VidyaSargur — Mon, 31 Jul 2023 15:47:04 GMT

@itdm_bmi, Have the replies from @udeshmukh helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.

Re: Cannot validate serde: org.apache.hadoop.hive.serde2.MultiDelimitSerDe

itdm_bmi — Tue, 01 Aug 2023 04:21:59 GMT

Hi,

Sorry to make you waiting. Yes, that solution resolved the issue.

But i have 1 more issue.

After the data successfully inserted to textfile table. Then i need to insert the data to parquet table from textfile table. But it failed insert to parquet table. Error message: "[FATAL] 10:25:08 vaproject.vmlog_0_4.VMLOG- tHiveRow_1 Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask".

What is wrong or missing? Please need your help. Thank you.

Sincerely,

Gideon Maruli

IT Data Management - Bank Mayapada