question Re: Hive Insert into table issue in Support Questions

Hive Insert into table issue

lruizr — Mon, 14 Aug 2017 19:35:56 GMT

I need to create a table with just a field, which is a map of string: string. I have created the table without problems, but when I try to insert the values (they are defined, not in another table) I am not able to achieve it. The code is below.

create table comunidades ( codigo MAP<STRING, STRING> );
INSERT INTO TABLE comunidades SELECT 1, {"AND": '01'};

Re: Hive Insert into table issue

balavignesh_nag — Mon, 14 Aug 2017 20:46:20 GMT

@Luis Ruiz

Are you trying to insert from one table to another and facing this issue?

If that is the case then when you are inserting from one table to another then you may need to convert the columns into MAP as you have used MAP in the second table.

Re: Hive Insert into table issue

jvaria — Tue, 15 Aug 2017 01:16:26 GMT

@Luis Ruiz

You should use map() complex type constructor in your insert statement.

insert into table testMap SELECT map('AND','01');

You can find more details about complex type constructors from here:

https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF

Re: Hive Insert into table issue

lruizr — Wed, 16 Aug 2017 14:19:57 GMT

@Jagruti Varia

I've just tried your command and it returns an error. I'm using the Hortonworks Sandbox, and I don't understand why it throws that error.

org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: ParseException line 1:52 Failed to recognize predicate '<EOF>'. Failed rule: 'regularBody' in statement

Re: Hive Insert into table issue

Shelton — Wed, 16 Aug 2017 16:22:30 GMT

@Luis Ruiz

I tried recreating your situation and it worked. see attached.To use the map function the source tables should already exist. I used a text file ruiz.txt with values

$ cat ruiz.txt
"AND": '01'
"TOO": '02'
"MORE": '03'

Hope that helps please accept the reponse if it resolved your problem!

Re: Hive Insert into table issue

lruizr — Wed, 16 Aug 2017 16:51:14 GMT

@Geoffrey Shelton Okot

I have repeated your steps in Ambari and it throws me an error (below). I have checked the community entries and it's something repeated. I don't know if there is a solution yet for this issue.

java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask

Re: Hive Insert into table issue

Shelton — Wed, 16 Aug 2017 17:14:14 GMT

@Luis Ruiz

Try this

# cd /tmp/data

# su - hdfs

$ hdfs dfs -copyFromLocal autonomias.txt  /apps/hive/warehouse/

$ hdfs dfs -chown -R hive:hive  /apps/hive/warehouse/

hive> load data inpath '/apps/hive/warehouse/autonomias.txt' into table comunidades;

Tell me that should work

Re: Hive Insert into table issue

lruizr — Wed, 16 Aug 2017 17:31:41 GMT

@Geoffrey Shelton Okot

In Ambari I have no terminal client, I upload files through a visual interface and the permissions for the file and folder are all enabled. I though the same, a problem with the permissions, but not. I don't know if the Sandbox is limited in some Hive operations

Re: Hive Insert into table issue

Shelton — Wed, 16 Aug 2017 18:21:23 GMT

@Luis Ruiz

Install putty to interact with your sandbox from your desktop, let download what is the version of sandbox?

Re: Hive Insert into table issue

lruizr — Wed, 16 Aug 2017 18:32:04 GMT

@Geoffrey Shelton Okot

Yes I know about putty, but it is possible to do also from Ambari. I will try to do it from putty.

The version of the sandbox is 2.6.1 for VirtualBox. It's available here: https://es.hortonworks.com/downloads/#sandbox

Re: Hive Insert into table issue

lruizr — Wed, 16 Aug 2017 18:55:05 GMT

@Geoffrey Shelton Okot

The table was filled in the previous actions, but the Ambari platform throws me the specified error above. Now I would need to specify the values into file ruiz.txt as proper key-value pairs, and not inserting null after the file rows. I'll look how to do it. Thank you very much for your patience

Re: Hive Insert into table issue

Shelton — Wed, 16 Aug 2017 19:05:47 GMT

@Luis Ruiz

Nice to know it helped, that's the open source spirit 🙂

Re: Hive Insert into table issue

lruizr — Wed, 16 Aug 2017 19:12:38 GMT

Yes, it's the better way to solve problems 🙂