question Re: Hive Partitioning in Archives of Support Questions (Read Only)

Hive Partitioning

Geek007 — Sun, 30 Apr 2017 03:51:43 GMT

Hi All,

I am using cloudera 4.3.0. (System Config:-iIntel i3 Processor with 8GB RAM)Trying to create a Partitioning in Hive. Below is the detail:-

CREATE TABLE partitioned_user(
firstname VARCHAR(64),
lastname VARCHAR(64),
address STRING,
city VARCHAR(64),
post STRING,
phone1 VARCHAR(64),
phone2 STRING,
email STRING,
web STRING
)
PARTITIONED BY (country VARCHAR(64), state VARCHAR(64))
STORED AS SEQUENCEFILE;

But getting error as "FAILED: ParseException line 2:10 cannot recognize input near 'VARCHAR' '(' '64' in column type".

Can anyone please assist.

Thank You.

Re: Hive Partitioning

kushalbohra — Sun, 30 Apr 2017 11:38:14 GMT

Probably your version of hive is old. Check below.

Varchar datatype was introduced in Hive 0.12.0 (HIVE-4844).

Re: Hive Partitioning

Geek007 — Sun, 30 Apr 2017 16:32:13 GMT

Hi Kushal,

Thanks for the response.

I am using Hadoop 2.0.0-CDH4.3.0. So it should work (Please check https://hive.apache.org/downloads.html)

Is there any other possible reason ?

Re: Hive Partitioning

kushalbohra — Sun, 30 Apr 2017 20:22:26 GMT

As mentioned before Hive version 0.12 ships varchar datatype, based on your cdh4.3.0 it looks like hive version is 0.10 (ref: https://archive.cloudera.com/cdh4/cdh/4/hive-0.10.0-cdh4.3.0.releasenotes.html )

Re: Hive Partitioning

csguna — Wed, 03 May 2017 13:00:42 GMT

SInce you have mentioned that you are using CDH4.3.0 - it ships with hive-0.10.0+121

please refer the link

VARCHAR can be used with CDH 5.2 and higher (i,e Hive 0.12.0)

Re: Hive Partitioning

Geek007 — Wed, 03 May 2017 19:27:10 GMT

Thanks for the response.

I tried to add CDH 5.10 with VMware player. But the Cloudera Manger icon is missing. Could you please advice.

Re: Hive Partitioning

csguna — Thu, 04 May 2017 02:02:34 GMT

That is strange .

I hope you are using

username: cloudera

could you check on the home /Desktop directory of the user.

Could you please take a look into this quickly to make sure your setup is good.

https://community.cloudera.com/t5/Hadoop-101-Training-Quickstart/How-to-setup-Cloudera-Quickstart-Virtual-Machine/ta-p/35056

Re: Hive Partitioning

cjervis — Thu, 04 May 2017 13:06:09 GMT

@Geek007 wrote:

Thanks for the response.

I tried to add CDH 5.10 with VMware player. But the Cloudera Manger icon is missing. Could you please advice.

I believe the "Launch Cloudera Manager" icon has been replaced with a "Launch Cloudera Express" icon. I'm checking with my contacts to confirm and get the QuickStart VM download page updated with the new wording if needed.

Re: Hive Partitioning

cjervis — Fri, 05 May 2017 13:48:34 GMT

Following up on this. I can confirm that the Launch Cloudera Manager icon has been replaced with icons to lauch Cloudera express or the Cloudera Enterprise trial. The team is working to update the wording on the download page to reflect this. Sorry for the confusion.

Re: Hive Partitioning

Geek007 — Sat, 06 May 2017 03:13:16 GMT

Hello Jervis,

Thanks for the response.

So currently is it fine to use CDH 5.10 without getting Cloudera Manager ?

I have already downloaded CDH 5.10. So is it required to download it again once the update about the wording will be done or it will auto-reflect the Cloudera Manager ?

Re: Hive Partitioning

cjervis — Sat, 06 May 2017 12:38:28 GMT

My understanding is that the Quickstart VM will not change the icon and it will remain with the new wording. The only changes will be to the download page and other documentation that reference launching Cloudera Manager in the VM. You only need to use those icons if you wish to use Cloudera Manager otherwise you simply use CDH manually. Here is a page explaining the differences between Cloudera Express and Cloudera Enterprise. Keep in mind that the Cloudera Enterprise icon only e nables the additional features for a trial period. If you only need to use Cloudera Manager the Cloudera Express route is your most likely route.

Also keep in mind that when using Cloudera Manager there is a greater need for resources to be allocated to the VM to handle it. You can read about it in the How to setup a Cloudera Quickstart Virtual Machine article.