Reply
Contributor
Posts: 49
Registered: ‎07-26-2016

Re: Hive not responding for Twitter analysis

Console Output:

2016-11-03_0956.png

Contributor
Posts: 49
Registered: ‎07-26-2016

Re: Hive not responding for Twitter analysis

Please help me on this..

 

Thanks,

Syam.

Cloudera Employee
Posts: 16
Registered: ‎01-07-2014

Re: Hive not responding for Twitter analysis

Hi syamsri,

 

This seems like a permission issue. As indicated by the exception, please verify if appropriate write

permissions exist for table directory.

 

Thanks.

Contributor
Posts: 49
Registered: ‎07-26-2016

Re: Hive not responding for Twitter analysis

Hi Mohit,

 

Thanks for the reply,

I have given all permissions for the tweets folder.

 

Thanks,

Syam.

Champion
Posts: 753
Registered: ‎05-16-2016

Re: Hive not responding for Twitter analysis

if it is just a vm that you are playin around , disable the security in the hdfs-site.xml 

 

 by setting the below property to false in hdfs-site.xml

 

<property>
<name>dfs.permissions.enabled</name>
<value>false</value>
</property>

After setting please restart the all.

 

OR 

 

sudo -u hdfs hadoop fs -chmod  -R 777  /solr/twitter_demo/core_node1/data/tlog

 

you have to give the 

Contributor
Posts: 49
Registered: ‎07-26-2016

Re: Hive not responding for Twitter analysis

Hi Guna,

 

Thanks again for the reply,

The Stated property is not there in hdfs-site.xml .

Shall i add ?

 

I am not using solr .

I want Hive analysis on twitter data which came via Flume.

 

Thanks,

Syam.

Champion
Posts: 753
Registered: ‎05-16-2016

Re: Hive not responding for Twitter analysis

[ Edited ]

Yes please add the property if it is not there and if you are ok in disabling the security

also restart everything , in order to publish the change in the hdfs-site.xml

Contributor
Posts: 49
Registered: ‎07-26-2016

Re: Hive not responding for Twitter analysis

Hi Guna,

 

I have added the property as you stated and restarted.

But this error is repeating.

2016-11-15_1419.png

 

Appreciate your help.

Thanks,

Syam.

Champion
Posts: 753
Registered: ‎05-16-2016

Re: Hive not responding for Twitter analysis

This time it didnt complain about the permission error that you got last time.

please issue the below commands. 

 

MSCK REPAIR TABLE table_name;
analyze table table_name  compute statistics;

the above should refresh the metadata and try select * from tablename;

 

 

Contributor
Posts: 49
Registered: ‎07-26-2016

Re: Hive not responding for Twitter analysis

Hi Guna,

 

Thanks again,

Please check the scrreen shots. Same error

 

2016-11-17_0331.png2016-11-17_0332_002.png2016-11-17_0332.png2016-11-17_0332_001.png2016-11-17_0334.png

Thanks,

Syam.

Announcements