About csguna

csguna · ‎06-28-2017

Thanks for the detail information , appreciated it .

csguna · ‎06-28-2017

Would you consider using Bucketing instead of partitioning because it decomposes data sets into much more manageable parts but still depends on the use case. insertion may take some time but intended for fast read .

csguna · ‎06-28-2017

@mbigelow " It is part of the magic that happens when you install a gateway role " Are you referring to the NFS gateway role ?

csguna · ‎06-27-2017

@Tim Armstrong As suggested I bumped the JAVA_TOOL_OPTIONS=-Xss2m . do you have any rational behind for -Xss2m ? can we increase it more does it depends on any parameter like number of quries and hits to impala daemon .

csguna · ‎06-27-2017

@Tomas79i am ruining CDH 5.10 in production it is nice and clean However when we performed a fresh install on other box we had this JRE issue . fixed it with your post . Apprecaited it .

csguna · ‎06-27-2017

Is you cluster managed by cloduera manager ? if not it is pretty straight forward you can grab it from /etc/hadoop/conf/ grab the core-site.xml , hdfs-site.xml , hive-site.xml

csguna · ‎06-27-2017

Did you set your datanode secure port to 1004 ? Since I dont know the exact configuration in your system I assume that enabling the below should fix your problem based on the error that you had shown. hadoop.rpc.protection = privacy (core-site.xml) dfs.encrypt.data.transfer to true (hdfs-site.xml) Restart all the dameons to effect .

csguna · ‎06-27-2017

Could you check the parameter value of this in your ruining datanode hdfs-site.xml dfs.data.transfer.protection = ?

csguna · ‎06-27-2017

Although I havent tried , trying putting 777 on the chmod to that directory and run it as root. chmod -R 777 /etc/init.d/ it is very very bad practice though.

csguna · ‎06-27-2017

I hope you are using CDH trying runining the below sudo service hadoop-hdfs-datanode start sudo service hadoop-hdfs-namenode start sudo service hadoop-hdfs-secondarynamenode start then replace start with status / restart . create a normal user , dont use root add the user to group hadoop

Online	Offline
Last Visited	‎10-28-2024 06:24 AM

Member Since	‎05-16-2016 09:33 PM
Last Visited	‎10-28-2024 06:24 AM
Posts	785
Kudos received	112

Cloudera Community

Re: Kerberos / Sentry Integration

Re: How to upgrade Hive from 2.1 to 3.0 via CDH 6....

Re: How does nameservice id works for HA, how does...

Re: What license does the express edition fall und...

Re: Sqoop2 over Sqoop1 in CDH6

Re: Impala cannot start SIGBUS crash

Re: Hive Partitioning - maximum for cluster

Re: Configure hadoop-client tools to access hdfs f...

Re: Impala cannot start SIGBUS crash

Re: Impala cannot start SIGBUS crash

Re: Configure hadoop-client tools to access hdfs f...

Re: DataNode service failed with Exception in secu...

Re: DataNode service failed with Exception in secu...

Re: Datanode failing to start as root user

Re: Datanode failing to start as root user