About csguna

csguna · ‎02-25-2021

Please mark and give us kudos so it encourages the fellow users to contribute more !

csguna · ‎05-07-2020

navencrypt is setup on workers nodes in our cluster. After OS patching we found that one of the encrypted "fs /datax " got unmounted and it went un noticed for serveral days , reason for the mount failure could not be determined as syslog, dmesg was already rotated out , but we are sure that filesystem was not umounted with the Navencrypt tool.. Would like to know if there is any kind of alerting / monitoring that we can do in Cloudera manager ?

csguna · ‎12-12-2019

Could you try performing the "Validate hivemetastore schema " from Cloudera manager - > Hive service then Let us know if you are able to create the same table.

csguna · ‎10-10-2019

This is really a nice article. Kudos to you.

csguna · ‎09-08-2019

Please let me know if the below link helps https://www.cloudera.com/documentation/enterprise/latest/topics/cm_mc_adding_hosts.html#cmug_topic_7_5_1__title_215

csguna · ‎09-03-2019

Could you share the error ? Do you have sqoop client being installed on the node ? whats you mysql cnf file looking if you have this skip-networking just comment it out and restart the mysql i assume it your poc box.

csguna · ‎07-12-2019

Hi Can anyone let me know the bug / fixed version of SPARK - 8617 in CDH spark version .

csguna · ‎06-12-2019

my 1st question is it possible to add Kerberos security/authentification ? Yes you can enable kerberos . my 2nd question is should i go for Kerberos or Sentry ? Sentry is for authorzation , It supports secure access to services using Kerberos. Kerberos is for authentication . Hope this helps.

csguna · ‎06-06-2019

Embedded mode - it can support only one active user at a time.

csguna · ‎06-05-2019

Could you let me know what is the issue you are facing ? whats the error ?

csguna · ‎05-28-2019

The rational behind the permission denied ERROR The /user/ directory is owned by "hdfs" with 755 permissions. As a result only hdfs can write to that directory.

csguna · ‎05-28-2019

Can you fire the below command sudo -u hdfs hadoop fs -mkdir /user/butmah sudo -u hdfs hadoop fs -chown butmah /user/butmah

csguna · ‎05-28-2019

Didnt quite understand your requirement Could you provide some more information

csguna · ‎05-28-2019

I assume you want to make want to have column-level authorization with the SELECT privilege if so you need an AD account . then create role and then grant role to group . then finally perform the below step GRANT SELECT <column name> ON TABLE <table name> TO ROLE <role name>; Please go through this link and let me know if you need any more information https://www.cloudera.com/documentation/enterprise/5-5-x/topics/sg_hive_sql.html#create_role_statement

csguna · ‎05-27-2019

is it possible to upgrade it manually? Yes it possible however , you are doing at your own risk as cloudera does not recommend usually if you are using package that its pretty straight forward , if you want to use parcel then you have to write your own custom parcel to deploy hive binaries that you want. Currenty on latest CDH 6.2. CDH 6.2 comes with Apache Hive 2.1.1 By using the above you are guaranteed that everything has been tested, bugs have been fixed, and things will roll out smoothly

csguna · ‎05-20-2019

Let me know if you need any more information.

csguna · ‎05-20-2019

You can perform lastmodified option. Something like the below sqoop import \ --connect --username --password --table --incremental lastmodified \ --check cloumn last_updated_date_or anything that is according to your table --last--vaule " 2101-02-22 01:02:12"

csguna · ‎05-20-2019

What repository have you put it ? Did you chose the cloudera archive one ?

csguna · ‎05-13-2019

Antony Are there really chances that I could get into Big Data administration ? Yes I am the example I am an Oracle Dba as well with 10g 🙂 certification . Previously was a Java Developer . Nothing should stop you to pursuing another role .if you have already completed your cloudera hadoop certification then you should be able to land in a job very easily. please ping me in direct message I should be able to refer few of the opening if you are interested.

csguna · ‎04-28-2019

please provide Hue role log ? and possibly some screenshot of your CM

csguna · ‎04-28-2019

Are you kicking of any hdfs replication ? Could you provide the cm and cdh version ?

csguna · ‎04-28-2019

Could you provide more log message or screenshot for troubleshooting your issue btw were you able to perform ping from 2nd to 3 host vice versa ?

csguna · ‎04-28-2019

Hi Take a peek in to the below , please try in your lower enviroment and validate before moving to production box. https://community.cloudera.com/t5/Data-Discovery-Optimization/Navigator-metadata-server-keep-on-crashing-after-changing-to/td-p/60139

csguna · ‎02-18-2019

what do you have in this file - /data/dev1/consumption/crm sorry i am not quite getting your requirement ? if i understand clearly you want to load the data to the table with parquet format ?

csguna · ‎01-06-2019

I have not tested ? but would you consider deploying a Hbase gateway role on the host you are ruining ?

csguna · ‎01-01-2019

could you share the CM web ui front page .

csguna · ‎01-01-2019

To add to your his points . If your table is partioned then you use the below - quoting it from Cloudera KB The COMPUTE INCREMENTAL STATS variation is a shortcut for partitioned tables that works on a subset of partitions rather than the entire table Also Compute stats is a costly operations hence should be used very cautiosly . Some impala query may fail while performing compute stats . Hence chose Refresh command vs Compute stats accordingly . Hope this helps. Although you had done with your script 🙂

csguna · ‎12-23-2018

Could you please let me know if you have Spark service up and runining in QuickStart. Check in the Cm web ui . http://quickstart.cloudera:7180/cmf/login - Login Page for Cm . If you dont see Spark , Please click on the QuickStartvm -> add service - > spark / spark2 which ever you want -> place the spark service / gateway role on the host. After all the initial setup -> check in this directory to see if you can see the binary file . "/opt/cloudera/parcels/CDH-<version>/lib/spark/bin and then try the spark-sql

csguna · ‎12-16-2018

We have migrated our QA cluster and we aint facing any issue at least now . Parallely our Apps are also migrating , I believe we would probably need full test run before moving . I can keep you posted if anything comes along our way . But now the cluster is doing good.

csguna · ‎12-16-2018

You can login as hdfs user and create one . To do that so . 1. Log in to the host where Namenode / datanode runining . 2. Get in to the /var/run/cloudera-scm-agent process directory . 3. Find a process directory that is namenode / datanode 4 . Once you get into the directory find the hdfs.keytab file . 5 . Do an Kinit using hdfs.keytab - then you will become an hdfs user and can create folders Let me know if this is suffice.

Online	Offline
Last Visited	‎03-13-2021 04:57 PM

Date Registered	‎05-16-2016 09:33 PM
Last Visited	‎03-13-2021 04:57 PM
Total Messages Posted	783
Total Kudos Received	109

Re: Kerberos / Sentry Integration

Re: How to upgrade Hive from 2.1 to 3.0 via CDH 6....

Re: How does nameservice id works for HA, how does...

Re: What license does the express edition fall und...

Re: Sqoop2 over Sqoop1 in CDH6

Re: Permission denied: user=ABC, access=WRITE, ino...

monitoring capability - cloudera manager - unmount...

Re: Unable to create Hive external table after del...

Re: Transparent Data Encryption Explained: High-Le...

Re: Add New Host to Cloudera Manager using pbrun

Re: Sqoop Import not working with Mysql table data

SPARK-8617 - CDH vesion clarification

Re: Kerberos / Sentry Integration

Re: beeline - Default hs2 connection config not fo...

Re: Spark failed to get database default

Re: Permission denied: user=ABC, access=WRITE, ino...

Re: Permission denied: user=ABC, access=WRITE, ino...

Re: How to copy files from remote windows system t...

Re: Create user in hive or hadoop

Re: How to upgrade Hive from 2.1 to 3.0 via CDH 6....

Re: Sqoop Incremental Append

Re: Sqoop Incremental Append

Re: Installation failed. Failed to copy installati...

Re: Job role switch

Re: Hue fails to install - First failure: Service ...

Re: mapreduce job ConnectException: Connection tim...

Re: Agent installation failed on two Ubuntu 18.04 ...

Re: CM / CDH 6.2.X w/ PSQL:Cursor functionality re...

Re: PARQUET File getting created as empty file

Re: HBASE_HOME for sqoop import

Re: How to set up spark-sql in Cloudera quickstart...

Re: COMPUTE STATS - Database scripts

Re: How to set up spark-sql in Cloudera quickstart...

Re: OpenJDK certification for CDH

Re: Cannot create user directory after kerberos