Hi @ram76, Any reason why the mv is slow? Are they on different mount points? We did see issues around 2-3 minutes delay, but unfortunately that I am not aware of a workaround. You should focus on finding out why the "move" command took this long. In my test, it took 2 minutes to copy: time cp -r /opt/cloudera/parcels/CDH-5.13.3-1.cdh5.13.3.p3573.3750 /opt/cloudera/parcel-cache/5.13.3 real 1m59.830s user 0m0.126s sys 0m5.621s But my "mv' was instant: time mv /opt/cloudera/parcel-cache/5.13.3 /opt/cloudera/parcels/5.13.3 real 0m0.138s user 0m0.000s sys 0m0.002s Can you please share the output of : df -h So we can see the disk break down? Thanks Eric ... View more

@Daddy, This is a known issue in CM when either unpacking or moving of parcel directory is slow. When CM unpacks the parcel file, it performs below steps: 1. untar the parcel file under /opt/cloudera/parcel-cache 2. then "move" the parcel files to /opt/cloudera/parcels If the I/O is slow on the FS that holds directory /opt/cloudera/parcel-cache, the untar command will be slow. If the directories /opt/cloudera/parcel-cache and /opt/cloudera/parcels are mounted on different mount points, then the "move" command will become "copy" and then "delete", so operation will be much slower than the actual "move" which only involves rename. Since CM uses different threads to perform operations, it can happen that the checking happens before the untar operation finishes, hence you hit the issue. Can you please check if above is the issue in your case? So you can perform the same steps I mentioned: 1. manually untar parcel under /opt/cloudera/parcel-cache 2. run "mv" command to move directory from /opt/cloudera/parcel-cache to /opt/cloudera/parcels and time it If either of the above is slow, then you have found your issue. Cheers Eric ... View more

Hi Heri, Glad that it helped and thanks for the info. Cheers Eric ... View more

Hi Heri, As mentioned in the error: if using free form query import (consider adding clause AS if you're using column transformation) You max(id) aggregate function does not have "AS" clause, please change your query to below and try again: select max(id) as max_id from NodeName a where $CONDITIONS Cheers Eric ... View more

@KokaN , Only 7 is supported in CDH 5.16.x, please see below doc: https://docs.cloudera.com/documentation/enterprise/release-notes/topics/rn_consolidated_pcm.html#c516_supported_os Cheers Eric ... View more

Please also share the output of below command on the Ranger host: ls -al /opt/cloudera/parcels/ Just to make sure the CDH version is linked properly. Cheers Eric ... View more

@Dombai_Gabor , Can you please log onto Ranger's host, go to directory /opt/cloudera/parcels/CDH/lib and then run command: grep -rni 'RangerRESTUtils' * Also under directory /opt/cloudera/parcels/CDH/jars and run the same command, just to check if file ranger-plugins-common-2.0.0.7.x.x.x-xxx.jar exist under your CDP installation.   Please share the full output.   Cheers Eric ... View more

Hi Karthik, Thanks for sharing the workaround. But since we have not tested MySQL in CDP DC 7.0, I am not sure if this is expected or not. I still suggest that you move to PostgreSQL 10 in case you will face other issues down the track. Cheers Eric ... View more

@karthikkadajji    I just learnt that CDP DC 7.0 does not support MariaDB yet, only PostgreSQL 10   Are you able to either upgrade to 7.1 or change to Postgres 10 to see if that can help to resolve your issue? Cheers Eric ... View more

@RedOne, Thanks for the update. PostgreSQL 9 should be OK, though we recommend 10 in CDP 7, please see below: https://docs.cloudera.com/cdpdc/7.0/release-guide/topics/cdpdc-database-requirements.html I guess this is an external user? Are all external users affected? How is Ranger UserSync affected? Have you checked the UserSync log to see any obvious errors? Cheers Eric ... View more

@RedOne, Can you please share what backend DB you used for Ranger and its version? How many users are affected? Thanks Eric ... View more

@karthikkadajji , Can you please share the content of install.properties file for review, after redacting sensitive info? You can also compare the file under previous xxxx-ranger-RANGER_ADMIN-SetupRangerCommand directory and see if indeed db_password was missing. Also, have you tried to install on a different host and see if that can help? Have you checked the Ranger server log and see if there are other errors reported over there? Is Ranger web UI working? When you say unable to login into UI, what error did you see? Cheers ... View more

@ChineduLB , Did you mean that you got the same error while trying to export the sample data you provided earlier? Have you tried to update your driver in case it might be old? Cheers Eric ... View more

@ChineduLB Can you please share below info: - the DDL of the table in Teradata - some sample data from the file in HDFS It looks to me some issues in the data, I suggest you also narrow down the issue by slowly reducing the number of columns from the file and see which one is actually causing the issue and which rows. Cheers Eric ... View more

@Manus , Can you please share the error from Beeline and HS2 log? Without them, it is difficult to see what is going on. Cheers Eric ... View more

Hi Choon Kiat, Thanks for the confirmation. I have checked further, "Unable to obtain Principal Name for authentication" can happen when the JCE jars are not up to date on the client machine and not able to use the encryption key provided by Kerberos KDC. Can you please download the latest/appropriate JCE jars and place them in directory $JAVA_HOME/jre/lib/security. The files are: US_export_policy.jar local_policy.jar These files are dependent on the Java version. For Java8, it can be found here: https://www.oracle.com/java/technologies/javase-jce8-downloads.html Please give it a try and see how it goes. Regards Eric ... View more

Hi Gabor, Can you share the krb5.conf file on the HMS host for review? Cheers Eric ... View more

Hi Your JDBC connection string: jdbc:hive2://{host}:{port}/{database};AuthMech=1;KrbRealm=Domain;KrbHostFQDN={server};KrbServiceName=hive;KrbAuthType=2;LogLevel=6;LogPath=c:\ProgramData\MIT\Kerberos5\log.log Is "Domain" the real string or a placeholder? From your krb5, your Realm should be "AIU.XXXXXX", so I want to confirm. Cheers Eric ... View more

@TanChoonKiat Your JDBC Connection string is wrong, assuming that you are using Cloudera Hive JDBC Driver: jdbc:hive2://xx.xx.xxx.xx:10001/default;AuthMech=1;principal=hive/domain@domain;KrbHostFQDN=10.11.121.21;KrbServiceName=hive;KrbAuthType=2;LogLevel=6;LogPath=c:\ProgramData\MIT\Kerberos5\log.log 1. No need for "principal" 2. Can you please check what's the full principals from your KDC server? KrbHostFQDN should be normally the domain name, not IP. 3. you are missing KrbRealm, which should be the part after "@" from your principal Please try to correct those and try again. Full JDBC doc can be found here: https://docs.cloudera.com/documentation/other/connectors/hive-jdbc/latest/Cloudera-JDBC-Driver-for-Apache-Hive-Install-Guide.pdf Cheers Eric ... View more

@TanChoonKiat Can you please share your JDBC connection string? Cheers Eric ... View more

@aleesmin , Couple of questions: 1. I am not familiar with golden gate , but are those inserts and updates run inside transactions? 2. have you checked if the duplicate data in the same resulted text file in HDFS or on different files? 3. I see that you used "--direct", have you tried non-direct mode? Cheers Eric ... View more

Please use the query ID hive_20200308155555_9a444e04-9523-4443-b312-64a94e5a5138 and search in HS2 log to find out the exact reason for the failure. Looks like beeline did not capture the full error from server side. Cheers Eric ... View more

Hi @Dombai_Gabor, Can you check the keytab file under /var/run/cloudera-scm-agent/process/*HIVEMETASTORE* directories are valid and you can kinit using those keytab files without issues? Also, does the error happen on start up or after running for a while? Thanks Eric ... View more

Great catch @bgooley!! ... View more

Hi @HadoopBD, The log you provided is RM log, not application log that Ben asked earlier. Please run below command: yarn logs -applicationId application_1582677468069_0009 > application_1582677468069_0009.log And then find the snippet that has the error, as the log will likely to be very big. I also noticed that the log you provided earlier contained your domain name, if you have concerns, we can redact them for you. Please advise. Thanks Eric ... View more

@MrCarlo , Have you tried to create a VIEW on top of the table in Oracle and then import the VIEW instead? It is supported in Sqoop as mentioned below: http://sqoop.apache.org/docs/1.4.6/SqoopUserGuide.html#_selecting_the_data_to_import Cheers Eric ... View more