Hello @Tak567 ,   thank you for letting us know you are hitting "Could not start EmbeddedOozieServer! Error message:  Address already in use" exception. It can occur, for example when there are not enough ephemeral ports available on the OS.   Kind regards: Ferenc ... View more

Hello @5sdba ,   thank you for reporting the issue you hit. Can you please specify the CDP version you are using and if you are using CM HA (Cloudera Manager High Availability), please?   Thank you: Ferenc ... View more

Hello @Devink ,   thank you for reaching out to the Community.   I understand that your issue is: Hive on Tez job that is failed because of OutOfMemory issue is reported as successful and you would like to know the reason for it.   Please note if you have a Cloudera Subscription, a Support Case might be a better forum for deep analysis.   Could you please give us some additional information, so we can assist you more efficiently? What is the distribution you are using and what is the version number, please? (e.g. HDP, CDH, CDP) Is the successful-state reported via Hue from an Oozie workflow? What Oozie action did you use to execute the Hive job, please? If it is not via Hue and Oozie, please specify where did you see the application reported as successful.   Please note, Oozie is at the mercy of the status reported back from the job it is running.  There are two ways that Oozie can detect a failure in e.g. a Java action. If an exception is thrown from the  main  method of the class executed by the Java action or  System.exit  is called anywhere in the code, Oozie will treat the action as failed. It will then transition to the Error state configured for the action.   Thank you: Ferenc   ... View more

Hello @Lilit ,   thank you for raising this question. I believe this post will answer your enquiry.   Please let us know if you still need any further information!   Thank you: Ferenc ... View more

Hello @aryan_dear ,   thank you for reporting your observations on Impala UNION ALL returning wrong results up to CDH6.   The issue you are facing with is most likely: https://issues.apache.org/jira/browse/IMPALA-7957   The fix for this issue is implemented from Impala3.3., for example in CDP.   Please let us know if you need more information on this topic!   Kind regards: Ferenc ... View more

Hello @Anto ,   thank you for reporting you have issues replacing the Spark2 version on CDH6. Unfortunately it is meant to be like this. Please see this thread that explains and this documentation on the compatibility matrix.   In short:  Spark2 comes bundled with CDH6, hence you cannot replace it with a different version or install it separately.   Hope this helps!   Kind regards: Ferenc ... View more

Hello @AJM ,   thank you for reaching out regarding what happens after your subscription license expires. Please kindly specify the exact version you are planning to use to be able to provide you with a more accurate answer.   In this thread, we discussed that e.g. in CDH6 with a trial license you can install Cloudera Express and it has a 100 nodes limitation. Once any license expires, the documentation describes here what happens: Cloudera Enterprise   Cloudera Enterprise  Trial - Enterprise features are disabled. Cloudera Enterprise  - Most enterprise features such as Navigator, reports, Auto-TLS, and fine-grained permissions are disabled. Key Trustee KMS and the Key Trustee server will continue to function on the cluster, but you cannot change any configurations or add any services. Navigator will not continue to collect audits, but existing audits will remain on disk in the Cloudera Manager audit table. On license expiration, the license expiration banner displays which enterprise features have been disabled.   With our latest product, CDP, you can find the licensing information here.   Please let us know if you need more information on this topic.   Thank you: Ferenc ... View more

Hello @Atradius ,   thank you for reaching out to the Community with your issue of having both NameNodes down.   Do you see in your NN log entries like JvmPauseMonitor saying "Detected pause in JVM or host machine" and a value larger than 1000ms, please? It can be an indication that your service is running out of heap. If it is the NameNode, the short-term solution is to increase the heap and restart the service. A long term solution is to identify why did you run out of heap? E.g. do you face with small files issue? Please read article [1] about how to tackle this.   Losing quorum might be caused by ZK service issue, when the ZK is not in quorum. Please check the ZK logs as well.   Please let us know if you need more input to progress with your investigation.   Best regards: Ferenc   [1] https://blog.cloudera.com/small-files-big-foils-addressing-the-associated-metadata-and-application-challenges/ ... View more

Hi @Aswinnxp ,   replied to your enquiry in this thread.   Best regards: Ferenc ... View more

Hello @Aswinnxp ,   thank you for letting us know that after registration to the Support Portal you have difficulties raising a case.   Do you have a valid Cloudera Subscription, please? It will be required to be able to raise a Support Case.   Once you have Cloudera Subscription, the steps to take to register to the portal are: 1. Register at: https://sso.cloudera.com/register.html   You will be sent an email with a validation link.  2. Please click this link to complete your registration. 3. Set your password 4. Login at https://sso.cloudera.com .   I understand that you've done these steps.   Until you will be reached out following your registration, we can do one more thing: Do you have a colleague that has working portal access and can raise a case, please? In this case please raise a case to get further assistance on your access.   Thank you: Ferenc ... View more

Hello @tresk ,   thank you for reaching out to the Community.   Wondering if this is the doc you were looking for: "The JDBC connection string for connecting to a remote Hive client requires a host, port, and Hive database name. You can optionally specify a transport type and authentication." jdbc:hive2://<host>:<port>/<dbName>;<sessionConfs>?<hiveConfs>#<hiveVars>   Please let us know!   Thank you: Ferenc ... View more

Hello @Suyog1981 ,   thank you for reaching out to Community. I understand that your issue is: After upgrading from CDH5.12 to CDH6.3.3. MR2 job that is connecting to HBase is failing and it seems to be that the runtime is still pointing to CDH5.12.   Can you please check if any of the links under  /etc/alternatives or /var/lib/alternatives is still pointing to CDH5.12 paths on the node where the container of the MR job is failing? E.g. use: grep CDH-5.12 * | awk -F ':' '{print $1}'   Thank you: Ferenc ... View more

Hello @Mohsenhs ,   thank you for showing interest in the CCA159. Based on the description of the exam:   "CCA159 is a hands-on, practical exam using Cloudera technologies. Each user is given their own CDH6 (currently 6.1.1) cluster pre-loaded with Impala, HiveServer1 and HiveServer2."   You can download the required Cloudera product following the instructions from the documentation: "A 60-day trial can be enabled to provide access to the full set of  Cloudera Enterprise   Cloudera Enterprise  features."   Please let us know if it answers your inquiry!   Thank you: Ferenc ... View more

Hellio @AmroSaleh ,   thank you for reaching out on Community and raising your enquiry on Sentry-HDFS.   Have you seen the "Authorization with Apache Sentry" documentation, please?    For HDFS-Sentry synchronization to work, you   must   use the Sentry service, not policy file authorization. See   Synchronizing HDFS ACLs and Sentry Permissions, for more details. Let us know if you went through these docs and you still need any additional information.   Thank you: Ferenc ... View more

Hello @KSKR ,   thank you for raising the question on "how to fetch the CPU utilization for a Spark job programmatically".   One way to do this is via the Spark REST API. You should consider if you need the "live data" or you are looking for analysis once the application finished running. While the application is running, you can consider to connect to the driver and fetch the live data. Once the application finished running, you can consider parse the JSON files (the event log files) for the CPU time or use the Spark REST API and let the Spark History Server serve you with the data.   What is your exact requirement? What would you like to achieve?   Thank you: Ferenc     ... View more