Member since
09-29-2015
4612
Posts
21
Kudos Received
33
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
752 | 08-11-2021 05:29 AM | |
587 | 07-07-2021 01:04 AM | |
349 | 07-06-2021 03:24 AM | |
983 | 06-07-2021 11:12 PM | |
316 | 06-02-2021 04:06 AM |
08-24-2021
12:54 AM
Hello @roshanbi , thank you for the clarification. I am not aware of any automated way of doing the translation. If I was facing with this task, I would dive into the differences between these SQL dialects and if Kudu needs some different design considerations when building up the queries and either to it manually or consider if it takes less effort to build custom automation, then build scripts for the job. Kind regards: Ferenc
... View more
08-19-2021
03:07 AM
@Sriparna Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. I
... View more
07-19-2021
09:58 AM
1 Kudo
Thanks! Before you replied I tried the following which also helped: yarn.scheduler.capacity.schedule-asynchronously.maximum-threads=2 yarn.scheduler.capacity.schedule-asynchronously.scheduling-interval-ms=100
... View more
07-09-2021
11:03 AM
Hi @Bender Correct, our cluster is not kerberized yet. Is it possible connect SMM without kerberos? thanks Eduardo
... View more
07-09-2021
07:26 AM
Hi @SujaP , this can happen e.g. when you run out of disk space. 1. Please make sure that the disk have enough space to keep unpacked parcels. 2. Hard stop cloudera-scm-agent service (supervisord) 3. Empty the parcel directories : /opt/cloudera/parcels & opt/cloudera/parcel-cache 4. Start the agent service (#systemctl start cloudera-scm-agent) Kind regards: Ferenc
... View more
07-08-2021
09:31 AM
Thank you @Bender , I'm reviewing the documentation link you have shared to see how it can fit our needs. Regards, Rajat
... View more
07-08-2021
08:14 AM
1 Kudo
Hello Ferenc, Thank you for your update and the info provided. Makes sense. Will reach out to Qlik. Have a great day! Tom
... View more
07-06-2021
07:44 PM
1 Kudo
Thanks @Bender for the feedback. Still learning, so good to get a view on this. Cheers Joe
... View more
07-02-2021
12:07 AM
Please add following entries to your /etc/resolv.conf ,according to your personal configurations. 192.168.1.200 redhat1.hdp.com redhat1 192.168.1.206 redhat2.hdp.com redhat2 192.168.1.205 redhat3.hdp.com redhat3
... View more
06-18-2021
09:31 AM
Hi , Thanks for the response. It turns out my issue is slightly different. I have been able to unblock myself by creating a new pem key and cert file using openssl. Thanks for you help, please don't keep the issue open on my part, Best regards Darren
... View more
06-15-2021
11:41 AM
Hi @Bender, Thanks for your replay. The Faq wasn't useful. It's aswer is: "With BDA V2.0 Sqoop automatically supports Oracle Database and MySQL. Hence connect strings beginning with jdbc:oracle or jdbc:mysql:// are handled with no additional setup." 😞
... View more
06-02-2021
04:06 AM
Hi @apedroso , thank you for starting this thread. In this reply, I will focus on how the YARN RM stores data about historical applications, which can be accessed via the RM Web UI. The RM keeps data about the applications in its state store [1]. It can be LeveldbRMStateStore, FileSystemRMStateStore or ZKRMStateStore. We recommend using ZKRMStateStore (this is what we use in YARN HA as well), because it is a more robust implementation. For example, you can migrate in RM HA standby RM while the active RM is still running and keep the state-store intact. Because the RM Web UI is reading the data from the state-store, it is independent of the presence or lack of YARN Application Logs. What are your exact migration steps? Do I understand correctly that you upgrade your cluster to CDP or do you need to move services to a new cluster, please? [1] Please read section for "yarn.resourcemanager.store.class" in https://hadoop.apache.org/docs/r3.1.2/hadoop-yarn/hadoop-yarn-site/ResourceManagerRestart.html
... View more
06-02-2021
02:31 AM
Hello @dirkj , the answer to your question is in the source code of the INSERT OVERWRITE in a form of comments under FinalizeHdfsInsert. Please let us know if you need further clarification on it! Best regards: Ferenc
... View more
04-23-2021
10:58 AM
add this in spark service in CM > Spark > Configuration >Spark Client Advanced Configuration Snippet (Safety Valve) for spark-conf/spark-env.sh =export HADOOP_CONF_DIR=/etc/hadoop/conf
... View more
03-23-2021
07:50 AM
For future reference adding here the link to our public documentation on how to connect NiFi with Hive on CDP.
... View more
03-23-2021
07:35 AM
1 Kudo
Please note, the instructions are also available in our public documentation under "Installing OpenJDK".
... View more
03-23-2021
07:09 AM
Please find here the Apache Hive tutorial and more information on selecting distinct values under the Aggregations section. For more on the Apache Hive content roadmap, please refer to our documentation.
... View more
03-23-2021
03:50 AM
Please find more about the "pros and cons to having hive jobs run as the hive user or the end user" vs. Ranger in our public Cloudera documentation for CDP: Enabling or disabling impersonation (doas)
... View more
03-23-2021
02:28 AM
To see more on Hive Managed and External tables, please see our public documentation for CDP Hive.
... View more
03-17-2021
07:09 AM
您好,请看一看下面的解决办法[1]: "12. Error If npm is executed under the root account, it will change the uid to the current account, or the value of the uid is obtained from the user configuration file, and the default value of uid is nobody. So when you run npm install under the root account, you need to change unsafe-perm Option plus. Solve (and then re-edit): # find ~/.m2/repository/ -name "*.lastUpdated" -exec rm -rf {} \; # mvn -B clean install rpm:rpm -DnewVersion=2.7.3.0.0 -DskipTests -Dpython.ver="python >= 2.6" -Drat.skip=true -X -rf :ambari-admin" [1] https://www.programmersought.com/article/72684156755/
... View more
10-12-2020
01:27 AM
Hello @Tak567 , thank you for letting us know you are hitting "Could not start EmbeddedOozieServer! Error message: Address already in use" exception. It can occur, for example when there are not enough ephemeral ports available on the OS. Kind regards: Ferenc
... View more
10-05-2020
02:32 PM
I tried this workaround for my installation on Ubuntu 18.04 and nothing...... the error is incomplete installation. I am installing this using the windows subsytem for Linux (windows 10) Do you know a workaround for this please? Thanks
... View more
10-01-2020
01:39 PM
1 Kudo
I appreciate you answer, i dont know the jira number but the case is solved by upgrading to hdp 3.1.5.
This is the link where you can find "descriptions of new features". Here they mention that hive and spark can interact in an easy way due to the fact that now they are using the same hive metastore. Right now we are using hdp 3.1.4, and when we want to write or read hive objects we have to use the hive warehouse connector, which, sometimes is too slow.
https://docs.cloudera.com/HDPDocuments/HDP3/HDP-3.1.5/release-notes/hdp-release-notes.pdf
Apache component
Hive
Feature areas, benefits, and links to further information
Core Capabilities • Support single catalog for Hive and Spark using the Hive Metastore (HMS) translation layer.
Regards,
... View more
09-29-2020
11:50 PM
Sincerely,thanks to the reply.I would like to offer more information you may need. We use cdp7.1.1. The successful information can be seen in YARN(MR included), which is in cloudera manager.
... View more
09-29-2020
01:12 PM
I used the systemd. It worked great. Again, I appreciate everyone's help!
... View more
09-23-2020
06:28 AM
1 Kudo
interesting
... View more
09-23-2020
03:51 AM
1 Kudo
Hi Experts, My issue is resolved now. I had raised a ticket with cloudera and they provided my with a modified yumrpm.py file which I replaced with my existing file. This new python had option to skip in case it encounters a blank package. Following are the steps to resolve my issue. 1) verify ambari-agent version is 2.6.2.2 by `ambari-agent --version` on problematic node 2) stop ambari-agent on problematic node 3)go to /usr/lib/ambari-agent/lib/resource_management/core/providers/package/ ~> cd /usr/lib/ambari-agent/lib/resource_management/core/providers/package/ 4) take bacup of yumrpm.py ~> mv yumrpm.py /tmp 5) download the attached yumrpm.py and keep it in /user/home/ananya 6) do an diff of ~> diff /tmp/yumrpm.py /user/home/ananya/yumrpm.py >>>(diff loooks similar too this) 263,267c263,264 < if len(name) == 0: < Logger.info("Skipping installation of empty package") < else: < Logger.info("Installing package %s ('%s')" % (name, string_cmd_from_args_list(cmd))) < self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput()) --- > Logger.info("Installing package %s ('%s')" % (name, string_cmd_from_args_list(cmd))) > self.checked_call_with_retries(cmd, sudo=True, > logoutput=self.get_logoutput()) <<<< 7) move the yumrpm.py to /usr/lib/ambari-agent/lib/resource_management/core/providers/package/ mv /user/home/ananya/yumrpm.py /usr/lib/ambari-agent/lib/resource_management/core/providers/package/ 😎 start ambari-agent Thanks and Regards, Ananya
... View more
09-22-2020
02:43 AM
Hi @iEason8 , you are welcome! Thank you for raising these questions and accepting the answer as a solution! Solved articles will surface better on search engines, hence other members with similar questions will find the answer easier. Best regards: Ferenc
... View more
09-22-2020
01:06 AM
Hello @Mondi , thank you for asking for clarification if CDP has a Cloudera Express-like "no license required" distribution. Our licensing strategy changed and you can find the details about it here. For your convenience, I am pasting here a part of the "Subscription Agreement" section that might be relevant for you: "3. Will Cloudera offer Developer or Trial software Subscriptions? Customers and developers will be able to access our products with a subscription agreement with Cloudera. We will have partner development subscription agreements for developers through our Cloudera Connect Partner Program, and free (unsupported) short-term trial subscriptions through Cloudera.com." Based on the documentation Cloudera Express is discontinued from version 6.3.3. Hope it clarifies, let us know, please! Kind regards: Ferenc
... View more