Member since
03-23-2019
41
Posts
1
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2508 | 09-29-2019 09:10 PM | |
1526 | 09-29-2019 09:09 PM |
10-27-2020
02:02 AM
@irfangk1 This might help you since this is only AWS console specific task. Add instance store volumes to your EC2 instance
... View more
10-21-2020
05:48 PM
Can you share a little more about your use case? Are you only appending to the table or also updating records (UPSERT)? Will there be duplicate records? Also, what version of Hive are you working with?
... View more
10-17-2019
09:08 PM
@irfangk1 It's NOT a requirement but best practice you that you have better control and filter of who has access to your cluster and it is on the edge, not you Firewall your cluster by deploying KNOX like a DMZ in a classic network. 2M and & 6D is fine so one of the 3 ZK masters will sit on a data node right? .. Here is a document that should inspire you setup of edge node in HDP cluster
... View more
09-29-2019
09:09 PM
Hi Shelton, Facing the issue in Hive.. 2019-09-27 15:41:46,351 - Retrying after 10 seconds. Reason: Execution of '/usr/jdk64/jdk1.8.0_112/bin/java -cp /usr/lib/ambari-agent/DBConnectionVerification.jar:/usr/hdp/current/hive-server2/lib/postgresql-42.2.8.jar org.apache.ambari.server.DBConnectionVerification 'jdbc:postgresql://inairsr542007v3.ntil.com:5432/hive' hive [PROTECTED] org.postgresql.Driver' returned 1. ERROR: Unable to connect to the DB. Please check DB connection properties. org.postgresql.util.PSQLException: Connection to inairsr542007v3.ntil.com:5432 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
... View more
09-27-2019
05:15 AM
@irfangk1 Is this issue resolved? Looks like you have abandoned this thread. Please revert back if you have found the solution that way other community users can get the solution Or please share the requested informations to continue the discussion..
... View more
09-25-2019
09:22 PM
@irfangk1 Looks like the SmartSense service installation is failing for you. Failed to execute command: dpkg-query -l | grep 'ii\s*smartsense-*' || apt-get -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install smartsense-hst || dpkg -i /var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SMARTSENSE/package/files/deb/*.deb; Exit code: 1; stdout: ; stderr: E: dpkg was interrupted, you must manually run 'dpkg --configure -a' to correct the problem.
dpkg: error processing archive /var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SMARTSENSE/package/files/deb/*.deb (--install):
cannot access archive: No such file or directory Thats the reason later at Step9 the services are failing to start because smartsense service binaries (due to package installation failure) are not present. INFO 2019-09-24 16:06:03,584 ComponentStatusExecutor.py:172 - Status command for HST_AGENT failed:
Failed to execute command: /usr/sbin/hst agent-status; Exit code: 127; stdout: ; stderr: /bin/sh: 1: /usr/sbin/hst: not found Better to skip and proceed the Step9 by clicking Next/Proceed/OK/Complete kind of button in UI and then later verify on the Host where the SmartSense package is supposed to be install and failing to install. Check if the repo is fine and if you are manually able to install the SmartSesne binary on that host? It might be some ambari repo access issue on that node where the SmartSense installation failed. Better to check and share the exact OS version and the ambari repo version. Like based on the ambari version please get the correct repo something like: # wget -O /etc/apt/sources.list.d/ambari.list <a href="http://public-repo-1.hortonworks.com/ambari/XXXXXXXXXXXXXX/updates/2.7.3.0/ambari.list" target="_blank">http://public-repo-1.hortonworks.com/ambari/XXXXXXXXXXXXXX/updates/2.7.3.0/ambari.list</a>
# apt-get clean all
# apt-get update You can get the correct ambari REPO URL from the following kind of links: https://docs.cloudera.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-upgrade-major/content/upgrade_ambari.html . .
... View more
08-30-2019
01:49 AM
@irfangk1 If its an HDP cluster then I assume you are using Ambari for managing the HDF cluster, you will need to first prepare the 2 new hosts see the Prepare the EnvironmentCloudera document Then add the hosts to the cluster see Add host to cluster Thereafter add HDF to these 2 new nodes it follows the same procedure as adding HDF Services on an existing HDP Cluster hTH
... View more