Member since
04-24-2024
3
Posts
3
Kudos Received
1
Solution
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 4924 | 04-25-2024 04:08 AM |
04-27-2024
12:31 AM
1 Kudo
I've created a cluster in Cloudera and now I want to add Hive, but I need it to utilize the Tez execution engine. So, I'm adding Hive on Tez and the Tez service. However, I'm confused about assigning server IPs to roles. In the Hive service section, I see options for gateway, hiveserver2, metastore, and WebHcat. In the Hive on Tez section, I see options for gateway and hiveserver2. In the Tez section, only gateway is listed. Now, I'm confused. Should I assign the same IP to all gateways and hiveserver2, or should I assign different IPs? Where should I assign hiveserver2, in Hive or in Hive on Tez? And how many servers can I assign to hiverserver2, metastore, and gateway? Moreover, when the Hive section covers gateway and hiverserver2 options, why do the Hive on Tez and Tez sections also show these options? Additionally, I would appreciate clarification on how to configure Hive high availability in this setup. I'm seeking guidance to proceed and would appreciate any help from the Cloudera community.
... View more
Labels:
- Labels:
-
Apache Hive
04-25-2024
10:54 PM
1 Kudo
Could you kindly confirm the following information for me? Are you installing Cloudera using cloud services or on a local machine such as a laptop/PC? What is the operating system of your system? Your confirmation will help me to create a script with the necessary steps. I will share that script with you once it's ready. Thank you!
... View more
04-25-2024
04:08 AM
1 Kudo
step1: Create a separate repository server, or alternatively, execute the following step at the location where you previously executed https://archive.cloudera.com/cm7/7.4.4/cloudera-manager-installer.bin sudo yum install httpd -y sudo systemctl start httpd sudo systemctl enable httpd sudo mkdir -p /var/www/html/cloudera-repos/cm7/ download as per your requirement redhat version redhat7 or redhat8 wget https://archive.cloudera.com/cm7/7.4.4/repo-as-tarball/cm7.4.4-redhat7.tar.gz OR wget https://archive.cloudera.com/cm7/7.4.4/repo-as-tarball/cm7.4.4-redhat8.tar.gz sudo tar -xzvf cm7.4.4-redhat7.tar.gz -C /var/www/html/cloudera-repos/cm7/ OR sudo tar -xzvf cm7.4.4-redhat8.tar.gz -C /var/www/html/cloudera-repos/cm7/ sudo mkdir -p /var/www/html/cloudera-repos/cdh7/7.1.7.0/parcels cd /var/www/html/cloudera-repos/cdh7/7.1.7.0/parcels sudo wget https://archive.cloudera.com/cdh7/7.1.7/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976-el7.parcel sudo wget https://archive.cloudera.com/cdh7/7.1.7/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976-el7.parcel.sha1 sudo wget https://archive.cloudera.com/cdh7/7.1.7/parcels/CDH-7.1.7-1.cdh7.1.7.p0.15945976-el7.parcel.sha256 sudo wget https://archive.cloudera.com/cdh7/7.1.7/parcels/KEYTRUSTEE_SERVER-7.1.7.0-1.keytrustee7.1.7.0.p0.15945976-el7.parcel sudo wget https://archive.cloudera.com/cdh7/7.1.7/parcels/KEYTRUSTEE_SERVER-7.1.7.0-1.keytrustee7.1.7.0.p0.15945976-el7.parcel.sha sudo wget https://archive.cloudera.com/cdh7/7.1.7/parcels/KEYTRUSTEE_SERVER-7.1.7.0-1.keytrustee7.1.7.0.p0.15945976-el7.parcel.sha1 sudo wget https://archive.cloudera.com/cdh7/7.1.7/parcels/manifest.json To see on web browser http://<Repo_public_ip>/cloudera-repos/ Eg.: - http://13.233.244.230/cloudera-repos/ step 2 1 sudo vi /etc/yum.repos.d/cloudera-manager.repo 2 [cloudera-manager] name=Cloudera Manager baseurl=http://<Repo-server-private-ip>/cloudera-repos/cm7/cm7.4.4/ gpgkey =http:// <Repo-server-private-ip>/cloudera-repos/cm7/cm7.4.4/RPM-GPG-KEY-cloudera gpgcheck = 0 step 3 1 sudo yum clean all 2 sudo yum makecache 3 sudo yum install cloudera-manager-daemons cloudera-manager-agent cloudera-manager-server -y step 4 sudo systemctl start cloudera-scm-server sudo tail -f /var/log/cloudera-scm-server/cloudera-scm-server.log step 5 click on parcel repositories & network settings Then delete existing links , click on + copy-paste following path http://Your_repo_private_IP/cloudera-repos/cdh7/7.1.7.0/parcels/ I hope these steps are helpful to you! 🙂
... View more