Member since
06-01-2018
14
Posts
0
Kudos Received
0
Solutions
07-31-2018
06:27 AM
Hello All, We are tying to install Cloudera 5.8.5 on Linux 7 using Cloudera manager. We selected parcles based installation , but while Installation we are getting below error on all 3 hosts what we are using. We checked proxy settings it is below. When we use below path (https://archive...) direct on node using wget https://archive .... it is able to download the file. What else can be checked to resolve this issue. Error - failure: repodata/repomd.xml from cloudera-cdh5: [Errno 256] No more mirrors to try. https://archive.cloudera.com/cdh5/redhat/7/x86_64/cdh/5.8.5/repodata/repomd.xml: [Errno 12] Timeout on https://archive.cloudera.com/cdh5/redhat/7/x86_64/cdh/5.8.5/repodata/repomd.xml: (28, 'Connection timed out after 30001 milliseconds') Proxy - export http_proxy="http://16.168.30.201:8080" export https_proxy="https://16.168.30.201:8080" export http_proxy=${http_proxy} export https_proxy=${https_proxy} Thanks.
... View more
Labels:
06-20-2018
03:09 AM
Hello Saranvisa , Thanks a lot for you reply. I will try this for set Quota on directories. Will we are able to allocate Quota to users as well in this ? How to select users/groups and define size in GB on a perticuler directory ? As per our requirment we want to restrict users to use only allowed GB on perticuler dirctory. Like we want to allocate space to users on directory So they can not use more space on any directory. Thanks Rohit Mathur
... View more
06-19-2018
12:45 AM
Hello All, We are using CDH 5.8 and want to setup a control on resuorce utilization ( CPU ,RAM) and Disk space utilization on cluster of different users.
We have setup Dynamic resource pools to setup job level restricition and now we want to set up disk utilization for indidual users . Like user A can use only use 10 GB under /u01/ABC.
We are using Sentry Service in CDH setup . We can configure disk space urilization at indidual/group of users uising Sentry Service ?
Or what we should do to achive this.
... View more
Labels:
06-01-2018
03:11 AM
Hi All, We are using CHD 5.8 and the requirement is to set system resources utilization ( disk space etc. ) and Set job periority for certain group of users. We are having 2 groups of users , One for developemnt and other is just to check some things rendonmly on cluster. We want to set high peoriroty for the work development gorup is doing. What all options we can use to setup these periority ? Thanks .
... View more
- Tags:
- resource manager
Labels:
03-12-2018
07:35 AM
Hi Jay, Thanks . I checked with my network team , as per them there is not rule set for 8080 port. I tried to telnet ip from office also but it is not getting connected But ambari URL working and i am able to login. Is there any other things i can check. Thanks
... View more
03-07-2018
07:34 AM
Hi All, We have HDP 2.5.3 setup on VMs ,having 1 name node and 2 data nodes. We are able to access the ambari url from office network however when we go out of the office and use vpn to connect office network we are not able to connect to ambari url. From vpn connectivity we are able to access all vms (putty) etc... except ambari url .We are using Ambari URL like http://12.133.130.180:8080 . What could be the issue and how to find this . Thanks
... View more
01-25-2018
10:02 AM
Hi All, We have installed HDP 2.5.3 and Vertica 9 on 3 nodes cluster. One node we are using as HDP name node. We are using two Ethernet ports , one for hadoop and other for Vertica (Same subnet and Mask).. We are facing the connectivity issue with name node ( From putty) some time network services goes done abruptly. This is happening 4-5 times in a day with out any pattern. Is this issue can be related to HDP or Vertica , What all things we can check from HDP or vertica side to resolve this issue. Thanks.
... View more
- Tags:
- Hadoop Core
- hdp-2.5.0
Labels:
01-02-2018
11:03 AM
Hi, We have installed HDP on 3 nodes cluster ( using eth0 network ips), We had a requirement to install vertica database also on same nodes. So we create one more network ip (eth1) with different ip and installed vertica. but now HDP services are started pointing to new ips (eth1) and giving following errors. This error we are getting in all the services. Following i have taken from oozie logs. We want to use etho nodes ip to use Ambari. Any idea how to correct it. eth0 ip - 15.153.133.130 ( Used this ip to intalled HDP) etth1 ip - 15.153.133.110 ( Used this ip to installed vertica). 2018-01-02 11:34:27,779 WARN Client:611 - SERVER[abb23.dev.com] Address change detected. Old: abb23.dev.com/15.153.133.130:8020 New: abb23.dev.com/15.153.133.110:8020 2018-01-02 11:34:27,780 WARN Client:886 - SERVER[abb23.dev.com] Failed to connect to server: abb23.dev.com/15.153.133.110:8020: try once and fail. java.net.NoRouteToHostException: No route to host
... View more
- Tags:
- Hadoop Core
- hdp-2.5.0
Labels:
12-16-2017
07:52 AM
Hi, I have a 4 node cluster (1 name node, 3 data node) hdp 2.5 cluster on linux 6.6. We want to install vertica 9 on these nodes, for installation can we use the same IP addresses of the nodes we used for HDP installation when running vertica installation script and how to communicate with HDP via vertica. What will be the best to communicate with hadoop like to read data stored in hive using Hcatalog or store data in vertica . Can we get a document for installation. Thanks
... View more
- Tags:
- Hadoop Core
- hdp-2.5.0
Labels:
12-13-2017
01:00 AM
Hi Vikas, Thanks ... I did follow the steps mentioned in the below link. I am fine to use default database as well for my installation, but i am getting the same issue with both options. https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-reference/content/using_hive_with_mysql.html
... View more
12-12-2017
02:19 PM
Thanks bviswanadham.
... View more
12-12-2017
02:14 PM
Hi , I am installing HDP 2.5.3 using Ambari 2.4.1.0, While installation of Hive, i was trying to use Postgres or MySQL databases but with both db , hive connection is not successful. I am getting an error. I have copied DBConn. files from ambari-server to ambari-agent path, as suggested but it is still not working. Any idea how to resolve this issue. Error downloading DBConnectionVerification.jar from Ambari Server resources. Check network access to Ambari Server. HTTP Error 404: Not Found
... View more
12-07-2017
12:21 AM
Hello All , We need to install HDP 2.3.5 with Spark 1.6 on Linux Red Hat Enterprise Linux Server release 6.6(Santiago). Will this linux version will support both of these s/w.
... View more
11-29-2017
04:39 PM
Hi, We are using hdfso/s user as admin for hdp platform , We want to create a new user having permission on hive and oozie jobs , How to give these permissions to this new user. If it is not possible then we need to give same permission as hdfs user is having. I have used below commands to create new user , now how to give all permissions to this user. chmod 777 /tmp useradd -G newuser hadoop
sudo su - hdfs
hadoop fs -mkdir /user/newuser
hadoop fs -chown -R newuser:hadoop /user/newuser
... View more
Labels: