Thank you so much @Jay SenSharma. It is working fine and I made it parameterized for file path also. ... View more

@Arun Reddy Which version of hdp you are using ? ... View more

@vsharmaThansk for your reply. But it was not an issue with /hdp/ dir. As it was working fine for HDP Base repo. http://w3.hdp22/hdp/HDP/centos6/2.x/updates/2.3.0.0/ Actually I forgot to copy HDP-UTILS file to this location (/var/www/html/hdp). Once I copied it then it started working and I have successfully upgraded my hdp stack as well. [root@w3 hdp]# ll total 8 drwxr-xr-x 3 root root 4096 Oct 4 07:48 HDP drwxr-xr-x 3 ambari-qa users 4096 Dec 3 2015 HDP-UTILS-1.1.0.20 http://w3.hdp22/hdp/HDP-UTILS-1.1.0.20/repos/centos6/ Index of /hdp/HDP-UTILS-1.1.0.20/repos/centos6 ... View more

@jk: There was some network slowness and it was getting timeout as well. So once that is resolved I ran your above give steps this problem resolved. It is being installed now without any other error. ... View more

[root@m1 log]# /usr/bin/yum install hdp-select Loaded plugins: fastestmirror Setting up Install Process Determining fastest mirrors epel/metalink | 5.1 kB 00:00 * base: ftp.iitm.ac.in * epel: epel.mirror.net.in * extras: ftp.iitm.ac.in * updates: ftp.iitm.ac.in HDP-2.3 | 2.9 kB 00:00 HDP-2.3/primary_db | 61 kB 00:00 HDP-2.3.4.0-3485 | 2.9 kB 00:00 HDP-2.3.4.0-3485/primary_db | 61 kB 00:00 HDP-2.5.0.0 | 2.9 kB 00:00 HDP-2.5.0.0/primary_db | 69 kB 00:00 HDP-UTILS-1.1.0.20 | 2.9 kB 00:00 HDP-UTILS-1.1.0.20/primary_db | 27 kB 00:00 HDP-UTILS-2.3.4.0-3485 | 2.9 kB 00:00 HDP-UTILS-2.3.4.0-3485/primary_db | 27 kB 00:00 HDP-UTILS-2.5.0.0 | 2.9 kB 00:00 HDP-UTILS-2.5.0.0/primary_db | 33 kB 00:00 Updates-ambari-2.4.0.1 | 2.9 kB 00:00 Updates-ambari-2.4.0.1/primary_db | 8.3 kB 00:00 base | 3.7 kB 00:00 base/primary_db | 4.7 MB 00:35 bintray--sbt-rpm | 1.3 kB 00:00 bintray--sbt-rpm/primary | 1.8 kB 00:00 bintray--sbt-rpm 11/11 epel | 4.3 kB 00:00 http://epel.mirror.net.in/epel/6/x86_64/repodata/repomd.xml: [Errno -1] repomd.xml does not match metalink for epel Trying other mirror. epel | 4.3 kB 00:00 epel/primary_db | 5.9 MB 00:24 extras | 3.4 kB 00:00 extras/primary_db | 37 kB 00:00 updates | 3.4 kB 00:00 updates/primary_db | 2.0 MB 00:08 Package hdp-select-2.5.0.0-1245.el6.noarch already installed and latest version Nothing to do [root@m1 log]# ... View more

@Ayub Pathan I am using following as base URL and don't see any n/w issue. http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.0.0 ... View more

@Gurmukh Singh: Thanks I just tested it with following ways and it is working fine. We can change hadoop fs -ls to hadoop fs -rm -r and required dir. #!/bin/bash usage="Usage: dir_diff.sh [days]" if [!"$1"] then echo$usage exit1 fi now=$(date +%s) hadoop fs -ls /zone_encr2/ | grep "^d" | while read f; do dir_date=`echo $f | awk '{print $6}'` difference=$(( ( $now - $(date -d "$dir_date" +%s) ) / (24 * 60 * 60 ) )) if [$difference-gt$1]; then hadoop fs -ls `echo$f| awk '{ print $8 }'`; fi done ... View more