@hema moger Great if it's a Linux server then create a passwordless login between the remote server and the edge node. First, update your /etc/hosts so that the remoter server is pingable from your edge node check the firewall rules and make sure you don't have a DENY Here is the walkthrough See attached pic1.jpg In my case the I have a centos server GULU and a Cloudera Quickstart VM running in Oracle VM virtual box because they are on the same network it's easy GULU Remote server: I want to copy the file test.txt which is located in /home/sheltong/Downloads [root@gulu ~]# cd /home/sheltong/Downloads [root@gulu Downloads]# ls test.txt Edge node or localhost: [root@quickstart home]# scp root@192.168.0.80:/home/sheltong/Downloads/test.txt . The authenticity of host '192.168.0.80 (192.168.0.80)' can't be established. RSA key fingerprint is 93:8a:6c:02:9d:1f:e1:b5:0a:05:68:06:3b:7d:a3:d3. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '192.168.0.80' (RSA) to the list of known hosts. root@192.168.0.80's password:xxxxxremote_server_root_passwordxxx test.txt 100% 136 0.1KB/s 00:00 Validate that the file was copied [root@quickstart home]# ls cloudera test.txt There you are I hope that helped ... View more

@hema moger 1. Is the remote server a Linux box or Windows? If its the latter then you will need WinSCP to transfer the file to a Linux box. 2. If you set up your cluster according to the recommended architecture you should be having an edge node(s), Masternodes and data nodes. Typically your edge node will be used to recevieve the csv file.You will need to ensure there is connectivity between your edge node and the remote Linux box where your CSV file is. Assuming you have root access to boot the remote and edge node then you can copy the CSV file to the edge node. it better to setup a passwordless connection between the edge node and the remote Linux server. If you are on the computer from which you want to send the file to a remote computer: # scp /file/to/send username@remote:/where/to/put Here the remote can be an FQDN or an IP address. On the other hand if you are on the computer wanting to receive the file from a remote computer: # scp username@remote:/file/to/send /where/to/put Then on the edge node, you can invoke hdfs command, assuming the csv file is in /home/transfer/test.csv # su - hdfs $ hdfs dfs -put /home/transfer/test.csv /user/your_hdfs_directory Validate the success of the hdfs command $ hdfs dfs -ls /user/your_hdfs_directory/ You should be able to see your test.csv here ... View more

@glupu @Ian Shrum Try the below URL's for learning ropes HDP sandbox https://hortonworks.com/tutorial/sandbox-deployment-and-install-guide/section/1/ https://hortonworks.com/tutorial/sandbox-deployment-and-install-guide/section/2/ https://hortonworks.com/tutorial/sandbox-deployment-and-install-guide/section/3/ ... View more

@Bala K Yes please add the x.x.x.x dev-addc.fda.eyfids.net dev-addc line in the /etc/hosts on the KDC server and to force TCP protocol between the KDC and AD Server and the following line in the krb5.conf: [libdefaults] udp_preference_limit = 1 Remember we want to eliminate the host not found error ... View more

@Bala K The errors logged in krb5kdc.log Feb 19 18:59:23 qa-hdp-mitkdc.fdaqa.eyfids.net krb5kdc[1064](info): TGS_REQ (8 etypes {18 17 20 19 16 23 25 26}) : LOOKING_UP_SERVER: authtime 0, bigsql/qa-hdp-node5.fdaqa.eyfids.net@FDAQA.EYFIDS.NET for host/qa-hdp-node1.fdaqa.eyfids.net@FDAQA.EYFIDS.NET, Server not found in Kerberos database host/qa-hdp-node2.fdaqa.eyfids.net@FDAQA.EYFIDS.NET, Server not found in Kerberos database host/qa-hdp-node3.fdaqa.eyfids.net@FDAQA.EYFIDS.NET, Server not found in Kerberos database host/qa-hdp-node4.fdaqa.eyfids.net@FDAQA.EYFIDS.NET, Server not found in Kerberos database host/qa-hdp-node5.fdaqa.eyfids.net@FDAQA.EYFIDS.NET, Server not found in Kerberos database FQDN is always required by Kerberos make sure the entries in /etc/hosts reflect that too. A workaround is to set the LDAP server name directly rather than relying on DNS. Please do the necessary changes and revert. ... View more

@Bala K Also, ensure the clock is synchronized between the KDc and AD !! ... View more

@Bala K can the AD user successfully grab a ticket? # kinit aduser@FDA.EYFIDS.NET Then # Klist Can you share the above outputs and also the zip and share the following /var/log/krb5default.log /var/log/kadmind.log /var/log/krb5kdc.log Cheers ... View more

@Bala K Add the below line CAPATHS in the krb5.conf for cross-realm authentication, a database is needed to construct the authentication paths between the realms. From your previous posting add it below Note the (.) dot after the = sign on the second line [domain_realm] xxxx xxxxxx [capaths] FDA.EYFIDS.NET = { FDAQA.EYFIDS.NET = . } On the KDC do you have a principal krbtgt/FDAQA.EYFIDS.NET@FDA.EYFIDS.NET ? you can check with # kadmin.local list_princs If not add as below addprinc -e "aes256-cts:normal aes128-cts:normal des3-hmac-sha1:normal arcfour-hmac:normal des-hmac-sha1:normal des-cbc-md5:normal des-cbc-crc:normal" krbtgt/FDAQA.EYFIDS.NET@FDA.EYFIDS.NET In Ambari -> HDFS -> configs -> Advanced -> hadoop.security.auth_to_local Can you remove these 2 rules RULE:[1:$1@$0](^.*@FDA\.EYFIDS\.NET$)s/^(.*)@FDA\.EYFIDS\.NET$/$1/g RULE:[2:$1@$0](^.*@FDA\.EYFIDS\.NET$)s/^(.*)@FDA\.EYFIDS\.NET$/$1/g Replace them with RULE:[1:$1@$0](.*@FDA.EYFIDS.NET)s/@.*// Regenerate all Hadoop service principals and their respective keytabs and restart all stale components Try and revert ... View more

@Bala K There is an error with your auth_to_local entry for RULE:[2:$1...... In Ambari -> HDFS -> configs -> Advanced -> hadoop.security.auth_to_local RULE:[1:$1@$0](^.*@FDA\.EYFIDS\.NET$)s/^(.*)@FDA\.EYFIDS\.NET$/$1/g RULE:[2:$1@$0](^.*@FDA\.EYFIDS\.NET$)s/^(.*)@FDA\.EYFIDS\.NET$/$1/g Could you change it to the below note the RULE[2 ....line has not '@' RULE:[1:$1@$0](^.*@FDA\.EYFIDS\.NET$)s/^(.*)@FDA\.EYFIDS\.NET$/$1/g RULE:[2:$1@$0](^.*FDA\.EYFIDS\.NET$)s/^(.*)@FDA\.EYFIDS\.NET$/$1/g Please let me know if that helped ... View more