Member since
01-19-2017
3679
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 925 | 06-04-2025 11:36 PM | |
| 1529 | 03-23-2025 05:23 AM | |
| 757 | 03-17-2025 10:18 AM | |
| 2726 | 03-05-2025 01:34 PM | |
| 1804 | 03-03-2025 01:09 PM |
01-13-2019
11:44 PM
@Michael Bronson lsof is used to list all the deleted files which are still on disk due to open file descriptors. Memory is not immediately freed because the running process still has an open file handle to the just-deleted file. After all, if a process is still trying to use a file, you probably don't really want the kernel to get rid of it the file. On Linux based machines filenames are just pointers (inodes) that point to the memory where the file resides which could be a hard drive or even a RAM-backed filesystem. Each file records the number of links to it: the links can be either the filename (plural, and also every time a file is opened, the process actually holds the "link" to the same space. Space/memory is physically freed only if there are no links left to the deleted file, So, while the processes have the files still opened, you shouldn't expect to get space/memory back. It's not freed, it's being actively used. This is also one of the reasons that applications should really close the files when they finish using them. HTH
... View more
01-12-2019
07:41 PM
1 Kudo
@Divya Thaore If you are on HDP 2.6.x the login using credentials: root / hadoop and you get the prompt Did you run this command after ambari-admin-password-reset HTH
... View more
01-12-2019
11:22 AM
@Divya Thaore Are you trying to create a cluster using the sandbox from HW? Do you have putty? If not can you download putty
... View more
01-11-2019
10:56 PM
@Fernando Lopez Bello Can you share your CapacityScheduler config
... View more
01-11-2019
09:21 AM
@Divya Thaore Just a follow up do you still need help?
... View more
01-10-2019
05:59 PM
@Divya Thaore If you generated the ssh-keys hoping you didn't protect it with a password navigate to the /root/.ssh directory and # cat id_rsa And copy all the content between including the begin and end as shown and paste in the designated window in Ambari UI -----BEGIN RSA PRIVATE KEY-----
MIIEowIBAAKCAQEA8qP3SQ+81GIpYSd/Sw1uKjt1khxv/zh4aEbRbPK0pcaW1KAh
9mD76BdouBRifv6Mn8ydnanSthRNOmH1LcF8YhkudLseKJFoLO2iIFWtFwSqMPmX
cipTpBo+1YQGdrf3ugKsBZ+vWZBisEI6F5pTGHUrAEO3phYXQxfP6GEoVGQj7aIB
........ ..... qUzoqQKBgBjIJakrJfoFGySAOImIxjQDD0sv3ZTc85WtFeFyRvQxewdPQDS8NvZo
6pyhYJRSGSgaL+xzEwg3D1ofQinkYw1jVYUzldBZESMOslmEuOzYbpImnY3yxLOG
Yo0j49637Chn8BMVnrlELUWWf6YHOrXmwHT6nu71WmbqFBzbmsv8 -----END RSA PRIVATE KEY----- or using WinSCP download the above file and use the option to load from your windows/mac client HTH
... View more
01-10-2019
03:48 PM
@Divya Thaore A good practice to configure passwordless ssh by generating ssh-key on the Ambari server and copying it to all the host in the cluster. Those are the pre-requisites for the cluster install see steps below #####################################
# Generating the ssh key on CentOS 7
#####################################
ssh-keygen
chmod 700 ~/.ssh
cat ~/.ssh/id_rsa.pub >> /root/.ssh/authorized_keys
chmod 600 ~/.ssh/authorized_keys
########################################
# copy the public key to all other hosts
########################################
cat .ssh/id_rsa.pub | ssh root@xxx_host 'cat >> .ssh/authorized_keys' Or you can use manual by installing the ambari-agent on the other nodes but this is impractical for large clusters! One the slave node # yum install -y ambari-agent Then edit the ambari-agent.ini, under security [server]
hostname=$FQDN_Ambari server
url_port=8440
secured_url_port=8441
The start the agent # ambari-agent start Then you can proceed with you Ambari UI adding the hosts remember to do this on all the host you intend to join to your cluster HTH
... View more
01-09-2019
08:48 AM
@huzaira bashir Here they are
... View more
01-08-2019
08:37 PM
@Ali I think for a kerberized cluster you need to use the concept of a jaas.conf file see Accessing kerberized Sources from Spark2 in Cluster mode on YARN HTH
... View more
01-08-2019
02:20 PM
@Kunal Kumar Can you share your /etc/hosts files? To me it seems this is the first host in the cluster, what is your cluster name?
... View more