@yvettew  Yes, please try to run the same Curl command from the MAC laptop where you are opening Browser. Also please check your browser settings to see if it has any network proxy setting added or not? ... View more

@yvettew  Can you please share the output of the following curl command from the host where you are running the browser?  Just want to see if there are any Network proxy added in front of Ambari which is causing the 502 error?   # curl -iLv -u "admin:admin" -H "X-Requested-By: ambari" -X GET http://$AMBARI_HOSTNAME:8080/api/v1/check   Please replace the admin:admin with your ambari admin username and password and also the $AMBARI_HOSTNAME with the actual FQDN of ambari server.  Please share the output of the above curl command .    Also please check your browser setting if it has any Network proxy setting added to it? ... View more

@pritam_konar  Your latest error is :   [root@nladfmrvu12 ~]# hdf-select File "/bin/hdf-select", line 216 print "ERROR: Invalid package - " + name ^ SyntaxError: Missing parentheses in call to 'print'. Did you mean print("ERROR: Invalid package - " + name)?   This indicates that you are using "Python3" which needs the print statements to be inside parentheses.  You should be using Python 2.7.x to avoid this error OR you will have to manually update the hdf-select  script to change all 'print' statements with 'print()' Example:   Old: print "The answer is", 2*2 New: print("The answer is", 2*2)   You can see this behaviour change in Python3 in the following doc: https://docs.python.org/3/whatsnew/3.0.html   The print statement has been replaced with a print() function, with keyword arguments to replace most of the special syntax of the old print statement (PEP 3105).   . .   If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.   Better to add new Community Topic/Threads for completely unrelated errors that way it helps more users. ... View more

@Manoj690  Looks like you have marked an incorrect post as "Solution" which simply has an Error posted.   the post which you have marked as solution simple contains the below error message which makes no sense: ERROR manager.SqlManager: Error executing statement: java.sql.SQLException: Access denied for user 'root'@'hostname' (using password: NO) . Please be careful while marking a post as solution ..  ... View more

@pritam_konar  Yes hdf-select might be installed. However we you have mentioned earlier that when you tried to run it manually still you noticed this error:  which means it might not be installed properly.    [root@nladfmrvu12 ~]# hdf-select | grep nifi -bash: hdf-select: command not found [root@nladfmrvu11 ~]# hdf-select | grep nifi -bash: hdf-select: command not found   Thats why try to do a yum reinstall once. # yum reinstall hdf-select What i meant to say is .... hdf-select might not be able to determine the packages.  hdf-select usualy looks inside the "/usr/hdf/" directory and checks the versions and the "current" ..   So do you see any version for hdf components when you run the hdf-select command? # hdf-select   If not then please try to set the versions and then see if it works?   # hdf-select set nifi 3.3.1.0-10 # hdf-select set nifi-registry 3.3.1.0-10 # hdf-select set nifi-toolkit 3.3.1.0-10   ... View more

@pritam_konar  "#yum clean all"  will not delete any package from the host. It will just clean the yum cache header/packages. # yum clean packages    Eliminate any cached packages from the system. Note that packages are not automatically deleted after they are downloaded.   # yum clean headers  Eliminate all of the header files which yum uses for dependency resolution. # yum clean all      Runs yum clean packages and yum clean headers as above. ... View more

@vinodnerella  It depends based on the scenario that how much Heap you should be allocating for the Zookeeper. In your case if you are keep noticing that the Zookeeper heap is reaching to its max 1GB then it is better to increase the Zookeeper heap to a larger value and if needed then enable GC logging for zookeeper to monitor the gc usages in a period of time to findout the approximate heap that you need to setup for your zookeeper based on the environment requirement. As you have already set the Zookeeper heap to 4GB it should be good for now. We can monitor it for some time.   The common cause of Zookeeper OutOfMemory can be when  clients submit requests faster than ZooKeeper can process them, especially if there are a lot of clients.  The it can lead to OOM errors.   You can also take a look into parameters like "zookeeper.snapCount"  but better to monitor Zookeeper with 4GB heap for some time before tuning such parameters.  ... View more

@Manoj690  Looks like you have marked an incorrect answer as "Solution" in this thread. . ... View more

@Manoj690    As your latest error is  ERROR manager.SqlManager: Error executing statement: java.sql.SQLException: Access denied for user 'root'@'hostname' (using password: NO) Which means you will need to make sire that you are entering correct password for "root"  user in the sqoop command . using "--password" option. Also make sure to add the Grant as following for the root user in MySQL DB so that it can connect to mysql from the host where you are running the sqoop command. Example: mysql> GRANT ALL PRIVILEGES ON *.* TO 'root'@'%' IDENTIFIED BY 'XXXXXXXXXX' WITH GRANT OPTION;   Please share the output of the following command # mysql -u root -p Enter Password: <YOUR_PASSWORD> mysql> use mysql; mysql> select user, host FROM user;     ... View more

@Manoj690  Are you sure that you have downloaded the "mysql-connector-java.jar" of version 5.7 (not version 😎 ? because i see that as per: https://dev.mysql.com/doc/connector-j/8.0/en/connector-j-api-changes.html The name of the class that implements java.sql.Driver in MySQL Connector/J has changed from com.mysql.jdbc.Driver to com.mysql.cj.jdbc.Driver. The old class name has been deprecated. So in order to test your JDBC driver please try to run the following command to see if it is listing the driver details? # javap -cp /usr/hdp/sqoop-client/lib/mysql-connector-java.jar com.mysql.jdbc.Driver Or can you download the MySQL connector version 5.x. from https://dev.mysql.com/downloads/connector/j/5.1.html   ... View more

@Manoj690  Yes, in the " jdbc:mysql://xxxxx:3306/dbname"    DB url "xxxxx" is MySQL Server hostname and the "dbname" will be the database which you are trying to connect inside MySQL. ... View more

@Manoj690    You will need to make sure that   the "mysql-connector-java.jar"  is placed inside the "/usr/hdp/sqoop-client/lib" directory. Also your SQOOP command seems to have incorrect mysql JDBC URL is not in correct format "jdbc:mysql://xxxxx:3306/dbname"     # sqoop import --connect jdbc:mysql://xxxxx:3306/dbname --username root --password XXXXXXXXX --table emp --m 1       ... View more

@maxolasersquad  It looks like due to some reason the package installation failed earlier and hence the "/usr/hdf" directory was missing in your case.  So when you attempted to install Nifi package manually on this host then re initiating the wizard might have progressed well.   In order o find out why the initial package installation failed we might need to check the "/var/log/yum.log" and ambari agent log during the time of the issue.  ...etc ... View more

@maxolasersquad  As we see the error:   2019-08-26 16:12:45,213 - call returned (1, 'Traceback (most recent call last):\n File "/usr/bin/hdf-select", line 406, in <module>\n printVersions()\n File "/usr/bin/hdf-select", line 251, in printVersions\n for f in os.listdir(root):\nOSError: [Errno 2] No such file or directory: \'/usr/hdf\'')   Which indicates that the "hdf-select" command is not able to determine the HDF version. Usually this command line utility looks inside the "/usr/hdf" directory and then finds the installed versions of HDF.   Most possible cause could be, either "/usr/hdf/3.4.1.1-4" directory is not present or not readable hence during installation of storm client package on that host it is failing to determine the package version. Example:   # ls -l /usr/hdf/ drwxr-xr-x. 5 root root 49 Aug 26 23:30 3.4.1.1-4 drwxr-xr-x. 2 root root 83 Aug 26 23:30 current # ls -l /usr/hdf/current/ lrwxrwxrwx. 1 root root 31 Aug 2 23:30 nifi -> /usr/hdf/3.4.1.1-4/nifi lrwxrwxrwx. 1 root root 31 Aug 2 23:30 nifi-registry -> /usr/hdf/3.4.1.1-4/nifi-registry lrwxrwxrwx. 1 root root 31 Aug 26 23:30 nifi-toolkit -> /usr/hdf/3.4.1.1-4/nifi-toolkit   Also can you please confirm if the ambari agent is running as root user or non root user? So it looks like due to some reason no package is installed on the problematic host. Are you able to install any package manually on that host? Can you please try the following command to isolate any package installation issue ... may be the repo is not accessible ?   # apt-get install nifi     Then verify if the "/usr/hdf/3.4.1.1-4" directories are created or not? ... View more

@pritam_konar    How did you install NiFi on those two hosts?  Via Ambari or Manually?    Looks like somehow the "hdf-select" installation is missing on the Nifi Host.   I was expecting to see the output from the following command:   # hdf-select | grep nifi nifi - 3.3.1.0-10 nifi-registry - 3.3.1.0-10 nifi-toolkit - 3.3.1.0-10    . Looks like hdf-select is not installed on your host. Can you please try this to see if it works? Install the hdf-select manually as following:   # yum info hdf-select # yum clean all # yum install hdf-select   Then set the correct version for the stack.   # hdf-select set nifi 3.3.1.0-10 # hdf-select set nifi-registry 3.3.1.0-10 # hdf-select set nifi-toolkit 3.3.1.0-10   . Then try to enable ranger . nifi plugin again. . If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

@vivek_b2  As we see this error: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "abcd"; destination host is: "xyz":8032; Which can happen due to few reasons like incorrect FQDN/IP Mapping OR if we do not get a valid kerberos ticket due to some reasons. So it will be good to check few things/ Can you please share the following outputs: 1. On the Edge Node do you have the ambari-agent running? Can you please check and share the output of the following commands: # hostname -f # hostname If your cluster nodes are resolving each other based on the "/etc/hosts" file entry (unlike DNS Server entry) then usually we should see the same /etc/hosts file mapping accross the cluster nodes. So pelase validate the same. # cat /etc/hosts Also from the Edge node are you able to access the scheduler port? # telnet xyz 8032 (OR) # nc -v xyz 8032 2. From the KDC and Ambari Server host you are able to resolve your Edge node using the FQDN correctly? Assuming your Edge node FQDN is "abcd" then from Ambari Server/KDC are you able to resolve it as following? # ping abcd   3. Do you see keytabs inside the "/etc/security/keytabs" directory? Are you able to get a valid kerberos ticket using keytab? Example: # klist -ket /etc/security/keytabs/nm.service.keytab Keytab name: FILE:/etc/security/keytabs/nm.service.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 2 08/11/2019 01:58:29 nm/ker1latest4.example.com@EXAMPLE.COM (des-cbc-md5) 2 08/11/2019 01:58:29 nm/ker1latest4.example.com@EXAMPLE.COM (aes256-cts-hmac-sha1-96) 2 08/11/2019 01:58:29 nm/ker1latest4.example.com@EXAMPLE.COM (des3-cbc-sha1) 2 08/11/2019 01:58:29 nm/ker1latest4.example.com@EXAMPLE.COM (arcfour-hmac) 2 08/11/2019 01:58:29 nm/ker1latest4.example.com@EXAMPLE.COM (aes128-cts-hmac-sha1-96) # kinit -kt /etc/security/keytabs/nm.service.keytab nm/ker1latest4.example.com@EXAMPLE.COM # klist Like are you able to do Kinit and can check if you are able to get valid tickets using "klist" ? In your case the Principal name might be different based on your setup of edge node. . . If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more