@Neha G Your krb5.conf on all hosts should have both entries od the HDP and AD realms see below. In the below example HDP.HORTONWORKS.COM = HDP domain AD.HORTONWORKS.COM= AD domain [realms] HDP.HORTONWORKS.COM ={ kdc = kdc-server.hortonworks.com admin_server = kdc-server.hortonworks.com default_domain = hdp.hortonworks.com } AD.HORTONWORKS.COM ={ kdc = ad-server.hortonworks.com admin_server = ad-server.hortonworks.com default_domain = ad.hortonworks.com } Hope that helps ... View more

@Debra Have you recreated the same REALM & password? remember when you run the netdom trust you specified the HADOOP and AD realms with a password And also while creating the "Trust User" with the wiped cluster you created a principal in the KDC that you recreate linking the KDC to the AD. There is also the keytab KVNO associated with the wiped out cluster could cause a nightmare, So it would be reasonable to create a new cluster name and entries in the AD and later delete the old entries. ... View more

@Sam Red The following error indicates that the auth principle format is not correct. java.lang.NullPointerExceptionat org.apache.hadoop.security.authentication.util.KerberosName.getShortName(KerberosName.java:383) # Can you create a new "FileView" instance Ambari UI --> "admin" --> "Manage Ambari" --> "Views" --> "FILES" --> "Create Instance" # If you are logging in to the File View using "admin" user then it need to have the "admin" userhome created in HDFS with the correct owner permissions as following: # hdfs dfs -mkdir /user/admin # hdfs dfs -chown admin /user/admin # Can you double check if "proxyuser" in the Services > HDFS > Configs. Under the Advanced tab, navigate to the Custom core-site section. (Add property) is set correctly or not. In the following example we are assuming that ambari is running with "root" user so the following setting as follows: hadoop.proxyuser.root.groups=* hadoop.proxyuser.root.hosts=* # Can you also give me the values of HDFS-->Config-->Advanced-->Custom Core site-->filter "hadoop.proxyuser" # From the file views give me the value for "WebHDFS Authorization" ... View more

@Sam Red That's bizarre what is the error this time. Can you paste her the screen capture of the Ambari views -Settings And the values of - hadoop.proxyuser.* And also the # kadmin.local kadmin.local: listprincs ambari* And also the log /var/log/ambari-server/files-view ... View more

@Vikas Reddy Confluent has some amazing solutions jdbc,REST,Sinks and source connectors that I think is mature.Syncsort has a DB2 certified connector but you can combine a bunch of technics with Kafka connect to achieve. https://docs.confluent.io/current/connect/index.html https://www.confluent.io/product/connectors/ The above links are good resources. Hope that helps ... View more

@John Doe Surely I try that! Can you tell me exactly which hive script? I will try it out and give you a feedback! ... View more

@Sam Red This is a typical issue with the proxy setting for HDFS. As root log on to the KCD server as shown below, and run the kadmin command. Use the listprinc ambari* to include only Ambari related principals Make sure the user accessing the view has a home in hdfs /user/{$username$} otherwise userhome error will appear # kadmin.local kadmin.local: listprincs ambari* eg in my case below is my output was ambari-qa-pomit@TEST.COM ambari-server-pomit@TEST.COM The principal that has ambari-server is the one we are interested in Ambari UI-->HDFS-->Configs-->Custom core-site (Filter hadoop.proxyuser) Values in my cluster are hadoop.proxyuser.ambari-server-pomit.groups=* hadoop.proxyuser.ambari-server-pomit.hosts=* If the ain't present Go to the Manage Ambari-->Views-->Files-->Create new instance mine is version 1.0.0, Please any values but the Display name should have any white spaces Details Instance Name = Test Display Name =Test_kerberos Description = Test view with Kerberos Setting WebHDFS Username = ${username} WebHDFS Authorization=auth=KERBEROS;proxyuser=ambari-server-pomit@TEST.COM Temporary HDFS Directory* = /user/${username}/files-view/tmp Once the above s done save and click Go to Instance you should be able to access the view ... View more

@Hari Kumar Gandla Here is the explanation and solution to your issue HCC Hope that helped. ... View more

@John Doe I used the same environment but copied the ooziedemo and required files and changed the ownership and permissions for Opera1. The ONLY exception I didn't recreate the table in hive login as: root root@192.168.0.80's password: Last login: Tue Oct 10 17:19:25 2017 from 192.168.0.178 Locates a non HDP user for the second test opera1 [root@gulu ~]# cat /etc/passwd root:x:0:0:root:/root:/bin/bash ....... ...... activity_analyzer:x:1023:1002::/home/activity_analyzer:/bin/bash slider:x:1024:970:SLIDER:/var/lib/slider:/bin/bash spark:x:986:968:Spark:/var/lib/spark:/bin/bash ranger:x:1025:1002::/home/ranger:/bin/bash kms:x:1026:1002::/home/kms:/bin/bash opera1:x:1027:1027::/home/opera1:/bin/bash Switched user to OPERA1 [root@gulu ~]# su - opera1 Last login: Sun Sep 10 20:34:24 CEST 2017 on pts/1 Checked the correct principal and grabbed a Kerberos ticket [opera1@gulu ~]$ klist -kt /etc/security/keytabs/opera1.keytab Keytab name: FILE:/etc/security/keytabs/opera1.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 1 08/24/2017 18:28:26 opera1@UGANDA.COM Grabbed a valid ticket [opera1@gulu ~]$ kinit -kt /etc/security/keytabs/opera1.keytab opera1@UGANDA.COM Checked ticket validity [opera1@gulu hivedemo]$ klist Ticket cache: FILE:/tmp/krb5cc_1027 Default principal: opera1@UGANDA.COM Valid starting Expires Service principal 10/10/2017 20:28:46 10/11/2017 20:28:46 krbtgt/UGANDA.COM@UGANDA.COM As root copied the ooziedemo to /tmp for user Opera1 [root@gulu ~]# cd /home/oozie/ [root@gulu oozie]# ls ooziedemo [root@gulu oozie]# cp -R ooziedemo /tmp [root@gulu oozie]#cd /tmp Gave user Opera1 correct permissions on the ooziedemo [root@gulu tmp]# chown -R opera1:opera1 ooziedemo As the hdfs user copied the file to HDFS [hdfs@gulu ~]$ hdfs dfs -cp /user/oozie/* /user/opera1 [hdfs@gulu ~]$ hdfs dfs -ls /user/opera1 Found 7 items drwxr-xr-x - opera1 hdfs 0 2017-09-07 19:57 /user/opera1/.hiveJars drwx------ - opera1 hdfs 0 2017-09-10 20:45 /user/opera1/.staging -rw-r--r-- 3 hdfs hdfs 1517368515 2017-10-10 20:40 /user/opera1/crime -rw-r--r-- 3 hdfs hdfs 134241 2017-10-05 21:37 /user/opera1/hs_err_pid18536.log drwxr-xr-x - hdfs hdfs 0 2017-10-10 20:40 /user/opera1/oozie-oozi drwxr-xr-x - hdfs hdfs 0 2017-10-10 20:40 /user/opera1/ooziedemo drwxr-xr-x - hdfs hdfs 0 2017-10-10 20:40 /user/opera1/share As HDFS user changed the ownership to opera1 [hdfs@gulu ~]$ hdfs dfs -chown opera1:hdfs /user/opera1 Copied the ooziedemo to /tmp and changed permissions for Opera1 [root@gulu hive]# cp load_crime_table.ddl /tmp/ooziedemo/ [root@gulu hive]# chown opera1:opera1 /tmp/ooziedemo/* [root@gulu hive]# ls -al /tmp/ooziedemo/ total 24 drwxr-xr-x 3 opera1 opera1 4096 Oct 10 20:49 . drwxrwxrwt. 46 root root 12288 Oct 10 20:49 .. drwxr-xr-x 3 opera1 opera1 4096 Oct 10 20:46 hivedemo -rw-r--r-- 1 opera1 opera1 715 Oct 10 20:49 load_crime_table.ddl export the OOZIE_URL environment variable [opera1@gulu ~]$ export OOZIE_URL=http://gulu.uganda.com:11000/oozie Executed the job as opera1 [opera1@gulu hivedemo]$ oozie job -run -config job.properties -verbose -debug -auth kerberos Auth type : kerberos POST http://gulu.uganda.com:11000/oozie/v2/jobs?action=start <?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration> <property><name>nameNode</name><value>hdfs://gulu.uganda.com:8020</value></property> <property><name>outputHiveDatabase</name><value>default</value></property> <property><name>oozie.wf.application.path</name><value>${exampleDir}/app</value></property> <property><name>oozie.use.system.libpath</name><value>true</value></property> <property><name>exampleDir</name><value>${nameNode}/user/${user.name}/ooziedemo/hivedemo</value></property> <property><name>jdbcPrincipal</name><value>hive/_HOST@UGANDA.COM</value></property> <property><name>queryYear</name><value>2008</value></property> <property><name>jobTracker</name><value>gulu.uganda.com:8050</value></property> <property><name>jdbcURL</name><value>jdbc:hive2://gulu.uganda.com:10000/default</value></property> <property><name>hivescript</name><value>${oozie.wf.application.path}/crime_per_year.hql</value></property> <property><name>user.name</name><value>opera1</value></property> </configuration> job: 0000001-170927191637157-oozie-oozi-W [opera1@gulu hivedemo]$ Followed the execution success in RM UI see screenshots, Hope that answers your doubts and demonstrates, please let me know whether I answered your question ... View more

@John Doe I have just tried out the article you mentioned above successfully. My cluster is a kerberized 1 node cluster 16GB RAM HDP.2.6.1.0 Ambari 2.5.1.0 Here is the raw input, To authenticate with Kerberos I had to use the correct principal login as: root root@192.168.0.10's password: Last login: Sat Oct 7 22:31:17 2017 from 192.168.0.178 [root@gulu ~]# su - oozie Last login: Tue Oct 10 17:14:17 CEST 2017 [oozie@gulu ~]$ klist -kt /etc/security/keytabs/o oozie.service.keytab opera1.keytab [oozie@gulu ~]$ klist -kt /etc/security/keytabs/oozie.service.keytab Keytab name: FILE:/etc/security/keytabs/oozie.service.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 1 08/24/2017 15:42:24 oozie/gulu.uganda.com@UGANDA.COM 1 08/24/2017 15:42:24 oozie/gulu.uganda.com@UGANDA.COM 1 08/24/2017 15:42:24 oozie/gulu.uganda.com@UGANDA.COM 1 08/24/2017 15:42:24 oozie/gulu.uganda.com@UGANDA.COM 1 08/24/2017 15:42:24 oozie/gulu.uganda.com@UGANDA.COM Initialize the kerberos ticket [oozie@gulu ~]$ kinit -kt /etc/security/keytabs/oozie.service.keytab oozie/gulu.uganda.com@UGANDA.COM [oozie@gulu ~]$ mkdir -p /tmp/crime [oozie@gulu ~]$ cd /tmp/crime [oozie@gulu crime]$ curl -o crime -L https://data.cityofchicago.org/api/views/ijzp-q8t2/rows.csv?accessType=DOWNLOAD % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 1447M 0 1447M 0 0 1788k 0 --:--:-- 0:13:48 --:--:-- 1953k [oozie@gulu crime]$ ls -al total 1483276 drwxr-xr-x 2 oozie hadoop 4096 Oct 10 17:16 . drwxrwxrwt. 43 root root 12288 Oct 10 17:35 .. -rw-r--r-- 1 oozie hadoop 1517368515 Oct 10 17:30 crime Directory /user/oozie already exists so no need to create one [hdfs@gulu ~]$ klist -kt /etc/security/keytabs/hdfs.headless.keytab Keytab name: FILE:/etc/security/keytabs/hdfs.headless.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 1 08/24/2017 15:42:23 hdfs-pomit@UGANDA.COM (aes256-cts-hmac-sha1-96) ....... 1 08/24/2017 15:42:23 hdfs-pomit@UGANDA.COM (des3-cbc-sha1) Grabbed a valid Kerberos ticket [hdfs@gulu ~] $ kinit -kt /etc/security/keytabs/hdfs.headless.keytab hdfs-pomit@ UGANDA.COM Check oozie directories [hdfs@gulu ~]$ hdfs dfs -ls /user Found 9 items drwx------ - accumulo hdfs 0 2017-07-31 00:28 /user/accumulo drwxr-xr-x - admin hdfs 0 2017-08-26 23:56 /user/admin ..... drwxr-xr-x - hive hdfs 0 2017-08-27 00:20 /user/hive drwxrwxr-x - oozie hdfs 0 2017-07-31 00:35 /user/oozie drwxr-xr-x - opera1 hdfs 0 2017-10-05 21:37 /user/opera1 drwxr-xr-x - zeppelin hdfs 0 2017-07-31 00:27 /user/zeppelin Switch to oozie user locate the correct principal and get a Kerberos ticket [oozie@gulu crime]$ klist -kt /etc/security/keytabs/oozie.service.keytab Keytab name: FILE:/etc/security/keytabs/oozie.service.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 1 08/24/2017 15:42:24 oozie/gulu.uganda.com@UGANDA.COM ...... 1 08/24/2017 15:42:24 oozie/gulu.uganda.com@UGANDA.COM [oozie@gulu crime]$ kinit -kt /etc/security/keytabs/oozie.service.keytab oozie/gulu.uganda.com@UGANDA.COM Copy the crime csv into HDFS [oozie@gulu crime]$ hdfs dfs -copyFromLocal crime /user/oozie/ [oozie@gulu crime]$ hdfs dfs -ls /user/oozie Found 2 items -rw-r--r-- 3 oozie hdfs 1517368515 2017-10-10 17:39 /user/oozie/crime drwxr-xr-x - oozie hdfs 0 2017-07-31 00:35 /user/oozie/share Change permissions [oozie@gulu crime]$ hdfs dfs -chmod -R 777 /user/oozie/crime [oozie@gulu crime]$ hdfs dfs -ls /user/oozie Found 2 items -rwxrwxrwx 3 oozie hdfs 1517368515 2017-10-10 17:39 /user/oozie/crime drwxr-xr-x - oozie hdfs 0 2017-07-31 00:35 /user/oozie/share Switch to hive user to create the table in beeline,but first get a Kerberos ticket for hive [root@gulu ~]# su - hive Last login: Mon Oct 2 16:28:51 CEST 2017 on pts/1 [hive@gulu ~]$ klist -kt /etc/security/keytabs/hive.service.keytab Keytab name: FILE:/etc/security/keytabs/hive.service.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 1 08/24/2017 15:42:24 hive/gulu.uganda.com@UGANDA.COM ............. 1 08/24/2017 15:42:24 hive/gulu.uganda.com@UGANDA.COM [hive@gulu ~]$ kinit -kt /etc/security/keytabs/hive.service.keytab hive/gulu.uganda.com@UGANDA.COM Create the HQL script I only changed the site-specific entries [hive@gulu ~]$ vi load_crime_table.ddl [hive@gulu ~]$ ls -al total 56 -rw-r--r-- 1 hive hadoop 715 Oct 10 17:47 load_crime_table.ddl With a valid Kerbero ticket I connect to beeline [hive@gulu ~]$ beeline -u "jdbc:hive2://gulu.uganda.com:10000/default;principal=hive/_HOST@UGANDA.COM" -f "/home/hive/load_crime_table.ddl" Connecting to jdbc:hive2://gulu.uganda.com:10000/default;principal=hive/_HOST@UGANDA.COM Connected to: Apache Hive (version 1.2.1000.2.6.1.0-129) Driver: Hive JDBC (version 1.2.1000.2.6.1.0-129) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://gulu.uganda.com:10000/default> CREATE EXTERNAL TABLE IF NOT EXISTS crime( 0: jdbc:hive2://gulu.uganda.com:10000/default> ID STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Case_Number STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Case_Date STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Block STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> IUCR INT, 0: jdbc:hive2://gulu.uganda.com:10000/default> Primary_Type STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Description STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Location_Description STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Arrest BOOLEAN, 0: jdbc:hive2://gulu.uganda.com:10000/default> Domestic BOOLEAN, 0: jdbc:hive2://gulu.uganda.com:10000/default> Beat STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> District STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Ward STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Community_Area STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> FBI_Code STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> X_Coordinate INT, 0: jdbc:hive2://gulu.uganda.com:10000/default> Y_Coordinate INT, 0: jdbc:hive2://gulu.uganda.com:10000/default> Case_Year INT, 0: jdbc:hive2://gulu.uganda.com:10000/default> Updated_On STRING, 0: jdbc:hive2://gulu.uganda.com:10000/default> Latitude DOUBLE, 0: jdbc:hive2://gulu.uganda.com:10000/default> Longitude DOUBLE, 0: jdbc:hive2://gulu.uganda.com:10000/default> Location STRING) 0: jdbc:hive2://gulu.uganda.com:10000/default> COMMENT 'This is crime data for the city of Chicago.' 0: jdbc:hive2://gulu.uganda.com:10000/default> ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde' 0: jdbc:hive2://gulu.uganda.com:10000/default> STORED AS TEXTFILE 0: jdbc:hive2://gulu.uganda.com:10000/default> LOCATION '/tmp/crime' 0: jdbc:hive2://gulu.uganda.com:10000/default> TBLPROPERTIES("skip.header.line.count"="1"); No rows affected (32.509 seconds) 0: jdbc:hive2://gulu.uganda.com:10000/default> Closing: 0: jdbc:hive2://gulu.uganda.com:10000/default;principal=hive/_HOST@UGANDA.COM Create the demo directory in hdfs and copy all the files created previously locally workflow.xml,crime_per_year.hql and downloaded files [oozie@gulu crime]$ hdfs dfs -mkdir -p /user/oozie/ooziedemo Validation [oozie@gulu crime]$ hdfs dfs -ls /user/oozie Found 3 items -rwxrwxrwx 3 oozie hdfs 1517368515 2017-10-10 17:39 /user/oozie/crime drwxr-xr-x - oozie hdfs 0 2017-10-10 17:57 /user/oozie/ooziedemo drwxr-xr-x - oozie hdfs 0 2017-07-31 00:35 /user/oozie/share [oozie@gulu app]$ vi workflow.xml [ oozie@gulu app]$ vi crime_per_year.hql [oozie@gulu app]$ cd ~/ooziedemo [oozie@gulu ooziedemo]$ hdfs dfs -copyFromLocal hivedemo /user/oozie/ooziedemo/ [oozie@gulu ooziedemo]$ hdfs dfs -ls -R /user/oozie/ooziedemo/ drwxr-xr-x - oozie hdfs 0 2017-10-10 18:10 /user/oozie/ooziedemo/hivedemo drwxr-xr-x - oozie hdfs 0 2017-10-10 18:10 /user/oozie/ooziedemo/hivedemo/app -rw-r--r-- 3 oozie hdfs 206 2017-10-10 18:10 /user/oozie/ooziedemo/hivedemo/app/crime_per_year.hql drwxr-xr-x - oozie hdfs 0 2017-10-10 18:10 /user/oozie/ooziedemo/hivedemo/app/lib -rw-r--r-- 3 oozie hdfs 968 2017-10-10 18:10 /user/oozie/ooziedemo/hivedemo/app/workflow.xml -rw-r--r-- 3 oozie hdfs 406 2017-10-10 18:10 /user/oozie/ooziedemo/hivedemo/job.properties export the OOZIE_URL environment variable [oozie@gulu ooziedemo]$ export OOZIE_URL=http://gulu.uganda.com:11000/oozie Run the oozie job [oozie@gulu hivedemo]$ oozie job -run -config job.properties -verbose -debug -auth kerberos Auth type : kerberos POST http://gulu.uganda.com:11000/oozie/v2/jobs?action=start <?xml version="1.0" encoding="UTF-8" standalone="no"?><configuration> <property><name>nameNode</name><value>hdfs://gulu.uganda.com:8020</value></property> <property><name>outputHiveDatabase</name><value>default</value></property> <property><name>oozie.wf.application.path</name><value>${exampleDir}/app</value></property> <property><name>oozie.use.system.libpath</name><value>true</value></property> <property><name>exampleDir</name><value>${nameNode}/user/${user.name}/ooziedemo/hivedemo</value></property> <property><name>jdbcPrincipal</name><value>hive/_HOST@UGANDA.COM</value></property> <property><name>queryYear</name><value>2008</value></property> <property><name>jobTracker</name><value>gulu.uganda.com:8050</value></property> <property><name>jdbcURL</name><value>jdbc:hive2://gulu.uganda.com:10000/default</value></property> <property><name>hivescript</name><value>${oozie.wf.application.path}/crime_per_year.hql</value></property> <property><name>user.name</name><value>oozie</value></property> </configuration> job: 0000000-170927191637157-oozie-oozi-W Once launched I switched to the RM to monitor the progress, See the attached screenshots for the Resource Manager. The job completed successfully, so compare and see where you went wrong or revert I could be of some help Hope that helps ... View more

@Dinesh Das How much memory have you allocated your EC2 instance? 14 to 16 GB would work well ... View more

@Roberto Sancho I found a very interesting setup from toad world ... View more

@Nicolas Le Jeune The problem is the FP (US/MM) sqoop is failing to interpret the Brackets and Slash / after the fourth field. ... View more

@D Giri Can you descript your cluster setup (master, Slave and Edge nodes) Okay what are the new components you are trying to install? You could be checking for the keytabs on the wrong host, can you rerun the below command # kadmin.local Authenticating as principal root/admin@REALM with password. kadmin.local: listprincs All the principals created should be visible in the KD database. If the principal for the component is present take note of the host and try to locate the keytabs in the below location of that node /etc/security/keytabs Please let me know ... View more

@Adil Muganlinsky Please can you have a look at these examples you are missing the hiveserver2 binary or HTTP ports in your connect string ! Hope that helps ... View more

@Nigel Jones Can you remove or comment the first entry of your /etc/hosts to look like below # 127.0.1.1 hdp262-1.novalocal hdp262-1 127.0.0.1 localhost 9.20.65.115 hdp262-1.novalocal hdp262-1 9.20.65.135 hdp262-2.novalocal hdp262-2 9.20.65.175 hdp262-3.novalocal hdp262-3 Then retry it should be okay ... View more

@Parth Panndya How much memory have you allocated the sandbox? Can you also paste in here you VM network configuration? Have a look at this document configuring network for VMWARE You need to disable the network manager causing the LSB failure, which unfortunately you can't before a complete bootup. ... View more