HTTP/1.1 400 Bad Request Connection: close Error: 400 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 280 100 280 0 0 13594 0 --:--:-- --:--:-- --:--:-- 14000 ####### Download demo script and create local users ... fatal: destination path 'masterclass' already exists and is not an empty directory. groupadd: group 'finance' already exists groupadd: group 'business_dev' already exists groupadd: group 'contractor' already exists groupadd: group 'csr' already exists groupadd: group 'etl' already exists useradd: user 'john_finance' already exists useradd: user 'mark_bizdev' already exists useradd: user 'jeremy_contractor' already exists useradd: user 'diane_csr' already exists useradd: user 'log_monitor' already exists useradd: user 'etl_user' already exists groupadd: group 'us_employee' already exists groupadd: group 'eu_employee' already exists groupadd: group 'analyst' already exists groupadd: group 'hr' already exists groupadd: group 'dpo' already exists useradd: user 'joe_analyst' already exists useradd: user 'kate_hr' already exists useradd: user 'sasha_eu_hr' already exists useradd: user 'ivanna_eu_hr' already exists useradd: user 'michelle_dpo' already exists useradd: user 'ANONYMOUS' already exists ####### Configure cluster for demo... stop Flume, oozie, spark2 and put in maintenance mode % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 101 0 0 100 101 0 9257 --:--:-- --:--:-- --:--:-- 10100 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=18hbez6ee39un1m0e983t4dnhg;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 100 0 0 100 100 0 8298 --:--:-- --:--:-- --:--:-- 9090 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=ha18jexyiuul3zfkw5mf7eem;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 101 0 0 100 101 0 10206 --:--:-- --:--:-- --:--:-- 11222 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1dmygspq01lsk7cyfzh8s01ty;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 108 0 0 100 108 0 10154 --:--:-- --:--:-- --:--:-- 10800 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=10769k8j7feflufbu7nss4fur;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 108 0 0 100 108 0 11091 --:--:-- --:--:-- --:--:-- 12000 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1ca46yjf7rvoac8ae5l22g7nm;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 109 0 0 100 109 0 11339 --:--:-- --:--:-- --:--:-- 12111 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1p06kwr7i57nu1vzmu6lljba;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 Ncat: Connection refused. make sure kafka, hbase, ambari infra, atlas, HDFS are out of maintenance mode % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 121 0 0 100 121 0 10854 --:--:-- --:--:-- --:--:-- 11000 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=wvedsp33aoxi19qg0jj1e07o0;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 121 0 0 100 121 0 12785 --:--:-- --:--:-- --:--:-- 13444 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=9far5kzc77551wgv6eim391ax;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 128 0 0 100 128 0 10876 --:--:-- --:--:-- --:--:-- 11636 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=f5b1uri3sboxr3e1xlg73gua;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 121 0 0 100 121 0 12581 --:--:-- --:--:-- --:--:-- 13444 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1r17l0mqn6liv1eivd85fctplo;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 120 0 0 100 120 0 9756 --:--:-- --:--:-- --:--:-- 10000 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=fqsdyqtz6ifz1sn02aepdf9sk;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 Enable kafka plugin for Ranger 2018-06-30 01:19:52,503 INFO ### Performing "set": 2018-06-30 01:19:52,504 INFO ### new property - "ranger-kafka-plugin-enabled":"Yes" 2018-06-30 01:19:52,522 INFO ### on (Site:ranger-env, Tag:version1530316822115986) 2018-06-30 01:19:52,528 INFO ### PUTting json into: doSet_version1530321592528361.json 2018-06-30 01:19:52,548 INFO ### NEW Site:ranger-env, Tag:version1530321592528361 2018-06-30 01:19:52,597 INFO ### Performing "set": 2018-06-30 01:19:52,597 INFO ### new property - "ranger-kafka-plugin-enabled":"Yes" 2018-06-30 01:19:52,616 INFO ### on (Site:ranger-kafka-plugin-properties, Tag:version1530316821893106) 2018-06-30 01:19:52,622 INFO ### PUTting json into: doSet_version1530321592622025.json 2018-06-30 01:19:52,641 INFO ### NEW Site:ranger-kafka-plugin-properties, Tag:version1530321592622025 enable Audits for Ranger 2018-06-30 01:19:52,693 INFO ### Performing "set": 2018-06-30 01:19:52,694 INFO ### new property - "xasecure.audit.destination.solr":"true" 2018-06-30 01:19:52,712 INFO ### on (Site:ranger-env, Tag:version1530316822115986) 2018-06-30 01:19:52,719 INFO ### PUTting json into: doSet_version1530321592719674.json 2018-06-30 01:19:52,741 INFO ### NEW Site:ranger-env, Tag:version1530321592719674 enable other plugin audits 2018-06-30 01:19:52,793 INFO ### Performing "set": 2018-06-30 01:19:52,793 INFO ### new property - "xasecure.audit.destination.solr":"true" 2018-06-30 01:19:52,813 INFO ### on (Site:ranger-hdfs-audit, Tag:version1530316822327282) 2018-06-30 01:19:52,821 INFO ### PUTting json into: doSet_version1530321592821244.json 2018-06-30 01:19:52,882 INFO ### NEW Site:ranger-hdfs-audit, Tag:version1530321592821244 2018-06-30 01:19:52,937 INFO ### Performing "set": 2018-06-30 01:19:52,937 INFO ### new property - "xasecure.audit.destination.solr":"true" 2018-06-30 01:19:52,961 INFO ### on (Site:ranger-atlas-audit, Tag:version1530316822506679) 2018-06-30 01:19:52,967 INFO ### PUTting json into: doSet_version1530321592967220.json 2018-06-30 01:19:52,987 INFO ### NEW Site:ranger-atlas-audit, Tag:version1530321592967220 2018-06-30 01:19:53,043 INFO ### Performing "set": 2018-06-30 01:19:53,043 INFO ### new property - "xasecure.audit.destination.solr":"true" 2018-06-30 01:19:53,077 INFO ### on (Site:ranger-kafka-audit, Tag:version1530316822687482) 2018-06-30 01:19:53,083 INFO ### PUTting json into: doSet_version1530321593083863.json 2018-06-30 01:19:53,103 INFO ### NEW Site:ranger-kafka-audit, Tag:version1530321593083863 2018-06-30 01:19:53,157 INFO ### Performing "set": 2018-06-30 01:19:53,157 INFO ### new property - "xasecure.audit.destination.solr":"true" 2018-06-30 01:19:53,178 INFO ### on (Site:ranger-hbase-audit, Tag:version1530316822863916) 2018-06-30 01:19:53,188 INFO ### PUTting json into: doSet_version1530321593188638.json 2018-06-30 01:19:53,223 INFO ### NEW Site:ranger-hbase-audit, Tag:version1530321593188638 Ranger tagsync mappings 2018-06-30 01:19:53,275 INFO ### Performing "set": 2018-06-30 01:19:53,275 INFO ### new property - "ranger.tagsync.atlas.hdfs.instance.cl1.ranger.service":"Sandbox_hadoop" 2018-06-30 01:19:53,296 INFO ### on (Site:ranger-tagsync-site, Tag:version1530316823723485) 2018-06-30 01:19:53,302 INFO ### PUTting json into: doSet_version1530321593302036.json 2018-06-30 01:19:53,322 INFO ### NEW Site:ranger-tagsync-site, Tag:version1530321593302036 2018-06-30 01:19:53,373 INFO ### Performing "set": 2018-06-30 01:19:53,373 INFO ### new property - "ranger.tagsync.atlas.hdfs.instance.hdp.ranger.service":"Sandbox_hadoop" 2018-06-30 01:19:53,399 INFO ### on (Site:ranger-tagsync-site, Tag:version1530316823723485) 2018-06-30 01:19:53,408 INFO ### PUTting json into: doSet_version1530321593408696.json 2018-06-30 01:19:53,431 INFO ### NEW Site:ranger-tagsync-site, Tag:version1530321593408696 2018-06-30 01:19:53,484 INFO ### Performing "set": 2018-06-30 01:19:53,484 INFO ### new property - "ranger.tagsync.atlas.hive.instance.hdp.ranger.service":"Sandbox_hive" 2018-06-30 01:19:53,504 INFO ### on (Site:ranger-tagsync-site, Tag:version1530316823723485) 2018-06-30 01:19:53,510 INFO ### PUTting json into: doSet_version1530321593510819.json 2018-06-30 01:19:53,530 INFO ### NEW Site:ranger-tagsync-site, Tag:version1530321593510819 2018-06-30 01:19:53,581 INFO ### Performing "set": 2018-06-30 01:19:53,581 INFO ### new property - "ranger.tagsync.atlas.hbase.instance.cl1.ranger.service":"Sandbox_hbase" 2018-06-30 01:19:53,600 INFO ### on (Site:ranger-tagsync-site, Tag:version1530316823723485) 2018-06-30 01:19:53,606 INFO ### PUTting json into: doSet_version1530321593606804.json 2018-06-30 01:19:53,627 INFO ### NEW Site:ranger-tagsync-site, Tag:version1530321593606804 2018-06-30 01:19:53,678 INFO ### Performing "set": 2018-06-30 01:19:53,678 INFO ### new property - "ranger.tagsync.atlas.kafka.instance.cl1.ranger.service":"Sandbox_kafka" 2018-06-30 01:19:53,696 INFO ### on (Site:ranger-tagsync-site, Tag:version1530316823723485) 2018-06-30 01:19:53,703 INFO ### PUTting json into: doSet_version1530321593703637.json 2018-06-30 01:19:53,724 INFO ### NEW Site:ranger-tagsync-site, Tag:version1530321593703637 Set Kafka replication factor to 1 2018-06-30 01:19:53,776 INFO ### Performing "set": 2018-06-30 01:19:53,776 INFO ### new property - "offsets.topic.replication.factor":"1" 2018-06-30 01:19:53,806 INFO ### on (Site:kafka-broker, Tag:TOPOLOGY_RESOLVED) 2018-06-30 01:19:53,812 INFO ### PUTting json into: doSet_version1530321593812748.json 2018-06-30 01:19:53,843 INFO ### NEW Site:kafka-broker, Tag:version1530321593812748 stop Ranger % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 101 0 0 100 101 0 3188 --:--:-- --:--:-- --:--:-- 3258 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1gea6niyzxejtkshrqqcnhcfd;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 Ncat: Connection refused. start Ranger % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 257 100 157 100 100 1960 1248 --:--:-- --:--:-- --:--:-- 1987 HTTP/1.1 202 Accepted X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1s8zezubp6kx1u201357cpplq;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Vary: Accept-Encoding, User-Agent Content-Length: 157 { "href" : "http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/requests/126", "Requests" : { "id" : 126, "status" : "Accepted" } }wait until ranger comes up Ncat: Connection refused. waiting for Ranger to come up... Ncat: Connection refused. waiting for Ranger to come up... Ncat: Connection refused. waiting for Ranger to come up... HTTP/1.1 400 Bad Request Server: Apache-Coyote/1.1 Transfer-Encoding: chunked Date: Sat, 30 Jun 2018 01:20:51 GMT Connection: close 0 Change Hive doAs setting and enable audits 2018-06-30 01:20:52,115 INFO ### Performing "set": 2018-06-30 01:20:52,115 INFO ### new property - "hive.server2.enable.doAs":"true" 2018-06-30 01:20:52,202 INFO ### on (Site:hive-site, Tag:version1530320885550) 2018-06-30 01:20:52,217 INFO ### PUTting json into: doSet_version1530321652216824.json 2018-06-30 01:20:52,347 INFO ### NEW Site:hive-site, Tag:version1530321652216824 2018-06-30 01:20:52,459 INFO ### Performing "set": 2018-06-30 01:20:52,459 INFO ### new property - "xasecure.audit.destination.solr":"true" 2018-06-30 01:20:52,514 INFO ### on (Site:ranger-hive-audit, Tag:version1530316931673840) 2018-06-30 01:20:52,531 INFO ### PUTting json into: doSet_version1530321652531708.json 2018-06-30 01:20:52,649 INFO ### NEW Site:ranger-hive-audit, Tag:version1530321652531708 enabling Hive ACID... 2018-06-30 01:20:52,750 INFO ### Performing "set": 2018-06-30 01:20:52,750 INFO ### new property - "hive_txn_acid":"on" 2018-06-30 01:20:52,806 INFO ### on (Site:hive-env, Tag:version1530316931906793) 2018-06-30 01:20:52,818 INFO ### PUTting json into: doSet_version1530321652817958.json 2018-06-30 01:20:52,930 INFO ### NEW Site:hive-env, Tag:version1530321652817958 2018-06-30 01:20:53,032 INFO ### Performing "set": 2018-06-30 01:20:53,032 INFO ### new property - "hive.support.concurrency":"true" 2018-06-30 01:20:53,078 INFO ### on (Site:hive-site, Tag:version1530320885550) 2018-06-30 01:20:53,096 INFO ### PUTting json into: doSet_version1530321653096050.json 2018-06-30 01:20:53,142 INFO ### NEW Site:hive-site, Tag:version1530321653096050 2018-06-30 01:20:53,249 INFO ### Performing "set": 2018-06-30 01:20:53,251 INFO ### new property - "hive.compactor.initiator.on":"true" 2018-06-30 01:20:53,304 INFO ### on (Site:hive-site, Tag:version1530320885550) 2018-06-30 01:20:53,316 INFO ### PUTting json into: doSet_version1530321653316765.json 2018-06-30 01:20:53,382 INFO ### NEW Site:hive-site, Tag:version1530321653316765 2018-06-30 01:20:53,512 INFO ### Performing "set": 2018-06-30 01:20:53,512 INFO ### new property - "hive.compactor.worker.threads":"1" 2018-06-30 01:20:53,605 INFO ### on (Site:hive-site, Tag:version1530320885550) 2018-06-30 01:20:53,650 INFO ### PUTting json into: doSet_version1530321653650027.json 2018-06-30 01:20:53,684 INFO ### NEW Site:hive-site, Tag:version1530321653650027 2018-06-30 01:20:53,779 INFO ### Performing "set": 2018-06-30 01:20:53,779 INFO ### new property - "hive.enforce.bucketing":"true" 2018-06-30 01:20:53,829 INFO ### on (Site:hive-site, Tag:version1530320885550) 2018-06-30 01:20:53,847 INFO ### PUTting json into: doSet_version1530321653847447.json 2018-06-30 01:20:53,885 INFO ### NEW Site:hive-site, Tag:version1530321653847447 2018-06-30 01:20:53,965 INFO ### Performing "set": 2018-06-30 01:20:53,965 INFO ### new property - "hive.exec.dynamic.partition.mode":"nonstrict" 2018-06-30 01:20:54,021 INFO ### on (Site:hive-site, Tag:version1530320885550) 2018-06-30 01:20:54,029 INFO ### PUTting json into: doSet_version1530321654029384.json 2018-06-30 01:20:54,066 INFO ### NEW Site:hive-site, Tag:version1530321654029384 2018-06-30 01:20:54,125 INFO ### Performing "set": 2018-06-30 01:20:54,125 INFO ### new property - "hive.txn.manager":"org.apache.hadoop.hive.ql.lockmgr.DbTxnManager" 2018-06-30 01:20:54,150 INFO ### on (Site:hive-site, Tag:version1530320885550) 2018-06-30 01:20:54,161 INFO ### PUTting json into: doSet_version1530321654161623.json 2018-06-30 01:20:54,203 INFO ### NEW Site:hive-site, Tag:version1530321654161623 restart Hive % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 256 100 157 100 99 2215 1397 --:--:-- --:--:-- --:--:-- 2242 HTTP/1.1 202 Accepted X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1kg50fgdraz5w1u99jhvy8xk8v;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Vary: Accept-Encoding, User-Agent Content-Length: 157 { "href" : "http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/requests/127", "Requests" : { "id" : 127, "status" : "Accepted" } }Invalid status 101waiting for Hive to go down... Invalid status 101waiting for Hive to go down... Invalid status 101waiting for Hive to go down... Ncat: Connection refused. HTTP/1.1 400 Bad Request Content-Length: 0 Connection: close Server: Jetty(7.6.0.v20120127) waiting for Hcat to go down... HTTP/1.1 400 Bad Request Content-Length: 0 Connection: close Server: Jetty(7.6.0.v20120127) waiting for Hcat to go down... HTTP/1.1 400 Bad Request Content-Length: 0 Connection: close Server: Jetty(7.6.0.v20120127) waiting for Hcat to go down... HTTP/1.1 400 Bad Request Content-Length: 0 Connection: close Server: Jetty(7.6.0.v20120127) waiting for Hcat to go down... Ncat: Connection refused. % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 255 100 157 100 98 1924 1201 --:--:-- --:--:-- --:--:-- 1938 HTTP/1.1 202 Accepted X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1c83olvd7s7tj153rw7g4q5d0v;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Vary: Accept-Encoding, User-Agent Content-Length: 157 { "href" : "http://sandbox-hdp.hortonworks.com:8080/api/v1/clusters/Sandbox/requests/128", "Requests" : { "id" : 128, "status" : "Accepted" } }Start Kafka, HBase, Ambari infra, Atlas % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 99 0 0 100 99 0 2050 --:--:-- --:--:-- --:--:-- 2062 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1mkg5r8dfss3l1im9327i4kgpn;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 99 0 0 100 99 0 3292 --:--:-- --:--:-- --:--:-- 3413 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=15gz3rngouulag7tyk1sowuge;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 106 0 0 100 106 0 6153 --:--:-- --:--:-- --:--:-- 6235 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=n7t6786b9yh5w8rt4gtqrb7z;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 99 0 0 100 99 0 8880 --:--:-- --:--:-- --:--:-- 9900 HTTP/1.1 200 OK X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=xineh89yeflo1mdg0ubt8k128;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 wait until atlas come up HTTP/1.1 400 Bad Request Connection: close Server: Jetty(8.1.19.v20160209) Error: 400 adding user kate_hr to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 223 100 120 100 103 8301 7125 --:--:-- --:--:-- --:--:-- 8571 { "status" : 500, "message" : "An internal system exception occurred: User kate_hr already exists with type LOCAL" }adding user ivanna_eu_hr to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 233 100 125 100 108 14859 12838 --:--:-- --:--:-- --:--:-- 15625 { "status" : 500, "message" : "An internal system exception occurred: User ivanna_eu_hr already exists with type LOCAL" }adding user joe_analyst to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 231 100 124 100 107 6986 6028 --:--:-- --:--:-- --:--:-- 7294 { "status" : 500, "message" : "An internal system exception occurred: User joe_analyst already exists with type LOCAL" }adding user sasha_eu_hr to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 231 100 124 100 107 8615 7434 --:--:-- --:--:-- --:--:-- 8857 { "status" : 500, "message" : "An internal system exception occurred: User sasha_eu_hr already exists with type LOCAL" }adding user john_finance to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 233 100 125 100 108 5054 4367 --:--:-- --:--:-- --:--:-- 5000 100 233 100 125 100 108 5023 4340 --:--:-- --:--:-- --:--:-- 5000 { "status" : 500, "message" : "An internal system exception occurred: User john_finance already exists with type LOCAL" }adding user mark_bizdev to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 231 100 124 100 107 16219 13996 --:--:-- --:--:-- --:--:-- 17714 { "status" : 500, "message" : "An internal system exception occurred: User mark_bizdev already exists with type LOCAL" }adding user jermy_contractor to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 241 100 129 100 112 10377 9009 --:--:-- --:--:-- --:--:-- 10750 { "status" : 500, "message" : "An internal system exception occurred: User jermy_contractor already exists with type LOCAL" }adding user diane_csr to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 227 100 122 100 105 11292 9718 --:--:-- --:--:-- --:--:-- 12200 { "status" : 500, "message" : "An internal system exception occurred: User diane_csr already exists with type LOCAL" }adding user log_monitor to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 231 100 124 100 107 9350 8068 --:--:-- --:--:-- --:--:-- 9538 { "status" : 500, "message" : "An internal system exception occurred: User log_monitor already exists with type LOCAL" }adding user etl_user to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 225 100 121 100 104 11873 10205 --:--:-- --:--:-- --:--:-- 12100 { "status" : 500, "message" : "An internal system exception occurred: User etl_user already exists with type LOCAL" }adding user demokitadmin to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 233 100 125 100 108 6598 5701 --:--:-- --:--:-- --:--:-- 6944 { "status" : 500, "message" : "An internal system exception occurred: User demokitadmin already exists with type LOCAL" }create groups in Ambari adding group hr to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 124 100 98 100 26 3390 899 --:--:-- --:--:-- --:--:-- 3500 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }adding group analyst to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 129 100 98 100 31 6512 2060 --:--:-- --:--:-- --:--:-- 7000 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }adding group us_employee to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 133 100 98 100 35 2741 978 --:--:-- --:--:-- --:--:-- 2800 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }adding group eu_employee to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 133 100 98 100 35 8632 3083 --:--:-- --:--:-- --:--:-- 8909 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }adding group finance to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 129 100 98 100 31 5076 1605 --:--:-- --:--:-- --:--:-- 5157 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }adding group business_dev to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 98 100 36 6699 2461 --:--:-- --:--:-- --:--:-- 7000 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }adding group contractor to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 132 100 98 100 34 6759 2344 --:--:-- --:--:-- --:--:-- 7000 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }adding group csr to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 125 100 98 100 27 2418 666 --:--:-- --:--:-- --:--:-- 2450 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }adding group etl to Ambari % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 125 100 98 100 27 11909 3281 --:--:-- --:--:-- --:--:-- 12250 { "status" : 500, "message" : "An internal system exception occurred: Group already exists." }HR group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 184 100 120 100 64 5911 3152 --:--:-- --:--:-- --:--:-- 6000 { "status" : 500, "message" : "An internal system exception occurred: User kate_hr is already present in group hr" } % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 194 100 125 100 69 9433 5207 --:--:-- --:--:-- --:--:-- 10416 { "status" : 500, "message" : "An internal system exception occurred: User ivanna_eu_hr is already present in group hr" } % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 192 100 124 100 68 2744 1504 --:--:-- --:--:-- --:--:-- 2818 { "status" : 500, "message" : "An internal system exception occurred: User sasha_eu_hr is already present in group hr" }analyst group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 202 100 129 100 73 2853 1614 --:--:-- --:--:-- --:--:-- 2931 { "status" : 500, "message" : "An internal system exception occurred: User joe_analyst is already present in group analyst" }us_employee group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 202 100 129 100 73 6696 3789 --:--:-- --:--:-- --:--:-- 6789 { "status" : 500, "message" : "An internal system exception occurred: User kate_hr is already present in group us_employee" } % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 210 100 133 100 77 5693 3296 --:--:-- --:--:-- --:--:-- 5782 { "status" : 500, "message" : "An internal system exception occurred: User joe_analyst is already present in group us_employee" }eu_employee group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 212 100 134 100 78 4396 2559 --:--:-- --:--:-- --:--:-- 4466 { "status" : 500, "message" : "An internal system exception occurred: User ivanna_eu_hr is already present in group eu_employee" } % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 210 100 133 100 77 5443 3151 --:--:-- --:--:-- --:--:-- 5541 { "status" : 500, "message" : "An internal system exception occurred: User sasha_eu_hr is already present in group eu_employee" }finance group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 204 100 130 100 74 4026 2291 --:--:-- --:--:-- --:--:-- 4062 { "status" : 500, "message" : "An internal system exception occurred: User john_finance is already present in group finance" }bizdev group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 212 100 134 100 78 8953 5211 --:--:-- --:--:-- --:--:-- 9571 { "status" : 500, "message" : "An internal system exception occurred: User mark_bizdev is already present in group business_dev" }contractor group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 218 100 137 100 81 6699 3961 --:--:-- --:--:-- --:--:-- 6850 { "status" : 500, "message" : "An internal system exception occurred: User jermy_contractor is already present in group contractor" }csr group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 190 100 123 100 67 7414 4039 --:--:-- --:--:-- --:--:-- 7687 { "status" : 500, "message" : "An internal system exception occurred: User diane_csr is already present in group csr" }etl group membership % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 194 100 125 100 69 5501 3036 --:--:-- --:--:-- --:--:-- 5681 { "status" : 500, "message" : "An internal system exception occurred: User log_monitor is already present in group etl" } % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 188 100 122 100 66 2235 1209 --:--:-- --:--:-- --:--:-- 2259 { "status" : 500, "message" : "An internal system exception occurred: User etl_user is already present in group etl" }add groups to Hive views % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 876 0 0 100 876 0 13844 --:--:-- --:--:-- --:--:-- 13687 100 876 0 0 100 876 0 13805 --:--:-- --:--:-- --:--:-- 13687 HTTP/1.1 200 OK X-Frame-Options: SAMEORIGIN X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=79sjj1dp5z4jyvud120g08x3;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 876 0 0 100 876 0 9162 --:--:-- --:--:-- --:--:-- 9221 HTTP/1.1 200 OK X-Frame-Options: SAMEORIGIN X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=8ph1hzl9lawonanpytqog8nf;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Type: text/plain Content-Length: 0 pull latest notebooks remote: Counting objects: 749, done. remote: Compressing objects: 16% (1/6)  remote: Compressing objects: 33% (2/6)  remote: Compressing objects: 50% (3/6)  remote: Compressing objects: 66% (4/6)  remote: Compressing objects: 83% (5/6)  remote: Compressing objects: 100% (6/6)  remote: Compressing objects: 100% (6/6), done. Receiving objects: 0% (1/749) Receiving objects: 1% (8/749) Receiving objects: 2% (15/749) Receiving objects: 3% (23/749) Receiving objects: 4% (30/749) Receiving objects: 5% (38/749) Receiving objects: 6% (45/749) Receiving objects: 7% (53/749) Receiving objects: 8% (60/749) Receiving objects: 9% (68/749) Receiving objects: 10% (75/749) Receiving objects: 11% (83/749) Receiving objects: 12% (90/749) Receiving objects: 13% (98/749) Receiving objects: 14% (105/749) Receiving objects: 15% (113/749) Receiving objects: 16% (120/749) Receiving objects: 17% (128/749) Receiving objects: 18% (135/749) Receiving objects: 19% (143/749) Receiving objects: 20% (150/749) Receiving objects: 21% (158/749) Receiving objects: 22% (165/749) Receiving objects: 23% (173/749) Receiving objects: 24% (180/749) Receiving objects: 25% (188/749) Receiving objects: 26% (195/749) Receiving objects: 27% (203/749) Receiving objects: 28% (210/749) Receiving objects: 29% (218/749) Receiving objects: 30% (225/749) Receiving objects: 31% (233/749) Receiving objects: 32% (240/749) Receiving objects: 33% (248/749), 140.01 KiB | 246.00 KiB/s Receiving objects: 34% (255/749), 140.01 KiB | 246.00 KiB/s Receiving objects: 35% (263/749), 140.01 KiB | 246.00 KiB/s Receiving objects: 35% (268/749), 708.01 KiB | 646.00 KiB/s Receiving objects: 36% (270/749), 708.01 KiB | 646.00 KiB/s Receiving objects: 37% (278/749), 708.01 KiB | 646.00 KiB/s Receiving objects: 38% (285/749), 708.01 KiB | 646.00 KiB/s Receiving objects: 39% (293/749), 708.01 KiB | 646.00 KiB/s Receiving objects: 40% (300/749), 708.01 KiB | 646.00 KiB/s Receiving objects: 41% (308/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 42% (315/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 43% (323/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 44% (330/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 45% (338/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 46% (345/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 47% (353/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 48% (360/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 49% (368/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 50% (375/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 51% (382/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 52% (390/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 53% (397/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 54% (405/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 55% (412/749), 1.46 MiB | 933.00 KiB/s Receiving objects: 55% (415/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 56% (420/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 57% (427/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 58% (435/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 59% (442/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 60% (450/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 61% (457/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 62% (465/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 63% (472/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 64% (480/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 65% (487/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 66% (495/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 67% (502/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 68% (510/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 69% (517/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 70% (525/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 71% (532/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 72% (540/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 73% (547/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 74% (555/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 75% (562/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 76% (570/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 77% (577/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 78% (585/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 79% (592/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 80% (600/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 81% (607/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 82% (615/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 83% (622/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 84% (630/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 85% (637/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 86% (645/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 87% (652/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 88% (660/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 89% (667/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 90% (675/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 91% (682/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 92% (690/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 93% (697/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 94% (705/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 95% (712/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 96% (720/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 97% (727/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 98% (735/749), 2.14 MiB | 1.02 MiB/s Receiving objects: 99% (742/749), 2.14 MiB | 1.02 MiB/s remote: Total 749 (delta 1), reused 0 (delta 0), pack-reused 741 Receiving objects: 100% (749/749), 2.85 MiB | 1.09 MiB/s Receiving objects: 100% (749/749), 2.88 MiB | 1.09 MiB/s, done. Resolving deltas: 0% (0/332) Resolving deltas: 1% (4/332) Resolving deltas: 3% (11/332) Resolving deltas: 14% (47/332) Resolving deltas: 15% (52/332) Resolving deltas: 16% (54/332) Resolving deltas: 17% (57/332) Resolving deltas: 18% (61/332) Resolving deltas: 19% (65/332) Resolving deltas: 21% (71/332) Resolving deltas: 22% (74/332) Resolving deltas: 37% (125/332) Resolving deltas: 39% (130/332) Resolving deltas: 41% (138/332) Resolving deltas: 42% (140/332) Resolving deltas: 43% (144/332) Resolving deltas: 57% (192/332) Resolving deltas: 59% (197/332) Resolving deltas: 62% (207/332) Resolving deltas: 63% (211/332) Resolving deltas: 69% (230/332) Resolving deltas: 81% (272/332) Resolving deltas: 82% (273/332) Resolving deltas: 93% (312/332) Resolving deltas: 95% (317/332) Resolving deltas: 98% (326/332) Resolving deltas: 99% (329/332) Resolving deltas: 100% (332/332) Resolving deltas: 100% (332/332), done. /bin/mv: cannot move ‘zeppelin-notebooks/r’ to ‘./r’: Directory not empty /bin/mv: cannot move ‘zeppelin-notebooks/screenshots’ to ‘./screenshots’: Directory not empty Restarting Apache Zeppelin... Done! make sure HDFS is up HTTP/1.1 400 Bad Request Connection: close Server: Jetty(6.1.26.hwx) rmr: DEPRECATED: Please use 'rm -r' instead. 18/06/30 01:22:28 INFO fs.TrashPolicyDefault: Moved: 'hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/notebook/old_20180630-005951' to trash at: hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/.Trash/Current/user/zeppelin/notebook/old_20180630-005951 18/06/30 01:22:28 INFO fs.TrashPolicyDefault: Moved: 'hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/notebook/r' to trash at: hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/.Trash/Current/user/zeppelin/notebook/r1530321748877 18/06/30 01:22:28 INFO fs.TrashPolicyDefault: Moved: 'hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/notebook/screenshots' to trash at: hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/.Trash/Current/user/zeppelin/notebook/screenshots1530321748888 18/06/30 01:22:28 INFO fs.TrashPolicyDefault: Moved: 'hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/notebook/update_all_notebooks.sh' to trash at: hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/.Trash/Current/user/zeppelin/notebook/update_all_notebooks.sh1530321748900 18/06/30 01:22:28 INFO fs.TrashPolicyDefault: Moved: 'hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/notebook/zeppelin-notebooks' to trash at: hdfs://sandbox-hdp.hortonworks.com:8020/user/zeppelin/.Trash/Current/user/zeppelin/notebook/zeppelin-notebooks1530321748912 disable anonymous login and create Hortonia users 2018-06-30 01:22:57,925 INFO ### Performing "set": 2018-06-30 01:22:57,925 INFO ### from file /tmp/zeppelin-env.json 2018-06-30 01:22:57,925 INFO ### PUTting file: "/tmp/zeppelin-env.json" 2018-06-30 01:22:57,925 INFO ### PUTting json into: doSet_version1530321777925930.json 2018-06-30 01:22:57,976 INFO ### NEW Site:zeppelin-shiro-ini, Tag:version1530321777925930 make sure YARN up HTTP/1.1 400 Bad Request Connection: close Server: Jetty(6.1.26.hwx) kill any previous Hive/tez apps to clear queue 18/06/30 01:23:04 INFO client.RMProxy: Connecting to ResourceManager at sandbox-hdp.hortonworks.com/172.18.0.2:8032 18/06/30 01:23:05 INFO client.AHSProxy: Connecting to Application History server at sandbox-hdp.hortonworks.com/172.18.0.2:10200 make sure Ranger up HTTP/1.1 400 Bad Request Server: Apache-Coyote/1.1 Transfer-Encoding: chunked Date: Sat, 30 Jun 2018 01:23:05 GMT Connection: close 0 update ranger to support deny policies sh: line 189: jq: command not found sh: line 206: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (23) Failed writing body (0 != 8136) % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 HTTP/1.1 404 Not Found Server: Apache-Coyote/1.1 Set-Cookie: RANGERADMINSESSIONID=CCAC764BFE5634F3DED60072E6386181; Path=/; HttpOnly X-Frame-Options: DENY X-Content-Type-Options: nosniff X-XSS-Protection: 1; mode=block Strict-Transport-Security: max-age=31536000 Content-Length: 0 Date: Sat, 30 Jun 2018 01:23:05 GMT % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 280 0 174 100 106 588 358 --:--:-- --:--:-- --:--:-- 589 {"statusCode":1,"msgDesc":"(0) Validation failure: error code[1007], reason[Duplicate service name: name=[tags]], field[name], subfield[null], type[semantically incorrect] "}Associating tags service with Ranger hive repo... sh: line 230: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (23) Failed writing body (0 != 4720) sh: line 231: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 Associating tags service with Ranger hbase repo... sh: line 230: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (23) Failed writing body (0 != 4720) sh: line 231: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 Associating tags service with Ranger kafka repo... sh: line 230: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 curl: (23) Failed writing body (0 != 4720) sh: line 231: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 importing ranger Tag policies.. sh: line 238: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 281 0 58 100 223 264 1016 --:--:-- --:--:-- --:--:-- 1013 100 281 0 58 100 223 264 1015 --:--:-- --:--:-- --:--:-- 1013 {"statusCode":1,"msgDesc":"Provided json file is empty!!"}import ranger Hive policies... sh: line 247: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 276 0 58 100 218 366 1378 --:--:-- --:--:-- --:--:-- 1379 {"statusCode":1,"msgDesc":"Provided json file is empty!!"}import ranger HDFS policies... sh: line 255: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 281 0 58 100 223 329 1267 --:--:-- --:--:-- --:--:-- 1274 {"statusCode":1,"msgDesc":"Provided json file is empty!!"}import ranger kafka policies... sh: line 263: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 282 0 58 100 224 296 1145 --:--:-- --:--:-- --:--:-- 1148 {"statusCode":1,"msgDesc":"Provided json file is empty!!"}import ranger hbase policies... sh: line 271: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 282 0 58 100 224 358 1384 --:--:-- --:--:-- --:--:-- 1391 {"statusCode":1,"msgDesc":"Provided json file is empty!!"} % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 7476 0 0 100 7476 0 499k --:--:-- --:--:-- --:--:-- 521k curl: (22) The requested URL returned error: 409 Conflict failed with error code: 22 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 13291 0 0 100 13291 0 28430 --:--:-- --:--:-- --:--:-- 28399 curl: (22) The requested URL returned error: 400 Bad Request failed with error code: 22 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 14767 0 0 100 14767 0 18695 --:--:-- --:--:-- --:--:-- 18692 curl: (22) The requested URL returned error: 400 Bad Request failed with error code: 22 mkdir: `/user/admin': File exists mkdir: `/user/joe_analyst': File exists mkdir: `/user/kate_hr': File exists mkdir: `/user/sasha_eu_hr': File exists mkdir: `/user/ivanna_eu_hr': File exists mkdir: `/user/etl_user': File exists mkdir: `/user/john_finance': File exists mkdir: `/user/mark_bizdev': File exists mkdir: `/user/jermy_contractor': File exists mkdir: `/user/diane_csr': File exists mkdir: `/user/log_monitor': File exists Copying data to /hive_data dir in HDFS... put: `/hive_data/claim/claims_provider_summary_data.csv': File exists put: `/hive_data/cost_savings/claim-savings.csv': File exists put: `/hive_data/finance/tax_2009/tax_2009.csv': File exists put: `/hive_data/finance/tax_2010/tax_2010.csv': File exists put: `/hive_data/finance/tax_2015/tax_2015.csv': File exists put: `/hive_data/hortoniabank/eu_countries/eu_countries.csv': File exists put: `/hive_data/hortoniabank/us_customers/us_customers_data.csv': File exists put: `/hive_data/hortoniabank/ww_customers/ww_customers_data.csv': File exists put: `/hive_data/consent/consent_master_data_cleaned.csv': File exists put: `/hive_data/eu_countries/eu_countries.csv': File exists Enabling kerberos... fatal: destination path 'useful-scripts' already exists and is not an empty directory. CLUSTER_NAME= AMBARI_ADMIN_USER=admin AMBARI_ADMIN_PASSWORD=hdpsandbox AMBARI_HOST=sandbox-hdp.hortonworks.com KDC_HOST=sandbox-hdp.hortonworks.com REALM=HWX.COM KERBEROS_CLIENTS=sandbox-hdp.hortonworks.com 2018-06-30,01:25:37 Installing kerberos RPMs Loaded plugins: fastestmirror, ovl Loading mirror speeds from cached hostfile * base: mirror.us.leaseweb.net * epel: mirror.globo.com * extras: mirror.us.leaseweb.net * ius: archive.linux.duke.edu * updates: mirror.us.leaseweb.net Package krb5-server-1.15.1-19.el7.x86_64 already installed and latest version Package krb5-libs-1.15.1-19.el7.x86_64 already installed and latest version Package krb5-workstation-1.15.1-19.el7.x86_64 already installed and latest version Nothing to do 2018-06-30,01:25:45 Configuring Kerberos kdb5_util: Cannot open DB2 database '/var/kerberos/krb5kdc/principal': File exists while creating database '/var/kerberos/krb5kdc/principal' Loading random data Initializing database '/var/kerberos/krb5kdc/principal' for realm 'HWX.COM', master key name 'K/M@HWX.COM' 2018-06-30,01:25:45 Starting KDC services Redirecting to /bin/systemctl start krb5kdc.service Redirecting to /bin/systemctl start kadmin.service Note: Forwarding request to 'systemctl enable krb5kdc.service'. Note: Forwarding request to 'systemctl enable kadmin.service'. 2018-06-30,01:25:45 Creating admin principal WARNING: no policy specified for admin/admin@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "admin/admin@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. 2018-06-30,01:25:45 Restarting kadmin Redirecting to /bin/systemctl restart kadmin.service 2018-06-30,01:25:45 Adding KERBEROS Service to cluster % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 HTTP/1.1 404 Not Found X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=6ns0g5uhe5zj1kuvq8docnuoo;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Length: 0 2018-06-30,01:25:45 Adding KERBEROS_CLIENT component to the KERBEROS service % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 HTTP/1.1 404 Not Found X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=itofiex2y1owfzyoa27zhszk;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Length: 0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 1951 0 0 100 1951 0 229k --:--:-- --:--:-- --:--:-- 272k HTTP/1.1 100 Continue HTTP/1.1 405 Method Not Allowed X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=lgy7ofu4vdah1vw6hptrbgzdn;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Allow: HEAD,GET,OPTIONS Content-Length: 0 2018-06-30,01:25:47 Creating the KERBEROS_CLIENT host components for each host % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 76 0 0 100 76 0 6241 --:--:-- --:--:-- --:--:-- 6909 HTTP/1.1 404 Not Found X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1u0fmsumw2bul17ul50rag8vyt;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Length: 0 2018-06-30,01:25:48 Installing the KERBEROS service and components % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 40 0 0 100 40 0 3606 --:--:-- --:--:-- --:--:-- 4000 HTTP/1.1 404 Not Found X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=hs9sjexk3sv1165oz70d73v0g;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Length: 0 2018-06-30,01:25:48 Sleeping for 1 minute 2018-06-30,01:26:48 Stopping all the services % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 40 0 0 100 40 0 4212 --:--:-- --:--:-- --:--:-- 4444 HTTP/1.1 404 Not Found X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=lqnav06ik1qd1tmljfazfyv7r;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Length: 0 2018-06-30,01:26:48 Sleeping for 3 minutes 2018-06-30,01:29:48 Enabling Kerberos % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 172 0 0 100 172 0 23031 --:--:-- --:--:-- --:--:-- 24571 HTTP/1.1 405 Method Not Allowed X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=cb1akmbb9hpe1uf1cg9cvdrbq;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Allow: HEAD,GET,OPTIONS Content-Length: 0 2018-06-30,01:29:48 Starting all services after 2 minutes..Please be patient :) % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 38 0 0 100 38 0 3830 --:--:-- --:--:-- --:--:-- 4222 HTTP/1.1 404 Not Found X-Frame-Options: DENY X-XSS-Protection: 1; mode=block X-Content-Type-Options: nosniff Cache-Control: no-store Pragma: no-cache Set-Cookie: AMBARISESSIONID=1vs39gkx0c18xdfcl2b1k8gx5;Path=/;HttpOnly Expires: Thu, 01 Jan 1970 00:00:00 GMT User: admin Content-Length: 0 2018-06-30,01:31:48 Please check Ambari UI Thank You! :) Creating users in KDC... WARNING: no policy specified for joe_analyst/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "joe_analyst/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. WARNING: no policy specified for kate_hr/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "kate_hr/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. WARNING: no policy specified for log_monitor/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "log_monitor/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. WARNING: no policy specified for diane_csr/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "diane_csr/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. WARNING: no policy specified for jermy_contractor/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "jermy_contractor/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. WARNING: no policy specified for mark_bizdev/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "mark_bizdev/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. WARNING: no policy specified for john_finance/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "john_finance/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. WARNING: no policy specified for ivanna_eu_hr/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "ivanna_eu_hr/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. WARNING: no policy specified for etl_user/sandbox-hdp.hortonworks.com@HWX.COM; defaulting to no policy add_principal: Principal or policy already exists while creating "etl_user/sandbox-hdp.hortonworks.com@HWX.COM". Authenticating as principal root/admin@HWX.COM with password. Creating user keytabs... Authenticating as principal root/admin@HWX.COM with password. Entry for principal joe_analyst/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:joe_analyst.keytab. Entry for principal joe_analyst/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:joe_analyst.keytab. Authenticating as principal root/admin@HWX.COM with password. Entry for principal log_monitor/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:log_monitor.keytab. Entry for principal log_monitor/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:log_monitor.keytab. Authenticating as principal root/admin@HWX.COM with password. Entry for principal diane_csr/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:diane_csr.keytab. Entry for principal diane_csr/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:diane_csr.keytab. Authenticating as principal root/admin@HWX.COM with password. Entry for principal jermy_contractor/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:jermy_contractor.keytab. Entry for principal jermy_contractor/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:jermy_contractor.keytab. Authenticating as principal root/admin@HWX.COM with password. Entry for principal mark_bizdev/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:mark_bizdev.keytab. Entry for principal mark_bizdev/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:mark_bizdev.keytab. Authenticating as principal root/admin@HWX.COM with password. Entry for principal john_finance/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:john_finance.keytab. Entry for principal john_finance/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:john_finance.keytab. Authenticating as principal root/admin@HWX.COM with password. Entry for principal ivanna_eu_hr/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:ivanna_eu_hr.keytab. Entry for principal ivanna_eu_hr/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:ivanna_eu_hr.keytab. Authenticating as principal root/admin@HWX.COM with password. Entry for principal kate_hr/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:kate_hr.keytab. Entry for principal kate_hr/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:kate_hr.keytab. Authenticating as principal root/admin@HWX.COM with password. Entry for principal etl_user/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:etl_user.keytab. Entry for principal etl_user/sandbox-hdp.hortonworks.com@HWX.COM with kvno 4, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:etl_user.keytab. mv: target ‘/etc/security/keytabs’ is not a directory make sure hive is up Invalid status 101HTTP/1.1 400 Bad Request Content-Length: 0 Connection: close Server: Jetty(7.6.0.v20120127) Using default cache: persistent:0:0 Using principal: rm/sandbox-hdp.hortonworks.com@HWX.COM Using keytab: /etc/security/keytabs/rm.service.keytab kinit: Client 'rm/sandbox-hdp.hortonworks.com@HWX.COM' not found in Kerberos database while getting initial credentials 18/06/30 01:32:22 INFO client.RMProxy: Connecting to ResourceManager at sandbox-hdp.hortonworks.com/172.18.0.2:8032 18/06/30 01:32:22 INFO client.AHSProxy: Connecting to Application History server at sandbox-hdp.hortonworks.com/172.18.0.2:10200 18/06/30 01:32:23 INFO client.RMProxy: Connecting to ResourceManager at sandbox-hdp.hortonworks.com/172.18.0.2:8032 18/06/30 01:32:24 INFO client.AHSProxy: Connecting to Application History server at sandbox-hdp.hortonworks.com/172.18.0.2:10200 Killing application application_1530316373195_0008 18/06/30 01:32:24 INFO impl.YarnClientImpl: Killed application application_1530316373195_0008 18/06/30 01:32:25 INFO client.RMProxy: Connecting to ResourceManager at sandbox-hdp.hortonworks.com/172.18.0.2:8032 18/06/30 01:32:26 INFO client.AHSProxy: Connecting to Application History server at sandbox-hdp.hortonworks.com/172.18.0.2:10200 Killing application application_1530316373195_0007 18/06/30 01:32:26 INFO impl.YarnClientImpl: Killed application application_1530316373195_0007 Using default cache: persistent:0:0 Using principal: hive/sandbox-hdp.hortonworks.com@HWX.COM Using keytab: /etc/security/keytabs/hive.service.keytab kinit: Client 'hive/sandbox-hdp.hortonworks.com@HWX.COM' not found in Kerberos database while getting initial credentials Connecting to jdbc:hive2://localhost:10000/default;principal=hive/sandbox-hdp.hortonworks.com@HWX.COM 18/06/30 01:32:32 [main]: ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:244) at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:206) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) at org.apache.hive.beeline.Commands.connect(Commands.java:1204) at org.apache.hive.beeline.Commands.connect(Commands.java:1100) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:54) at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:998) at org.apache.hive.beeline.BeeLine.initArgs(BeeLine.java:717) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:779) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:493) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:476) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179) at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192) ... 34 more 18/06/30 01:32:32 [main]: WARN jdbc.HiveConnection: Failed to connect to localhost:10000 Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/default;principal=hive/sandbox-hdp.hortonworks.com@HWX.COM: GSS initiate failed (state=08S01,code=0) 0: jdbc:hive2://localhost:10000/default (closed)> CREATE DATABASE IF NOT EXISTS hortoniabank LOCATION '/hive_data/hortoniabank'; 18/06/30 01:32:32 [main]: ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:244) at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:206) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) at org.apache.hive.beeline.BeeLine.assertConnection(BeeLine.java:1198) at org.apache.hive.beeline.Commands.execute(Commands.java:810) at org.apache.hive.beeline.Commands.sql(Commands.java:729) at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1000) at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:835) at org.apache.hive.beeline.BeeLine.executeFile(BeeLine.java:816) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:785) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:493) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:476) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179) at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192) ... 31 more 18/06/30 01:32:32 [main]: WARN jdbc.HiveConnection: Failed to connect to localhost:10000 No current connection 18/06/30 01:32:32 [main]: ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:244) at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:206) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) at org.apache.hive.beeline.Commands.close(Commands.java:1016) at org.apache.hive.beeline.Commands.closeall(Commands.java:998) at org.apache.hive.beeline.BeeLine.close(BeeLine.java:848) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:795) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:493) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:476) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179) at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192) ... 28 more 18/06/30 01:32:32 [main]: WARN jdbc.HiveConnection: Failed to connect to localhost:10000 Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/default;principal=hive/sandbox-hdp.hortonworks.com@HWX.COM: GSS initiate failed (state=08S01,code=0) Connecting to jdbc:hive2://localhost:10000/default;principal=hive/sandbox-hdp.hortonworks.com@HWX.COM 18/06/30 01:32:36 [main]: ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:244) at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:206) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) at org.apache.hive.beeline.Commands.connect(Commands.java:1204) at org.apache.hive.beeline.Commands.connect(Commands.java:1100) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:54) at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:998) at org.apache.hive.beeline.BeeLine.initArgs(BeeLine.java:717) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:779) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:493) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:476) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179) at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192) ... 34 more 18/06/30 01:32:36 [main]: WARN jdbc.HiveConnection: Failed to connect to localhost:10000 Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/default;principal=hive/sandbox-hdp.hortonworks.com@HWX.COM: GSS initiate failed (state=08S01,code=0) 0: jdbc:hive2://localhost:10000/default (closed)> 0: jdbc:hive2://localhost:10000/default (closed)> CREATE TABLE IF NOT EXISTS consent_master.consent_data_trans( 0: jdbc:hive2://localhost:10000/default (closed)> Country STRING 0: jdbc:hive2://localhost:10000/default (closed)> , CountryFull STRING 0: jdbc:hive2://localhost:10000/default (closed)> , InsuranceID INT 0: jdbc:hive2://localhost:10000/default (closed)> , MarketingConsent STRING 0: jdbc:hive2://localhost:10000/default (closed)> , MarketingConsentStartDate DATE 0: jdbc:hive2://localhost:10000/default (closed)> , LoyaltyConsent STRING 0: jdbc:hive2://localhost:10000/default (closed)> , LoyaltyConsentStartDate DATE 0: jdbc:hive2://localhost:10000/default (closed)> , ThirdPartyConsent STRING 0: jdbc:hive2://localhost:10000/default (closed)> , ThirdPartyConsentStartDate DATE 0: jdbc:hive2://localhost:10000/default (closed)> ) 0: jdbc:hive2://localhost:10000/default (closed)> CLUSTERED BY(Country) INTO 3 BUCKETS 0: jdbc:hive2://localhost:10000/default (closed)> STORED AS ORC 0: jdbc:hive2://localhost:10000/default (closed)> LOCATION '/hive_data/consent-trans' 0: jdbc:hive2://localhost:10000/default (closed)> TBLPROPERTIES ('transactional'='true'); 18/06/30 01:32:36 [main]: ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:244) at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:206) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) at org.apache.hive.beeline.BeeLine.assertConnection(BeeLine.java:1198) at org.apache.hive.beeline.Commands.execute(Commands.java:810) at org.apache.hive.beeline.Commands.sql(Commands.java:729) at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1000) at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:835) at org.apache.hive.beeline.BeeLine.executeFile(BeeLine.java:816) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:785) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:493) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:476) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179) at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192) ... 31 more 18/06/30 01:32:36 [main]: WARN jdbc.HiveConnection: Failed to connect to localhost:10000 No current connection 18/06/30 01:32:36 [main]: ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.thrift.transport.TSaslClientTransport.handleSaslStartMessage(TSaslClientTransport.java:94) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:52) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport$1.run(TUGIAssumingTransport.java:49) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869) at org.apache.hadoop.hive.thrift.client.TUGIAssumingTransport.open(TUGIAssumingTransport.java:49) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:244) at org.apache.hive.jdbc.HiveConnection.(HiveConnection.java:206) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:208) at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:146) at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:211) at org.apache.hive.beeline.Commands.close(Commands.java:1016) at org.apache.hive.beeline.Commands.closeall(Commands.java:998) at org.apache.hive.beeline.BeeLine.close(BeeLine.java:848) at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:795) at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:493) at org.apache.hive.beeline.BeeLine.main(BeeLine.java:476) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:233) at org.apache.hadoop.util.RunJar.main(RunJar.java:148) Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179) at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192) ... 28 more 18/06/30 01:32:36 [main]: WARN jdbc.HiveConnection: Failed to connect to localhost:10000 Error: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/default;principal=hive/sandbox-hdp.hortonworks.com@HWX.COM: GSS initiate failed (state=08S01,code=0) Using default cache: persistent:0:0 Using principal: rm/sandbox-hdp.hortonworks.com@HWX.COM Using keytab: /etc/security/keytabs/rm.service.keytab kinit: Client 'rm/sandbox-hdp.hortonworks.com@HWX.COM' not found in Kerberos database while getting initial credentials 18/06/30 01:32:37 INFO client.RMProxy: Connecting to ResourceManager at sandbox-hdp.hortonworks.com/172.18.0.2:8032 18/06/30 01:32:38 INFO client.AHSProxy: Connecting to Application History server at sandbox-hdp.hortonworks.com/172.18.0.2:10200 kafka_broker detected as sandbox-hdp.hortonworks.com enable_kerberos detected as true kdc_realm detected as HWX.COM kinit: Client 'hbase/sandbox-hdp.hortonworks.com@HWX.COM' not found in Kerberos database while getting initial credentials Creating Hbase tables... ERROR: Table already exists: T_PRIVATE! Here is some help for this command: Creates a table. Pass a table name, and a set of column family specifications (at least one), and, optionally, table configuration. Column specification can be a simple string (name), or a dictionary (dictionaries are described below in main help output), necessarily including NAME attribute. Examples: Create a table with namespace=ns1 and table qualifier=t1 hbase> create 'ns1:t1', {NAME => 'f1', VERSIONS => 5} Create a table with namespace=default and table qualifier=t1 hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'} hbase> # The above in shorthand would be the following: hbase> create 't1', 'f1', 'f2', 'f3' hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000, BLOCKCACHE => true} hbase> create 't1', {NAME => 'f1', CONFIGURATION => {'hbase.hstore.blockingStoreFiles' => '10'}} Table configuration options can be put at the end. Examples: hbase> create 'ns1:t1', 'f1', SPLITS => ['10', '20', '30', '40'] hbase> create 't1', 'f1', SPLITS => ['10', '20', '30', '40'] hbase> create 't1', 'f1', SPLITS_FILE => 'splits.txt', OWNER => 'johndoe' hbase> create 't1', {NAME => 'f1', VERSIONS => 5}, METADATA => { 'mykey' => 'myvalue' } hbase> # Optionally pre-split the table into NUMREGIONS, using hbase> # SPLITALGO ("HexStringSplit", "UniformSplit" or classname) hbase> create 't1', 'f1', {NUMREGIONS => 15, SPLITALGO => 'HexStringSplit'} hbase> create 't1', 'f1', {NUMREGIONS => 15, SPLITALGO => 'HexStringSplit', REGION_REPLICATION => 2, CONFIGURATION => {'hbase.hregion.scan.loadColumnFamiliesOnDemand' => 'true'}} You can also keep around a reference to the created table: hbase> t1 = create 't1', 'f1' Which gives you a reference to the table named 't1', on which you can then call methods. ERROR: Table already exists: T_FOREX! Here is some help for this command: Creates a table. Pass a table name, and a set of column family specifications (at least one), and, optionally, table configuration. Column specification can be a simple string (name), or a dictionary (dictionaries are described below in main help output), necessarily including NAME attribute. Examples: Create a table with namespace=ns1 and table qualifier=t1 hbase> create 'ns1:t1', {NAME => 'f1', VERSIONS => 5} Create a table with namespace=default and table qualifier=t1 hbase> create 't1', {NAME => 'f1'}, {NAME => 'f2'}, {NAME => 'f3'} hbase> # The above in shorthand would be the following: hbase> create 't1', 'f1', 'f2', 'f3' hbase> create 't1', {NAME => 'f1', VERSIONS => 1, TTL => 2592000, BLOCKCACHE => true} hbase> create 't1', {NAME => 'f1', CONFIGURATION => {'hbase.hstore.blockingStoreFiles' => '10'}} Table configuration options can be put at the end. Examples: hbase> create 'ns1:t1', 'f1', SPLITS => ['10', '20', '30', '40'] hbase> create 't1', 'f1', SPLITS => ['10', '20', '30', '40'] hbase> create 't1', 'f1', SPLITS_FILE => 'splits.txt', OWNER => 'johndoe' hbase> create 't1', {NAME => 'f1', VERSIONS => 5}, METADATA => { 'mykey' => 'myvalue' } hbase> # Optionally pre-split the table into NUMREGIONS, using hbase> # SPLITALGO ("HexStringSplit", "UniformSplit" or classname) hbase> create 't1', 'f1', {NUMREGIONS => 15, SPLITALGO => 'HexStringSplit'} hbase> create 't1', 'f1', {NUMREGIONS => 15, SPLITALGO => 'HexStringSplit', REGION_REPLICATION => 2, CONFIGURATION => {'hbase.hregion.scan.loadColumnFamiliesOnDemand' => 'true'}} You can also keep around a reference to the created table: hbase> t1 = create 't1', 'f1' Which gives you a reference to the table named 't1', on which you can then call methods. TABLE ATLAS_ENTITY_AUDIT_EVENTS T_FOREX T_PRIVATE atlas_titan 4 row(s) in 0.0250 seconds Creating HDFS sensitive dir... kinit: Client 'nn/sandbox-hdp.hortonworks.com@HWX.COM' not found in Kerberos database while getting initial credentials mkdir: `/sensitive': File exists put: `/sensitive/private.csv': File exists Creating Kafka topics... kinit: Key table file '/etc/security/keytabs/log_monitor.keytab' not found while getting initial credentials Error while executing topic command : Topic 'FOREX' already exists. [2018-06-30 01:32:58,135] ERROR org.apache.kafka.common.errors.TopicExistsException: Topic 'FOREX' already exists. (kafka.admin.TopicCommand$) Error while executing topic command : Topic 'PRIVATE' already exists. [2018-06-30 01:33:00,080] ERROR org.apache.kafka.common.errors.TopicExistsException: Topic 'PRIVATE' already exists. (kafka.admin.TopicCommand$) ATLAS_ENTITIES ATLAS_HOOK FOREX PRIVATE __consumer_offsets Publishing test data to Kafka topics... org.apache.kafka.common.KafkaException: Failed to construct kafka producer at org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:433) at org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:291) at kafka.producer.NewShinyProducer.(BaseProducer.scala:40) at kafka.tools.ConsoleProducer$.main(ConsoleProducer.scala:50) at kafka.tools.ConsoleProducer.main(ConsoleProducer.scala) Caused by: java.lang.IllegalArgumentException: Could not find a 'KafkaClient' entry in the JAAS configuration. System property 'java.security.auth.login.config' is not set at org.apache.kafka.common.security.JaasContext.defaultContext(JaasContext.java:131) at org.apache.kafka.common.security.JaasContext.load(JaasContext.java:96) at org.apache.kafka.common.security.JaasContext.load(JaasContext.java:78) at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:104) at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:61) at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:86) at org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:390) ... 4 more org.apache.kafka.common.KafkaException: Failed to construct kafka producer at org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:433) at org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:291) at kafka.producer.NewShinyProducer.(BaseProducer.scala:40) at kafka.tools.ConsoleProducer$.main(ConsoleProducer.scala:50) at kafka.tools.ConsoleProducer.main(ConsoleProducer.scala) Caused by: java.lang.IllegalArgumentException: Could not find a 'KafkaClient' entry in the JAAS configuration. System property 'java.security.auth.login.config' is not set at org.apache.kafka.common.security.JaasContext.defaultContext(JaasContext.java:131) at org.apache.kafka.common.security.JaasContext.load(JaasContext.java:96) at org.apache.kafka.common.security.JaasContext.load(JaasContext.java:78) at org.apache.kafka.common.network.ChannelBuilders.create(ChannelBuilders.java:104) at org.apache.kafka.common.network.ChannelBuilders.clientChannelBuilder(ChannelBuilders.java:61) at org.apache.kafka.clients.ClientUtils.createChannelBuilder(ClientUtils.java:86) at org.apache.kafka.clients.producer.KafkaProducer.(KafkaProducer.java:390) ... 4 more Allowing Zeppelin to kinit as joe/ivanna/etluser.. chown: cannot access ‘/etc/security/keytabs/joe_analyst.keytab’: No such file or directory chmod: cannot access ‘/etc/security/keytabs/joe_analyst.keytab’: No such file or directory chown: cannot access ‘/etc/security/keytabs/ivanna_eu_hr.keytab’: No such file or directory chmod: cannot access ‘/etc/security/keytabs/ivanna_eu_hr.keytab’: No such file or directory chown: cannot access ‘/etc/security/keytabs/etl_user.keytab’: No such file or directory chmod: cannot access ‘/etc/security/keytabs/etl_user.keytab’: No such file or directory ./09-associate-entities-with-tags.sh: line 11: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 152 0 152 0 0 7253 0 --:--:-- --:--:-- --:--:-- 7600 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2383 100 2265 100 118 125k 6701 --:--:-- --:--:-- --:--:-- 130k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 20: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 154 0 154 0 0 11743 0 --:--:-- --:--:-- --:--:-- 12833 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2383 100 2265 100 118 319k 17061 --:--:-- --:--:-- --:--:-- 368k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 30: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 154 0 154 0 0 10861 0 --:--:-- --:--:-- --:--:-- 11000 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2383 100 2265 100 118 283k 15099 --:--:-- --:--:-- --:--:-- 315k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 39: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 160 0 160 0 0 10943 0 --:--:-- --:--:-- --:--:-- 11428 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2383 100 2265 100 118 294k 15714 --:--:-- --:--:-- --:--:-- 315k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 53: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 153 0 153 0 0 11498 0 --:--:-- --:--:-- --:--:-- 11769 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2397 100 2265 100 132 759k 45298 --:--:-- --:--:-- --:--:-- 1105k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 65: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 163 0 163 0 0 10386 0 --:--:-- --:--:-- --:--:-- 10866 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2396 100 2265 100 131 586k 34720 --:--:-- --:--:-- --:--:-- 737k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 74: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 148 0 148 0 0 10792 0 --:--:-- --:--:-- --:--:-- 11384 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2398 100 2265 100 133 334k 20084 --:--:-- --:--:-- --:--:-- 368k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 83: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 152 0 152 0 0 14297 0 --:--:-- --:--:-- --:--:-- 15200 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2421 100 2265 100 156 305k 21576 --:--:-- --:--:-- --:--:-- 315k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 92: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 162 0 162 0 0 13240 0 --:--:-- --:--:-- --:--:-- 13500 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2386 100 2265 100 121 294k 16105 --:--:-- --:--:-- --:--:-- 315k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 101: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 157 0 157 0 0 12953 0 --:--:-- --:--:-- --:--:-- 13083 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2386 100 2265 100 121 324k 17775 --:--:-- --:--:-- --:--:-- 368k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 110: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 164 0 164 0 0 10161 0 --:--:-- --:--:-- --:--:-- 10250 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2386 100 2265 100 121 284k 15536 --:--:-- --:--:-- --:--:-- 315k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 120: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 162 0 162 0 0 12726 0 --:--:-- --:--:-- --:--:-- 13500 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2391 100 2265 100 126 316k 18036 --:--:-- --:--:-- --:--:-- 368k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

./09-associate-entities-with-tags.sh: line 129: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 166 0 166 0 0 10662 0 --:--:-- --:--:-- --:--:-- 11066 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2388 100 2265 100 123 310k 17270 --:--:-- --:--:-- --:--:-- 315k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

% Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 516 0 230 100 286 2240 2786 --:--:-- --:--:-- --:--:-- 2803 {"mutatedEntities":{"UPDATE":[{"typeName":"kafka_topic","attributes":{"qualifiedName":"FOREX@hdp"},"guid":"66f8ff91-8777-48c0-8bf3-108b5ea8cacb","status":"ACTIVE"}]},"guidAssignments":{"-1":"66f8ff91-8777-48c0-8bf3-108b5ea8cacb"}} % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 524 0 232 100 292 1091 1373 --:--:-- --:--:-- --:--:-- 1370 100 524 0 232 100 292 1089 1371 --:--:-- --:--:-- --:--:-- 1370 {"mutatedEntities":{"UPDATE":[{"typeName":"kafka_topic","attributes":{"qualifiedName":"PRIVATE@hdp"},"guid":"b1ffbdfb-007c-4cea-996c-d710dc7a0222","status":"ACTIVE"}]},"guidAssignments":{"-1":"b1ffbdfb-007c-4cea-996c-d710dc7a0222"}}./09-associate-entities-with-tags.sh: line 176: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 375 0 375 0 0 15542 0 --:--:-- --:--:-- --:--:-- 15625 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2378 100 2265 100 113 742k 37919 --:--:-- --:--:-- --:--:-- 1105k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

% Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 552 0 232 100 320 2982 4113 --:--:-- --:--:-- --:--:-- 4155 {"mutatedEntities":{"UPDATE":[{"typeName":"hbase_table","attributes":{"qualifiedName":"T_FOREX@hdp"},"guid":"4f77e2c3-22c8-4483-853e-d37543bda8f4","status":"ACTIVE"}]},"guidAssignments":{"-1":"4f77e2c3-22c8-4483-853e-d37543bda8f4"}} % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 560 0 234 100 326 2848 3967 --:--:-- --:--:-- --:--:-- 4024 {"mutatedEntities":{"UPDATE":[{"typeName":"hbase_table","attributes":{"qualifiedName":"T_PRIVATE@hdp"},"guid":"1542f387-5672-46f5-8ae9-cf3da5f95521","status":"ACTIVE"}]},"guidAssignments":{"-1":"1542f387-5672-46f5-8ae9-cf3da5f95521"}}./09-associate-entities-with-tags.sh: line 224: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 400 0 400 0 0 16794 0 --:--:-- --:--:-- --:--:-- 17391 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2378 100 2265 100 113 303k 15528 --:--:-- --:--:-- --:--:-- 315k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

% Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 647 0 268 100 379 1793 2536 --:--:-- --:--:-- --:--:-- 2543 {"mutatedEntities":{"UPDATE":[{"typeName":"hdfs_path","attributes":{"qualifiedName":"hdfs://sandbox-hdp.hortonworks.com:8020/sensitive"},"guid":"72116568-daef-447d-8bb6-181acf26e033","status":"ACTIVE"}]},"guidAssignments":{"-1":"72116568-daef-447d-8bb6-181acf26e033"}}./09-associate-entities-with-tags.sh: line 253: jq: command not found % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 624 0 624 0 0 15513 0 --:--:-- --:--:-- --:--:-- 15600 (23) Failed writing body % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 2378 100 2265 100 113 305k 15590 --:--:-- --:--:-- --:--:-- 315k Atlas

Looking for something?

We're sorry. The web address you're looking for is not a functioning page in Apache Atlas. Please try navigating from Apache Atlas Home

Automated portion of setup is complete, next please create the tag repo in Ranger, associate with Hive and import tag policies See https://github.com/abajwa-hw/masterclass/blob/master/ranger-atlas/README.md for more details Once complete, see here for walk through of demo: https://community.hortonworks.com/articles/151939/hdp-securitygovernance-demo-kit.html