I like to use in my blueprint dynamic provisonied server names. For example define in blueprint under ranger-env master hostgroup server name "ranger_privelege_user_jdbc_url": "jdbc:postgresql://%HOSTGROUP::master%:5432/postgres" or oozie or hive server names in jdbc parameters tried few variants, didn't work I can use IP-s, due I know server will probably provisoned in specific IP always, but I'm wondering is it a way to use provisioned host names using cloudbreak 2.7.2 ... View more

Ambari 2.5.1 hadoop 2.5 running check from ambari it fails resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh server.domain.com ambari-qa 50111 idtest.ambari-qa.1499352141.17.pig /etc/security/keytabs/smokeuser.headless.keytab true /usr/bin/kinit ambari-qa-Cluster@DOMAIN.COM /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (ddl cmd): Failed. : {"error":"java.lang.reflect.UndeclaredThrowableException"}http_code <500> ... View more

Ambari 2.5.1 hadoop 2.5 running check from ambari it fails resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh server.domain.com ambari-qa 50111 idtest.ambari-qa.1499352141.17.pig /etc/security/keytabs/smokeuser.headless.keytab true /usr/bin/kinit ambari-qa-Cluster@DOMAIN.COM /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (ddl cmd): Failed. : {"error":"java.lang.reflect.UndeclaredThrowableException"}http_code <500> ... View more

We using flume ingestig data into HDFS. Flume sink is configured fileType=CompressedStream and codeC=snappy If on any reason flume agent dies or namenode (HA) restarts, flume current sink file will left open - .tmp extension. testfile.snappy.tmp for example. Is there any way to decompress such file and get data back human readable form? Or is there any tool to fix such files? We can use any other compression too, if there is a way to fix such files. ... View more

I made notebook with 2 paragraphs, 1 using shell interpreter, just lists files from hdfs, 2nd some hive query. Scheduled to run all paragrapghs every 5 minutes. Shell paragraph data changes, but hive query wont refresh, data doesn't refresh. Is this some zeppelin bug or what? Using HDP 2.5.0 - zeppelin 0.6.0 ... View more

After Hive service restart, all notebook hive queries failing. Hive queries using jdbc interpretator Error in notebooks java.sql.SQLException: org.apache.thrift.transport.TTransportException at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:255) ~[hive-jdbc-2.0.1.jar:2.0.1] at org.apache.zeppelin.jdbc.JDBCInterpreter.executeSql(JDBCInterpreter.java:356) [zeppelin-jdbc-0.6.0.2.5.0.0-1245.jar:0.6.0.2.5.0.0-1245] at org.apache.zeppelin.jdbc.JDBCInterpreter.interpret(JDBCInterpreter.java:442) [zeppelin-jdbc-0.6.0.2.5.0.0-1245.jar:0.6.0.2.5.0.0-1245] at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94) [zeppelin-interpreter-0.6.0.2.5.0.0-1245.jar:0.6.0.2.5.0.0-1245] at org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:341) [zeppelin-interpreter-0.6.0.2.5.0.0-1245.jar:0.6.0.2.5.0.0-1245] at org.apache.zeppelin.scheduler.Job.run(Job.java:176) [zeppelin-interpreter-0.6.0.2.5.0.0-1245.jar:0.6.0.2.5.0.0-1245] at org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162) [zeppelin-interpreter-0.6.0.2.5.0.0-1245.jar:0.6.0.2.5.0.0-1245] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_40] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_40] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_40] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_40] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_40] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_40] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_40] Caused by: org.apache.thrift.transport.TTransportException at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:132) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.readLength(TSaslTransport.java:376) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.readFrame(TSaslTransport.java:453) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslTransport.read(TSaslTransport.java:435) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TSaslClientTransport.read(TSaslClientTransport.java:37) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.hadoop.hive.thrift.TFilterTransport.readAll(TFilterTransport.java:62) ~[hive-shims-common-2.0.1.jar:2.0.1] at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:429) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:318) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:219) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:77) ~[libthrift-0.9.3.jar:0.9.3] at org.apache.hive.service.cli.thrift.TCLIService$Client.recv_ExecuteStatement(TCLIService.java:229) ~[hive-service-2.0.1.jar:2.0.1] at org.apache.hive.service.cli.thrift.TCLIService$Client.ExecuteStatement(TCLIService.java:216) ~[hive-service-2.0.1.jar:2.0.1] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_40] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_40] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_40] at java.lang.reflect.Method.invoke(Method.java:497) ~[?:1.8.0_40] at org.apache.hive.jdbc.HiveConnection$SynchronizedHandler.invoke(HiveConnection.java:1403) ~[hive-jdbc-2.0.1.jar:2.0.1] at com.sun.proxy.$Proxy8.ExecuteStatement(Unknown Source) ~[?:?] at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:246) ~[hive-jdbc-2.0.1.jar:2.0.1] ... 13 more This is know problem https://issues.apache.org/jira/browse/ZEPPELIN-1128 also and newer version from interpreter is already available, but not in hotronworks packages. ... View more

In usersync.log are errors. It happens when in AD user has been added/removed from groups what already existing in ranger user database. Also "response status of 400 Bad Request" will appear , when usename has been in ranger database. Even if it is deleted from ranger through API. 02 Sep 2016 15:12:57 INFO LdapUserGroupBuilder [UnixUserSyncThread] - LDAPUserGroupBuilder.updateSink() completed with user count: 8 02 Sep 2016 15:12:57 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: org/apache/commons/httpclient/URIException, for user: user1, groups: [users1, users2] 02 Sep 2016 15:12:57 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: org/apache/commons/httpclient/URIException, for user: user2, groups: [users1, users2] 02 Sep 2016 15:12:57 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: org/apache/commons/httpclient/URIException, for user: user3, groups: [users1, users2] 02 Sep 2016 15:12:57 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: org/apache/commons/httpclient/URIException, for user: user4, groups: [users1, users2] 02 Sep 2016 15:12:57 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: org/apache/commons/httpclient/URIException, for user: user5, groups: [users1, users2] 02 Sep 2016 15:12:57 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: org/apache/commons/httpclient/URIException, for user: user6, groups: [users1, users2] 02 Sep 2016 15:12:57 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: org/apache/commons/httpclient/URIException, for user: user7, groups: [users1, users2] 02 Sep 2016 15:12:57 ERROR LdapUserGroupBuilder [UnixUserSyncThread] - sink.addOrUpdateUser failed with exception: POST http://ranger.mydomain.com:6080/service/users/default returned a response status of 400 Bad Request, for user: user8, groups: [users1, users2] 02 Sep 2016 15:12:57 INFO UserGroupSync [UnixUserSyncThread] - End: initial load of user/group from source==>sink 02 Sep 2016 15:12:57 INFO UserGroupSync [UnixUserSyncThread] - Done initializing user/group source and sink Also adding xa_portal.log xa-portal.txt ... View more