Can apache atlas be installed without having apache ranger installed on the cluster? ... View more

We are running a Mapreduce program which makes use of apache pheonix to get and process some data. The job fails with a kerberos error. The same program when run standalone runs fine. We are making use of keytab to authenticate and the keytab is used in the connection object to create to a phoenix connection. The MR job starts and launches containers,but the phoenix connection couldn't be established and the job fails with the error 2017-11-08 18:38:36,121 INFO [main-SendThread(172.16.3.197:2181)] org.apache.phoenix.shaded.org.apache.zookeeper.ClientCnxn: Opening socket connection to server 172.16.3.197/172.16.3.197:2181. Will not attempt to authenticate using SASL (unknown error) 2017-11-08 18:38:36,122 INFO [main-SendThread(172.16.3.197:2181)] org.apache.phoenix.shaded.org.apache.zookeeper.ClientCnxn: Socket connection established to 172.16.3.197/172.16.3.197:2181, initiating session 2017-11-08 18:38:36,138 INFO [main-SendThread(172.16.3.197:2181)] org.apache.phoenix.shaded.org.apache.zookeeper.ClientCnxn: Session establishment complete on server 172.16.3.197/172.16.3.197:2181, sessionid = 0x35e92d03f140314, negotiated timeout = 40000 2017-11-08 18:38:36,693 INFO [main] org.apache.phoenix.metrics.Metrics: Initializing metrics system: phoenix 2017-11-08 18:38:36,693 WARN [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: MapTask metrics system already initialized! 2017-11-08 18:38:38,948 WARN [hconnection-0xddf20fd-shared--pool1-t1] org.apache.hadoop.hbase.ipc.AbstractRpcClient: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] 2017-11-08 18:38:38,949 FATAL [hconnection-0xddf20fd-shared--pool1-t1] org.apache.hadoop.hbase.ipc.AbstractRpcClient: SASL authentication failed. The most likely cause is missing or invalid credentials. Consider 'kinit'. javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211) at org.apache.hadoop.hbase.security.HBaseSaslRpcClient.saslConnect(HBaseSaslRpcClient.java:179) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupSaslConnection(RpcClientImpl.java:612) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.access$600(RpcClientImpl.java:157) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection$2.run(RpcClientImpl.java:738) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection$2.run(RpcClientImpl.java:735) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.setupIOstreams(RpcClientImpl.java:735) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.writeRequest(RpcClientImpl.java:897) at org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.tracedWriteRequest(RpcClientImpl.java:866) at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1209) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:217) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:318) at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32831) at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:373) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:200) at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:350) at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:324) at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126) at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:64) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:122) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:224) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179) at com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:192) ... 26 more 2017-11-08 18:38:42,802 WARN [hconnection-0xddf20fd-shared--pool1-t1] org.apache.hadoop.hbase.ipc.AbstractRpcClient: Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] 2017-11-08 18:38:42,803 FATAL [hconnection-0xddf20fd-shared--pool1-t1] org.apache.hadoop.hbase.ipc.AbstractRpcClient: SASL authentication failed. The most likely cause is missing or invalid credentials. Consider 'kinit'. javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] ... View more

I am trying to use the backup utility of hbase to backup hbase tables to S3. But i am facing the following error despite giving the correct access key and secret key. hbase backup create full s3a://$ACCESS_KEY:$SECRET_KEY@hbase-bucket/tables -set systems Error is ERROR [main] util.AbstractHBaseTool: Error running command-line tool java.nio.file.AccessDeniedException: s3a://xxxxxxxxxxxxxxxxxxxxxxxxxxxxx+g@hbase-bucket/tables: getFileStatus on s3a://xxxxxxxxxxxxxxxxxxxxxxxxxxx+g@hbase-bucket/tables: com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service: Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID: 99EC757749F1D141), S3 Extended Request ID: gTGozzH9nuMdbfqfmMwrkPh17iuacp0CXQZ3jzcaYNnvdzxgExXQjzxZOrDG+RT0y/ArKI2QOfU But i am able to use the command without any error hadoop fs -ls s3a://hbase-bucket/ i have set fs.s3a.access.key and fs.s3a.secret.key in core-site.xml any thoughts, i have given full permissions to the bucket ... View more

I have co hosted both HDP and HDF using the same ambari. the cluster is kerberised too. After installing schema registry of HDF, i am not able to access the UI. I am prompted for a user name/password. I tried some kerberos principals and passwords, but none of them worked. i do see an error like this. IS there a way to avoid this or even skip kerberos for the registry UI. Ambari used is 2.5.2 HDf - 3.0 HTTP ERROR 403 Problem accessing /. Reason: GSSException: Defective token detected (Mechanism level: GSSHeader did not find the right tag) ... View more

hdf-hdp.pngI recently came to know that both HDP and HDF can be installed via the same ambari. But when i tried installing HDF , i am unable to do so. I added the management pack for HDF 3.0 and registered in ambari, but i am unable to install it. I have attached the screen shot of this.Can you please suggest what to do. The ambari version is 2.5.0.3 ... View more

I am getting this error when i try to create a basic shell action in the WFM view. this error occurs when i tried to save the work flow Error occurred while saving workflow org.apache.ambari.view.PersistenceException: Caught exception trying to find org.apache.oozie.ambari.view.workflowmanager.model.Workflow where workflowDefinitionPath='/user/arun/oozie/shellworkflow.xml' Hide Logjava.lang.RuntimeException: org.apache.ambari.view.PersistenceException: Caught exception trying to find org.apache.oozie.ambari.view.workflowmanager.model.Workflow where workflowDefinitionPath='/user/arun/oozie/shellworkflow.xml' at org.apache.oozie.ambari.view.workflowmanager.WorkflowsRepo.getWorkflowByPath(WorkflowsRepo.java:66) at org.apache.oozie.ambari.view.workflowmanager.WorkflowManagerService.saveWorkflow(WorkflowManagerService.java:56) at org.apache.oozie.ambari.view.OozieProxyImpersonator.saveWorkflow(OozieProxyImpersonator.java:249) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.acce ... View more

From here can i download the docker image for HDP 2.6 using wget on a linux terminal.? ... View more

We recently upgraded from ambari 2.2 to 2.5 and hdp from 2.4 to 2.6. We have hbase bucket cache enabled. But after the upgrade hbase master is continuously failing. the exception is shown below. But once we disabled the bucket cache, the hbase master process is coming up. How to fix this? java.lang.RuntimeException: Failed construction of Master: class org.apache.hadoop.hbase.master.HMaster at org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2756) at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:235) at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126) at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2770) Caused by: java.lang.OutOfMemoryError: Direct buffer memory at java.nio.Bits.reserveMemory(Bits.java:658) at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123) at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311) at org.apache.hadoop.hbase.util.ByteBufferArray.<init>(ByteBufferArray.java:65) at org.apache.hadoop.hbase.io.hfile.bucket.ByteBufferIOEngine.<init>(ByteBufferIOEngine.java:47) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getIOEngineFromName(BucketCache.java:311) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.<init>(BucketCache.java:221) at org.apache.hadoop.hbase.io.hfile.CacheConfig.getBucketCache(CacheConfig.java:614) at org.apache.hadoop.hbase.io.hfile.CacheConfig.getL2(CacheConfig.java:553) at org.apache.hadoop.hbase.io.hfile.CacheConfig.instantiateBlockCache(CacheConfig.java:637) at org.apache.hadoop.hbase.io.hfile.CacheConfig.<init>(CacheConfig.java:231) at org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:576) at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:425) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ... View more

Environment: HDP 2.6 We are using an application(map reduce) that reads from the hbase tables. our application read data from hbase and does some processing and closes the hbase connection(phoenix). But even after closing the connection to zookeeper is not getting closed, which causes the maximum number of client connections to be reached from a host( we have maxClientCnxns as 500 in zookeeper config). As a result when a new application comes and tries to create a connection to hbase it fails. We do see something(as shown below) like this in ZK dump, even after closing from the application and no other application is running. Do we need to check any other property for fixing this issue? Latency min/avg/max: 0/0/236 Received: 14452563 Sent: 14452685 Connections: 8868 Outstanding: 0 Zxid: 0x1f0000238a Mode: leader Node count: 21309 ... View more

I am using kafka console consumer script to read messages from a kafka topic. but it is showing the following behavior. If i use the zookeeper option, the consumer reads messages, whereas if i use bootstrap-server option i am not able to read messages. any thoughts. using HDP 2.6 bin/kafka-console-consumer.sh --bootstrap-server 172.16.3.196:6667 --topic test1 --from-beginning bin/kafka-console-consumer.sh --zookeeper 172.16.3.196:2181 --topic test1 --from-beginning Using the ConsoleConsumer with old consumer is deprecated and will be removed in a future major release. Consider using the new consumer by passing [bootstrap-server] instead of [zookeeper]. Hello How are you this is a test message Hope this helps ... View more

I have a table named Accounts as shown below in phoenix AccountId Name Branch Transactiondate 123 Rajesh abc 20170413 124 Sachin def 20170112 125 Rajesh mno 20170314 126 Bahubali mno 20170314 127 Sachin pqr 20170202 AccountId is the primary key An index is created as CREATE INDEX accountidx ON Accounts(Name,Transactiondate) INCLUDE (Branch) The following query hits the index and index is used select AccountId,Name,Transactiondate from Accounts where Name = 'Rajesh' AND Branch = 'abc' whereas the below query doesn't make use of the index select AccountId,Name,Transactiondate from Accounts where Name = 'Rajesh' OR Branch = 'abc' Why is it so, AND works whereas OR doesn't work. Any thoughts would be great ... View more

I am trying to run a spark2 job in oozie and using HDP 2.6.0 and it fails with the following reason java.lang.IllegalArgumentException: Attempt to add (hdfs://172.16.3.195/user/oozie/share/lib/lib_20170726131404/oozie/aws-java-sdk-core-1.10.6.jar) multiple times to the distributed cache. and from whatever search i have made, the current oozie version supported in HDP 2.6 doesnt support spark2 job. IS there a workaround to make it work? Any thoughts would be great ... View more

we are usign solr to store audit information for ranger. It seems the audit information is piling on solr. Is there a way to purge audit information after a particular period of time. we dont want to store the audit information forever. ... View more