Hi Team,   While running the code in zeppelin , im facing the below error.the query is too large.   Regards, vamshi. ... View more

Hi team, We enable http and binary mode for hive configuration .after that while connecting to the beeline some times getting failed throwing below error ,but some times beeline connecting successfully. any one can help us on this. 19/07/03 12:48:59 [main]: ERROR jdbc.HiveConnection: Error opening session org.apache.thrift.transport.TTransportException: org.apache.http.client.ClientPr otocolException Thanks in advance, ... View more

Hi team, iam using hdp 3.1 hdp version,In the atlas service tags we can able to create ,these tags are reflected in ranger too,but these tag based polices are not working, example when i take one column for creating tag, based on that tag i created one tag based police in ranger .these polices are not working( i can able to see the full the data in beeline after applying the policy), in ambari ranger tag sync is enabled,logs in ranger tag-sync also not generating Please can anybody resolve this? Thanks in advance ... View more

hi team , iam connecting nifi through mysql,using hdp 3.1 version.for mysql connectivity im getting below error. o.apache.nifi.processors.standard.GetFTP GetFTP[id=9188eebd-016a-1000-ffff-ffff8ba666c0] Unable to fetch listing from remote server due to java.net.ConnectException: Connection refused (Connection refused): java.net.ConnectException: Connection refused (Connection refused) java.net.ConnectException: Connection refused (Connection refused) Regards vamshi. ... View more

hi team, im uploading file in ambari file view, getting below error. Unexpected HTTP response: code=504 != 201, op=CREATE, message=Unknown Host java.io.IOException: Unexpected HTTP response: code=504 != 201, op=CREATE, message=Unknown Host     at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:499)     at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.access$200(WebHdfsFileSystem.java:135)     at org.apache.hadoop.hdfs.web.WebHdfsFileSystem$FsPathOutputStreamRunner$1.close(WebHdfsFileSystem.java:1020)     at org.apache.ambari.view.commons.hdfs.UploadService.uploadFile(UploadService.java:75)     at org.apache.ambari.view.commons.hdfs.UploadService.uploadFile(UploadService.java:98)     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)     at java.lang.reflect.Method.invoke(Method.java:498)     at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)     at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)     at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)     at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)     at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)     at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)     at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)     at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)     at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)     at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)     at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)     at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)     at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)     at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1542)     at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1473)     at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1419)     at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1409)     at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:409)     at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:558)     at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:733)     at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)     at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:317)     at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:127)     at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:91)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.apache.ambari.server.security.authorization.AmbariAuthorizationFilter.doFilter(AmbariAuthorizationFilter.java:291)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:114)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.session.SessionManagementFilter.doFilter(SessionManagementFilter.java:137)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:111)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:170)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.savedrequest.RequestCacheAwareFilter.doFilter(RequestCacheAwareFilter.java:63)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.apache.ambari.server.security.authentication.AmbariDelegatingAuthenticationFilter.doFilter(AmbariDelegatingAuthenticationFilter.java:135)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.apache.ambari.server.security.authorization.AmbariUserAuthorizationFilter.doFilter(AmbariUserAuthorizationFilter.java:95)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.authentication.logout.LogoutFilter.doFilter(LogoutFilter.java:116)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.header.HeaderWriterFilter.doFilterInternal(HeaderWriterFilter.java:66)     at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:105)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:56)     at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:331)     at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:214)     at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)     at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347)     at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)     at org.apache.ambari.server.api.MethodOverrideFilter.doFilter(MethodOverrideFilter.java:73)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)     at org.apache.ambari.server.api.AmbariPersistFilter.doFilter(AmbariPersistFilter.java:53)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)     at org.apache.ambari.server.view.AmbariViewsMDCLoggingFilter.doFilter(AmbariViewsMDCLoggingFilter.java:56)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)     at org.apache.ambari.server.view.ViewThrottleFilter.doFilter(ViewThrottleFilter.java:161)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)     at org.apache.ambari.server.security.AbstractSecurityHeaderFilter.doFilter(AbstractSecurityHeaderFilter.java:130)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)     at org.apache.ambari.server.security.AbstractSecurityHeaderFilter.doFilter(AbstractSecurityHeaderFilter.java:130)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)     at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:51)     at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642)     at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)     at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146)     at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)     at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)     at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)     at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)     at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)     at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1340)     at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)     at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)     at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)     at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)     at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1242)     at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144)     at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:690)     at org.apache.ambari.server.controller.AmbariHandlerList.processHandlers(AmbariHandlerList.java:221)     at org.apache.ambari.server.controller.AmbariHandlerList.processHandlers(AmbariHandlerList.java:210)     at org.apache.ambari.server.controller.AmbariHandlerList.handle(AmbariHandlerList.java:151)     at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)     at org.eclipse.jetty.server.Server.handle(Server.java:503)     at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364)     at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260)     at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305)     at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103)     at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118)     at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)     at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)     at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)     at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)     at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)     at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765)     at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683)     at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: Content-Type "text/html" is incompatible with "application/json" (parsed="text/html")     at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.jsonParse(WebHdfsFileSystem.java:472)     at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.validateResponse(WebHdfsFileSystem.java:495)     ... 113 more (less...) ... View more

hi team we are storing zeppelin notebooks in github repository, we are followed below documentation ,but after adding the GithubRepo ,notebook dir, properties when we commit the notebook in git, we are getting below error https://community.hortonworks.com/articles/149437/how-to-store-zeppelin-notes-in-github-repo.html @rguruvannagari ... View more

We tried adding external Jars or dependencies. we have gone through below material https://community.hortonworks.com/questions/41537/adding-libraries-to-zeppelin.html https://zeppelin.apache.org/docs/0.6.2/assets/themes/zeppelin/img/docs-img/interpreter-dependency-loading.png https://community.hortonworks.com/questions/41537/adding-libraries-to-zeppelin.html 1) We tried adding jar using Local File Path. we still get Driver not found (We have restarted the service) 2) We tried using maven artifact we find below error 1.png2.png Can anyone suggest? ... View more

Hi team, We are using livy2.pyspark interpreter,we are connecting mysql data from pyspark interpreter ,we are adding group Id ,artifictd in pyspark interpreter and tried also mysql jar local path also still we are getting Jdbc driver not found. Can you please help me on this issue? ... View more

Hi team, i am using hdp 3.0.1,configured superset service from ambari ,also added AD configuration for superset .created database connection,its working well.but the problem is when i added the allpath in ranger taking superset as user.when im able to login with ad user it showing all databases ,all tables.? My question is simple? How to restrict the users from superset? what are the roles we can give the user to particular database ,particular table access? i go through the superset doc ,they provided list of roles like alpta,gamma ,but here the problem is user can see the all database. Thanks in advance ... View more

hi team, we are trying to run list tables command in sqoop, source is oracle server , sqoop list-tables --driver oracle.jdbc.driver.OracleDriver --connect jdbc:oracle:thin:@xxxxxxxx:1521/cringadmin --username "cringadmin" -P ,but iam facing below error. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/hdp/3.0.1.0-187/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 19/03/15 13:14:17 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7.3.0.1.0-187 Enter password: 19/03/15 13:14:24 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time. 19/03/15 13:14:24 INFO manager.SqlManager: Using default fetchSize of 1000 19/03/15 13:14:25 ERROR manager.SqlManager: Error reading database metadata: java.sql.SQLException: Listener refused the connection with the following error: ORA-12514, TNS:listener does not currently know of service requested in connect descriptor java.sql.SQLException: Listener refused the connection with the following error: ORA-12514, TNS:listener does not currently know of service requested in connect descriptor at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:489) at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:553) at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:254) at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:32) at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:528) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:247) at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:904) at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:59) at org.apache.sqoop.manager.SqlManager.listTables(SqlManager.java:539) at org.apache.sqoop.tool.ListTablesTool.run(ListTablesTool.java:49) at org.apache.sqoop.Sqoop.run(Sqoop.java:150) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:186) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:240) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:249) at org.apache.sqoop.Sqoop.main(Sqoop.java:258) Caused by: oracle.net.ns.NetException: Listener refused the connection with the following error: ORA-12514, TNS:listener does not currently know of service requested in connect descriptor at oracle.net.ns.NSProtocol.connect(NSProtocol.java:399) at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1140) at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:340) ... 16 more Could not retrieve tables list from server 19/03/15 13:14:25 ERROR tool.ListTablesTool: manager.listTables() returned null i check the port and ip its connecting.... ... View more

In Kerberos HDP Cluster, I got problem creating topics in Kafka using the kafka-topics.sh script with AD user. I am using HDP 3.0.0. login with upglead1 AD user and run the below command to create a topic [upglead1@devhcdl1 ~]$ [upglead1@devhcdl1 ~]$ /usr/hdp/current/kafka-broker/bin/kafka-topics.sh --create --topic test044 --zookeeper ********:2181 --replication-factor 1 --partitions 1 [2019-03-09 15:05:33,367] WARN Could not login: the Client is being asked for a password, but the ZooKeeper Client code does not currently support obtaining a password from the user. Make sure that the Client is configured to use a ticket cache (using the JAAS configuration setting 'useTicketCache=true)' and restart the Client. If you still get this message after that, the TGT in the ticket cache has expired and must be manually refreshed. To do so, first determine if you are using a password or a keytab. If the former, run kinit in a Unix shell in the environment of the user who is running this Zookeeper Client using the command 'kinit <princ>' (where <princ> is the name of the Client's Kerberos principal). If the latter, do 'kinit -k -t <keytab> <princ>' (where <princ> is the name of the Kerberos principal, and <keytab> is the location of the keytab file). After manually refreshing your cache, restart this Client. If you continue to see this message after manually refreshing your cache, ensure that your KDC host's clock is in sync with this host's clock. (org.apache.zookeeper.SaslClientCallbackHandler) [2019-03-09 15:05:33,369] WARN SASL configuration failed: javax.security.auth.login.LoginException: No password provided Will continue connection to Zookeeper server without SASL authentication, if Zookeeper server allows it. (org.apache.zookeeper.ClientCnxn) [2019-03-09 15:05:33,372] ERROR [ZooKeeperClient] Auth failed. (kafka.zookeeper.ZooKeeperClient) Error while executing topic command : KeeperErrorCode = InvalidACL for /config/topics/test044 [2019-03-09 15:05:33,770] ERROR org.apache.zookeeper.KeeperException$InvalidACLException: KeeperErrorCode = InvalidACL for /config/topics/test044 at org.apache.zookeeper.KeeperException.create(KeeperException.java:121) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at kafka.zookeeper.AsyncResponse.maybeThrow(ZooKeeperClient.scala:494) at kafka.zk.KafkaZkClient.createRecursive(KafkaZkClient.scala:1416) at kafka.zk.KafkaZkClient.createOrSet$1(KafkaZkClient.scala:268) at kafka.zk.KafkaZkClient.setOrCreateEntityConfigs(KafkaZkClient.scala:278) at kafka.zk.AdminZkClient.createOrUpdateTopicPartitionAssignmentPathInZK(AdminZkClient.scala:98) at kafka.zk.AdminZkClient.createTopic(AdminZkClient.scala:56) at kafka.admin.TopicCommand$.createTopic(TopicCommand.scala:111) at kafka.admin.TopicCommand$.main(TopicCommand.scala:63) at kafka.admin.TopicCommand.main(TopicCommand.scala) (kafka.admin.TopicCommand$) ... View more

im using hdp 3.0.1 zeppelin version is 0.8 ,druid version is 0.12 can we install druid interpreter for zeppelin ? ... View more

ranger.png hi im trying to import the ranger service policy in one cluster to another cluster, the service i needed exported successful,but now im unable to import the policy in other cluster ,below error we are getting please can one solve this? @Felix Albani ... View more

Hi team , I just created the sample hive table like this create table emp(id int,name string,location string); inserted some values and added ranger row level polices its working fine, but in zoom_data dashboard we are getting hive related error Failed to prepare data read request. Error while compiling statement: FAILED: SemanticException org.apache.hadoop.hive.ql.parse.ParseException: line 1:27 missing EOF at '.' near 'ds' can any one check this Thanks in advance. ... View more

what are the prerequisites for installing sam ,how to configure please explain indetail? ... View more

Is sam supports hdp 3.1 version ? ... View more