Recently I moved from the Oracle JDK 8 to Open JDK 8 (version: openjdk-1.8.0.242.b08). Cloudera version is 5.16.2. I have Kerberos, TLS enabled. When I am using Oracle JDK the below issue doesn't occur but when I switch to Open JDK then I am getting the below error. Please note that the proxy user is already enabled From the CM -> HDFS -> configuration.         JobHistoryServer Error starting JobHistoryServer org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Error creating done directory: [hdfs://XXXX.YYY.COM:8020/user/history/done] at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.tryCreatingHistoryDirs(HistoryFileManager.java:680) at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.createHistoryDirs(HistoryFileManager.java:616) at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.serviceInit(HistoryFileManager.java:577) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.mapreduce.v2.hs.JobHistory.serviceInit(JobHistory.java:95) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107) at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.serviceInit(JobHistoryServer.java:154) at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163) at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.launchJobHistoryServer(JobHistoryServer.java:229) at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:239) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: RZgWaGioVf@YYY.COM is not allowed to impersonate mapred/XXXX.YYY.COM@YYY.COM at org.apache.hadoop.ipc.Client.call(Client.java:1504) at org.apache.hadoop.ipc.Client.call(Client.java:1441) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:231) at com.sun.proxy.$Proxy16.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:788) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:258) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:104) at com.sun.proxy.$Proxy17.getFileInfo(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2168) at org.apache.hadoop.fs.Hdfs.getFileStatus(Hdfs.java:133) at org.apache.hadoop.fs.FileContext$14.next(FileContext.java:1143) at org.apache.hadoop.fs.FileContext$14.next(FileContext.java:1139) at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90) at org.apache.hadoop.fs.FileContext.getFileStatus(FileContext.java:1139) at org.apache.hadoop.fs.FileContext$Util.exists(FileContext.java:1604) at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.mkdir(HistoryFileManager.java:733) at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.tryCreatingHistoryDirs(HistoryFileManager.java:663)       ... View more

Hello, I am trying to deploy my custom view in the Ambari. However, I cannot see my custom view after deploying. I am following the procedure given here: Ambari-View Example, mainly following the basic view: HelloWorld. After downloading the code, I followed the below procedure Obtain the View package. For example, helloworld-view-1.0-SNAPSHOT.jar . On the Ambari Server host, browse to the views directory. cd /var/lib/ambari-server/resources/views Copy the helloworld-view-1.0-SNAPSHOT.jar into this folder. Restart Ambari Server. ambari-server restart Check in the Ambari web UI -> View menu, Nothing is displayed. Log is also showing nothing suspicious. Log: 17 Aug 2017 09:53:18,467 INFO [pool-5-thread-1] ViewDirectoryWatcher:118 - Event ENTRY_CREATE: /var/lib/ambari-server/resources/views/helloworld-view-1.0-SNAPSHOT.jar 17 Aug 2017 09:53:18,467 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:18,668 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:18,868 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:19,068 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:19,268 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:19,469 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:19,671 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:19,872 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:20,072 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:20,273 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:20,477 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:20,678 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:20,879 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:21,079 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:21,281 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:21,482 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:21,683 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:21,884 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:22,085 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:22,286 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:22,486 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:22,687 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:22,888 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:23,089 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:23,290 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:23,491 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:23,691 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:23,894 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:24,095 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:24,297 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:24,498 INFO [pool-5-thread-1] ViewDirectoryWatcher:200 - Waiting for file to be completely copied 17 Aug 2017 09:53:24,698 INFO [pool-5-thread-1] ViewDirectoryWatcher:213 - File /var/lib/ambari-server/resources/views/helloworld-view-1.0-SNAPSHOT.jar has finished copying 17 Aug 2017 09:53:24,699 INFO [pool-5-thread-1] ViewDirectoryWatcher:128 - Starting view extraction 17 Aug 2017 09:53:24,716 INFO [pool-5-thread-1] ViewRegistry:1823 - Reading view archive /var/lib/ambari-server/resources/views/helloworld-view-1.0-SNAPSHOT.jar. 17 Aug 2017 09:53:24,718 INFO [pool-5-thread-1] ViewExtractor:86 - Creating archive folder /var/lib/ambari-server/resources/views/work/HELLO_WORLD{1.0.0}. 17 Aug 2017 09:53:24,719 INFO [pool-5-thread-1] ViewExtractor:93 - Extracting files from helloworld-view-1.0-SNAPSHOT.jar. 17 Aug 2017 09:53:24,749 INFO [pool-5-thread-1] ViewRegistry:1857 - View deployed: HELLO_WORLD{1.0.0}. 17 Aug 2017 09:53:24,749 INFO [pool-5-thread-1] ViewDirectoryWatcher:82 - Finished processing the view definition for/var/lib/ambari-server/resources/views/helloworld-view-1.0-SNAPSHOT.jar POM.xml <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/maven-v4_0_0.xsd"> <modelVersion>4.0.0</modelVersion> <artifactId>helloworld-view</artifactId> <groupId>com.test.ambariview</groupId> <packaging>jar</packaging> <name>Ambari Hello World View</name> <version>1.0-SNAPSHOT</version> <url>http://maven.apache.org</url> <properties> <ambari.version>1.7.0.0</ambari.version> </properties> <dependencies> <dependency> <groupId>junit</groupId> <artifactId>junit</artifactId> <version>4.8.1</version> <scope>test</scope> </dependency> <dependency> <groupId>org.easymock</groupId> <artifactId>easymock</artifactId> <version>3.1</version> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.ambari</groupId> <artifactId>ambari-views</artifactId> <version>${ambari.version}</version> </dependency> <dependency> <groupId>com.sun.jersey</groupId> <artifactId>jersey-server</artifactId> <version>1.8</version> </dependency> </dependencies> <build> <pluginManagement> <plugins> <plugin> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-surefire-plugin</artifactId> <version>2.12</version> </plugin> </plugins> </pluginManagement> <plugins> <plugin> <groupId>org.codehaus.mojo</groupId> <artifactId>rpm-maven-plugin</artifactId> <version>2.0.1</version> <executions> <execution> <phase>none</phase> <goals> <goal>rpm</goal> </goals> </execution> </executions> </plugin> </plugins> </build> </project> am I missing anything else ? Best Regards Sayed Anisul Hoque ... View more

Hello, I am following the documentation to add a custom service to the Ambari. So far, I am able to understand and create a custom service and was able to successfully add to the Ambari. Next, I need to add the dependencies which needs to be installed prior to the custom service. For example, before deploying custom service it will install the dependencies such as SPARK, KAFKA, YARN, HDFS. For this purpose I was looking into HIVE:metainfo.xml file and could understand the below portions needs to be added in order to add the dependencies <dependencies> <dependency> <name>ZOOKEEPER/ZOOKEEPER_SERVER</name> <scope>cluster</scope> <auto-deploy> <enabled>true</enabled> <co-locate>HIVE/HIVE_SERVER</co-locate> </auto-deploy> </dependency> <dependency> <name>YARN/YARN_CLIENT</name> <scope>host</scope> <auto-deploy> <enabled>true</enabled> </auto-deploy> </dependency> <dependency> <name>MAPREDUCE2/MAPREDUCE2_CLIENT</name> <scope>host</scope> <auto-deploy> <enabled>true</enabled> </auto-deploy> </dependency> </dependencies> <requiredServices> <service>ZOOKEEPER</service> <service>YARN</service> <service>TEZ</service> </requiredServices> However, there are some aspects I could not find and was not able to understand about the "dependency". So, I would like to know about: Is there some additional resources on how to add the "dependency" on the custom service ? I would like to know more about the specifics of the tags, so that I know the tags usage. For example <dependency> <name>ZOOKEEPER/ZOOKEEPER_SERVER</name> [How this naming are put ?] <scope>cluster</scope> [When to use which scope ?] <auto-deploy> <enabled>true</enabled> <co-locate>HIVE/HIVE_SERVER</co-locate> </auto-deploy> </dependency> Thank you ! ... View more

  Hello !   I have setup Solr in my cloudera quickstart vm. Also, I kerborized it and enabled sentry. I created some collections and able to do MapReduce task to index files into those collections. However, while I am trying to access later using solr admin ui, I am getting this below error. It seems, i need to add "cloudera" user to the admin group via sentry. Please help in this issue.   Error log as below:   2017-06-05 04:53:20,708 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={indexInfo=false&_=1496663600675&wt=json} status=401 QTime=30 2017-06-05 04:53:26,720 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=46 2017-06-05 04:54:26,658 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=46 2017-06-05 04:55:26,618 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=55 2017-06-05 04:56:26,602 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=52 2017-06-05 04:57:26,709 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=63 2017-06-05 04:58:27,358 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=70 2017-06-05 04:59:27,281 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=47 2017-06-05 05:00:27,259 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=46 2017-06-05 05:01:27,288 INFO org.apache.solr.servlet.SolrDispatchFilter: [admin] webapp=null path=/admin/cores params={action=STATUS&wt=json} status=0 QTime=57 2017-06-05 05:02:26,889 ERROR org.apache.solr.core.SolrCore: org.apache.solr.common.SolrException: org.apache.sentry.binding.solr.authz.SentrySolrAuthorizationException: User cloudera does not have privileges for admin at org.apache.solr.sentry.SentryIndexAuthorizationSingleton.authorizeCollectionAction(SentryIndexAuthorizationSingleton.java:185) at org.apache.solr.sentry.SentryIndexAuthorizationSingleton.authorizeCollectionAdminAction(SentryIndexAuthorizationSingleton.java:105) at org.apache.solr.handler.SecureRequestHandlerUtil.checkSentryAdminCollection(SecureRequestHandlerUtil.java:79) at org.apache.solr.handler.SecureRequestHandlerUtil.checkSentryAdminCollection(SecureRequestHandlerUtil.java:48) at org.apache.solr.handler.admin.SecureCoreAdminHandler.handleRequestBody(SecureCoreAdminHandler.java:136) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:871) at org.apache.solr.servlet.SolrDispatchFilter.httpSolrCall(SolrDispatchFilter.java:314) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:255) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.solr.servlet.SolrHadoopAuthenticationFilter$2.doFilter(SolrHadoopAuthenticationFilter.java:408) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:622) at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:301) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:574) at org.apache.solr.servlet.SolrHadoopAuthenticationFilter.doFilter(SolrHadoopAuthenticationFilter.java:413) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:861) at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:612) at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:503) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.sentry.binding.solr.authz.SentrySolrAuthorizationException: User cloudera does not have privileges for admin at org.apache.sentry.binding.solr.authz.SolrAuthzBinding.authorizeCollection(SolrAuthzBinding.java:182) at org.apache.solr.sentry.SentryIndexAuthorizationSingleton.authorizeCollectionAction(SentryIndexAuthorizationSingleton.java:180) ... 28 more Thanks ... View more