question Re: Unable to open File View from Ambari UI in Archives of Support Questions (Read Only)

Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 13:57:10 GMT

I am unable to open File View from Ambari UI due to failure in hdfs service check. The error which i am getting is "fs.defaultFS" is not configured. The value of this property is already present in cores-site.xml but it is not work out.

is there anyplace else as well where i need to mention this property in addition to core-site.xml?

Thanks

Rahul

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 13:57:39 GMT

@Jay SenSharma

Re: Unable to open File View from Ambari UI

jsensharma — Mon, 19 Aug 2019 11:38:03 GMT

@rahul gulati

HDFS --> config (Tab) --> Advanced (sub Tab) Open the "Advanced core-site"

there you will find the value of "fs.defaultFS"

Also can you please share the value (instance property) of your FileView?

are you using webhdfs:// there?

Re: Unable to open File View from Ambari UI

kkhan — Thu, 16 Feb 2017 13:59:51 GMT

@rahul gulati Which version of Ambari? Is your cluster kerberized? Is Ambari SSL enabled? Is this on local Ambari Cluster? Can you share all setting from your FileView

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 14:04:36 GMT

@Jay SenSharma

I can see the value and the value is also correct. I tried connecting to hdfs using the same URI from Namenode and Edge Node and it is working. I am not sure why Ambari is not able to recognize that.

Thanks

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 14:05:23 GMT

@Kashif Khan

Ambari Versio is 2.4.2.0. Cluster is not kerberized. Ambari cluster is on 4 Azure VM's.

Thanks

Re: Unable to open File View from Ambari UI

jsensharma — Thu, 16 Feb 2017 14:08:43 GMT

@rahul gulati

Do you see a more detailed error/exception in any of the following file?

"/var/log/ambari-server/ambari-server.log" OR "/var/log/ambari-server/files-view/files-view.log "

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 14:15:45 GMT

@Jay SenSharma

Error logs from ambari-server.log are below

16 Feb 2017 06:13:39,297 ERROR [ambari-client-thread-6610] ContainerResponse:537 - Mapped exception to response: 500 (Internal Server Error) org.apache.ambari.view.commons.exceptions.ServiceFormattedException at org.apache.ambari.view.commons.hdfs.HdfsService.getApi(HdfsService.java:95) at org.apache.ambari.view.commons.hdfs.UserService.homeDir(UserService.java:56) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMetho dDispatchProvider.java:205) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.SubLocatorRule.accept(SubLocatorRule.java:137)

Re: Unable to open File View from Ambari UI

jsensharma — Thu, 16 Feb 2017 14:17:52 GMT

@rahul gulati

From ambari 2.4 onwards it ambari view is more enhanced and it should be able to populate most of the values on its own. Specially when the "Local Cluster" option is choosen while configuring a new View Instance.

- Are you using Local Cluster or Remote/Custom option?

- According to : https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-views/content/Cluster_Configuration_Local.html

The Local Ambari Managed Cluster Configuration option is enabled in the Ambari Administration Interface if you are managing a cluster with Ambari. When enabled, you can choose this option and Ambari will automatically configure the view based on how the cluster is configured.


When you configure the view using the Local option, the Files View will communicate with HDFS based on the fs.defaultFS property (for example: hdfs://namenode:8020). The View will also determine if NameNode HA is configured and adjust accordingly.

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 14:26:04 GMT

@Jay SenSharma

I understood that. I am managing cluster using Ambari and i deployed the same using Ambari as well.(4 Node). But is there a separate way to identify if it is a local or Remote?

Because as mentioned in link, in case of local cluster File View should be able to communicate with HDFS on its own.

Please suggest.

Thanks

Rahul

Re: Unable to open File View from Ambari UI

jsensharma — Mon, 19 Aug 2019 11:37:55 GMT

@rahul gulati

Local/Remote cluster configuration can be done at the View Level. As mentioned in :

https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.0.0/bk_ambari-administration/content/registering_remote_clusters.html

- Once a remote cluster is configured then you can create view instances to use that remote cluster like:

"manage ambari" --> View ---> File --> Create instance.

As in the above image you can see that i am using "ErieClusterRemote" a remote cluster for my file View. By default the default view instance uses "Local Cluster".

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 15:32:57 GMT

@Jay SenSharma

I have created a new View named File View New and Hive View New in Local Cluster. My checks are passed now and i am able to get into hdfs directories. But There are 2 things which i observed

1) When i try to open file stored in HDFS then i am getting the same errors

16 Feb 2017 07:27:58,295 ERROR [ambari-client-thread-7609] ContainerResponse:537 - Mapped exception to response: 500 (Internal Server Error) org.apache.ambari.view.commons.exceptions.ServiceFormattedException

2) Under Hive View when i run a any command then i am seeing error like "Could not write to /user/admin/hive/jobs(HDFSSApiException). Although i have created directory using below mentioned commands but still not able to see why this is happening. I am using below mentioned link to create admin directory in HDFS.

And i am getting 2nd error as mentioned in below link

https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_ambari_views_guide/content/troubleshooting.html

Re: Unable to open File View from Ambari UI

jsensharma — Thu, 16 Feb 2017 16:43:19 GMT

@rahul gulati

Have you changed the permission/ownership as well of the directory "/user/admin" ?

sudo -u hdfs hdfs dfs  -mkdir /user/admin
sudo -u hdfs hdfs dfs  -chown admin:hadoop /user/admin

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 16:50:26 GMT

@Jay SenSharma

Yes. I even have given 777 as permission as well

hadoop fs -ls /user

Found 8 items

drwxrwxrwx - admin hadoop 0 2017-02-16 07:33 /user/admin

It looks good but donot know why it is not working.

Re: Unable to open File View from Ambari UI

jsensharma — Thu, 16 Feb 2017 16:57:09 GMT

@rahul gulati

Can you please share the error that you are getting while it is failing to write content in hdfs?

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 17:12:20 GMT

@Jay SenSharma

Error mentioned below

16 Feb 2017 09:11:22,733 ERROR [ambari-client-thread-10030] ContainerResponse:537 - Mapped exception to response: 500 (Internal Server Error) org.apache.ambari.view.hive2.utils.ServiceFormattedException at org.apache.ambari.view.hive2.resources.jobs.viewJobs.JobControllerImpl.setupQueryFile(JobControllerImpl.java:270) at org.apache.ambari.view.hive2.resources.jobs.viewJobs.JobControllerImpl.setupQueryFileIfNotPresent(JobControllerImpl.java:178) at org.apache.ambari.view.hive2.resources.jobs.viewJobs.JobControllerImpl.afterCreation(JobControllerImpl.java:164) at org.apache.ambari.view.hive2.resources.jobs.viewJobs.JobResourceManager.create(JobResourceManager.java:56) at org.apache.ambari.view.hive2.resources.jobs.JobService.create(JobService.java:523) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)

Re: Unable to open File View from Ambari UI

munnyrahul — Thu, 16 Feb 2017 17:56:20 GMT

@Jay SenSharma

Following the link below i have added all the resp. properties in custom core-site.xml(Ambari) But no success.

http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_ambari_views_guide/content/_configuring_your_cluster_for_files_view.html

i have added 4 more properties named as

hadoop.proxyuser.root.groups=*
hadoop.proxyuser.root.hosts=*

hadoop.proxyuser.admin.groups=*
hadoop.proxyuser.admin.hosts=*