@cduby Sorry for posting to this closed issue. I'm interested to know if you were truly able to deploy this way though. I have never done a Cloudbreak installation to Openstack with Isilon, so I'd love to find out more about what you did. ... View more

I'd like to add a point of clarity for Dell EMC Isilon. In Isilon's OneFS operating system we have implemented the server (NameNode, DataNode) half of HDFS. A solution with Isilon still requires client systems (eg, CentOS) that have the HDFS Client installed. HBase would be installed on those systems with the HDFS client. HBase cannot be installed on OneFS and run in standalone mode. It could be installed in standalone mode on another system that used a mount or other path to store data on OneFS. But that would not be the same as running HBase on OneFS. ... View more

@jss shouldn't that be mentioned in one of the two docs then? Eg, http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.0.1/bk_ambari-views/content/configuring_your_cluster_for_files_view.html That doc specifically says "4. Save the configuration change and restart the required components as indicated by Ambari." It should say "and HiveServer2 in order to use Hive View". ... View more

Thanks for confirming. ... View more

Thanks for pointing to more information. I'm going to accept vperiasamy's answer. ... View more

Thank you, I was able to find it on a system with successful creation. This helped me very much. In the "Restart NameNode" in restarting HDFS services after changing the plugin setting to Enabled. 2016-10-07 08:38:32,458 - Ambari admin user creation successful. 2016-10-07 08:38:33,148 - Repository created Successfully 2016-10-07 08:38:33,148 - Hdfs Repository created in Ranger admin 2016-10-07 08:38:33,149 - File['/usr/hdp/current/hadoop-client/conf/ranger-security.xml'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644} ... View more

@Timothy Spann An updated, clearer guide was recently published by EMC which walks through installation of Hortonworks HDP and Isilon OneFS together. It is currently as of OneFS 8.0.0.x with HDP 2.4.x. Here it is, the EMC Isilon OneFS with Hadoop and Hortonworks Installation Guide: http://www.emc.com/collateral/TechnicalDocument/docu71396.pdf ... View more

Great @Matjaz Skerjanec , glad to help! How about selecting one of the answers as "Accepted" so that other folks know this question is closed? Also, I'm curious what version of OneFS your cluster is running. Is it 7.2.something or 8.0.something? ... View more

Are you also the administrator of the Isilon cluster? If not, you should ask the administrator to grant you access to view the web administrator UI or ssh into the cluster. Or, ask to be added to email notification on alerts for your zone and an HDFS traffic report from InsightIQ. Currently from the HDP side, the only direct reassurance you can get is to see that the HDFS service is green. We recognize that doesn't match the expectations of an Ambari administrator, so we hope to provide more data directly to Ambari in the near future. Otherwise within Ambari you will be looking at the cluster from an application perspective. For example, you can check that services are running correctly -- the Yarn service check is a great test. If OneFS is not configured correctly it won't pass. Within OneFS, the first page of the administrator dashboard will tell you the status of the cluster. From the console, run isi status for the same data. InsightIQ, our cluster analytics dashboard package, is now offered as a free option by Isilon. With it you can watch HDFS protocol traffic and inspect cluster capacity and other metrics over time. Give that a spin or ask your Isilon administrator to set up a report for you! ... View more

Here's what I used after guidance from @Robert Levas "security" : { "type" : "KERBEROS", "kerberos_descriptor": { "properties": { "realm" : "YOURREALMHERE", "keytab_dir" : "/etc/security/keytabs" }, "identities" : [ { "principal" : { "type" : "user", "value" : "ambari-qa@${realm}" }, "name" : "smokeuser" } ], "services" : [ { "name" : "HDFS", "components" : [ { "name" : "NAMENODE", "identities" : [ { "principal" : { "configuration" : "hadoop-env/hdfs_principal_name", "type" : "user", "local_username" : "hdfs", "value" : "hdfs@${realm}" }, "name" : "hdfs" } ] } ] }, { "name" : "MAPREDUCE2", "components" : [ { "name" : "HISTORYSERVER", "identities" : [ { "principal" : { "configuration" : "mapred-site/mapreduce.jobhistory.principal", "type" : "service", "local_username" : "mapred", "value" : "mapred/_HOST@${realm}" }, "name" : "history_server_jhs" } ] } ] }, { "name" : "SPARK", "identities" : [ { "principal" : { "configuration" : "spark-defaults/spark.history.kerberos.principal", "type" : "user", "local_username" : "spark", "value" : "spark@${realm}" }, "name" : "sparkuser" } ] }, { "name" : "ACCUMULO", "identities" : [ { "principal" : { "configuration" : "accumulo-env/accumulo_principal_name", "type" : "user", "local_username" : "accumulo", "value" : "accumulo@${realm}" }, "name" : "accumulo" }, { "principal" : { "configuration" : "accumulo-site/trace.user", "type" : "user", "local_username" : "accumulo", "value" : "accumulo@${realm}" }, "name" : "accumulo_tracer" } ] }, { "name" : "HBASE", "identities" : [ { "principal" : { "configuration" : "hbase-env/hbase_principal_name", "type" : "user", "local_username" : "hbase", "value" : "hbase@${realm}" }, "name" : "hbase" } ] }, { "name" : "YARN", "components" : [ { "name" : "NODEMANAGER", "identities" : [ { "principal" : { "configuration" : "yarn-site/yarn.nodemanager.principal", "type" : "service", "local_username" : "yarn", "value" : "yarn/_HOST@${realm}" }, "name" : "nodemanager_nm" } ] }, { "name" : "RESOURCEMANAGER", "identities" : [ { "principal" : { "configuration" : "yarn-site/yarn.resourcemanager.principal", "type" : "service", "local_username" : "yarn", "value" : "yarn/_HOST@${realm}" }, "name" : "resource_manager_rm" } ] } ] }, { "name" : "STORM", "identities" : [ { "principal" : { "configuration" : "storm-env/storm_principal_name", "type" : "user", "value" : "storm@${realm}" }, "name" : "storm_components" } ] }, { "name" : "FALCON", "configurations" : [ { "falcon-startup.properties" : { "*.dfs.namenode.kerberos.principal" : "hdfs/_HOST@${realm}" } } ] } ] } }, "configurations" : [ { "kerberos-env": { "properties_attributes" : { }, "properties" : { "realm" : "YOURREALM", "kdc_type" : "mit-kdc", "kdc_host" : "my-real-kdc.emc.com", "admin_server_host" : "my-real-ambari-server.emc.com" } } }, { "krb5-conf": { "properties_attributes" : { }, "properties" : { "domains" : "YOURREALM", "manage_krb5_conf" : "true" } } } ] ... View more

@Robert Levas Fantastic, thanks for your help! That small sample was the reassurance I needed on what path to follow. A bit of background: OneFS actually isn't a separate service in Ambari. The OneFS cluster reveals itself as a single FQDN, so that is simply added as an additional host within Ambari Server. For clarity, here's what the blueprint block looks like for OneFS: "host_groups" : [ { "name" : "onefs_group", "components" : [ {"name" : "DATANODE"}, {"name" : "NAMENODE"}, {"name" : "SECONDARY_NAMENODE"}, {"name" : "KERBEROS_CLIENT"} ], "cardinality" : "1" }, I'll update the original question with the security block I used. Robert, this post you did in April was also really helpful as I tracked down my last typo. https://community.hortonworks.com/articles/28734/obtaining-a-listing-of-expected-kerberos-identitie.html Thanks again! ... View more

I guess I wasn't clear enough in the title. It should be "How do I create custom Kerberos principals during cluster creation?" As I said in the body, I'm able to Kerberize just fine, and Ambari is successfully creating principals in my KDC. However, I need to customize a number of principals. I've only been successful with smokeuser aka ambari-qa. Specifically I need to change: - UPNs: HDFS, Accumulo Tracer, Accumulo, HBase, Storm, Spark - SPNs: HDFS NameNode, Yarn Resource Manager, Yarn Node Manager, Mapred2 Job History Server If I could get an example of one non-smokeuser UPN and one SPN, and assurance that it works in both a blueprint and a cluster template, I think I can do the rest. ... View more