I think you need to enable hive support when you create a spark session with the value of hive metastore Uris from hive-site.xml where your hive metastore is saved. Then you should be able to see existing tables of hive from spark . ... View more

Thanks @Jay for your suggestions. can we have a different ambari UI for each namespace or Is it like same ambari for the all the namespaces we create ? Is it possible to have different configurations at service level unlike host level. when hive is shared for multi tenants we have same metastore location that is one location for multiple namespaces. When we would like to have a different metastore for hive for new namespace , couldn't see any option for that. Same case with hbase region servers and kafka brokers storage. Is it really possible to federate services like hive, hbase and kafka ? I have not tried with Spark yet. Any suggestions will be great. Thanks, Arshad ... View more