@Sampath Kumar If you are interested to resolve the issue then try out match the encryption types and tag me if need be? ... View more

@Daniel Nguyen I hope you replaced the "my_host_name.com" with the output of $ hostname -f Meaning the FQDN of the nifi host just to be sure we have the same understanding? ... View more

@heta desai How do I manage and configure block/chunk size and the replication factor with WASB? You don't. It's not generally necessary. The data is stored in the Azure storage accounts, remaining accessible to many applications at once. Each blob (file) is replicated 3x within the data center. If you choose to use geo-replication on your account you also get 3 copies of the data in another data center within the same region. The data is chunked and distributed to nodes when a job is run. If you need to change the chunk size for memory-related performance at run time that is still an option. You can pass in any Hadoop configuration parameter setting when you create the cluster or you can use the SET command for a given job. Reference: Understanding WASB and Hadoop Storage in Azure ... View more

@Manjunath P N A google search should give you that HDP 3.0 ... View more

@heta desai The simple answer is YES The hadoop-azure file system layer simulates HDFS folders on top of Azure storage. Windows Azure Storage Blob (WASB) is an extension built on top of the HDFS APIs.It in many ways "is" HDFS. However, WASB creates a layer of abstraction that enables the separation of storage. This separation is what enables your data to persist even when no clusters currently exist and enables multiple clusters plus other applications to access a single piece of data all at the same time. This increases functionality and flexibility while reducing costs and reducing the time from question to insight. HDInsights which is a Hortontworkd offering in Azure runs against WASB Azure doesn't have the notion of a directory. However, the parsing of the file name gives the tree structure because Hadoop recognizes that a slash “/” is an indication of a directory. Blob address: # Fully Qualified name Local hdfs://<namenodehost>/<path> # HDInsight Syntax Global wasb[s]://<containername>@<accountname>.blob.core.windows.net/<path> # Example wasb://YOURDefaultContainer@YOURStorageAccount.blob.core.windows.net/SomeDirectory/ASubDirectory/AFile.txt Hope that enlightens your knowledge ... View more

@Sampath Kumar So you have disabled Kerberos for HTTP web-consoles was that intentional on a kerberized cluster or just a workaround? ... View more

@Dukool SHarma Any updates? ... View more

@Sampath Kumar Any updates did this article help you ? ... View more