I can open the link just fine. Please see attached screenshot http://hortonworks.com/wp-content/uploads/2015/08/DataSheet_HDPCD_Java_2.2.pdf Make sure your dont have any connection issues. ... View more

@Lifeng Ai - For your question - I solved the problem by removing "-D fs.s3a.fast.upload=true" but still don't know the reason. Do some one know why "fs.s3a.fast.upload=true" will cause java heap space problem? Yes, fs.s3a.fast.upload=true can cause Heap related issues: Read the below document: https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html#Stabilizing:_S3A_Fast_Upload HADOOP-13560 fixes the problem by introducing the property fs.s3a.fast.upload.buffer But this is not yet released as part of HDP, and should be released in HDP 2.6. Hope, this clarifies the issue! ... View more

Below is a good read on Determining HDP Memory configs: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_installing_manually_book/content/determine-hdp-memory-config.html ... View more

Yes, you can use ext4 disks to store HDFS data. Once you have installed HDP, you can set the property : dfs.datanode.data.dir in hdfs-site.xml to point to any locations you want the data to be stored. Below post talks about the same: https://community.hortonworks.com/questions/89786/file-uri-required-for-dfsdatanodedatadir.html For your second question, I am not aware of any rpm which can convert existing data to HDFS. You would have to migrate the existing data to HDFS. There are many ways possible as how to migrate the data also depending upon where the data resides (on disk, in database etc). Below is one basic example of loading the data: https://hortonworks.com/hadoop-tutorial/loading-data-into-the-hortonworks-sandbox/ ... View more

@Sylvain Robert - This looks like a duplicate of : https://community.hortonworks.com/questions/89875/expression-language-for-kafka-broker-of-publishkaf.html Can you please resolve this. Thanks! ... View more

@Faruk Berksoz - Below query should work fine: SELECT * FROM ( SELECT * FROM TB.TABLE1 ) T; ... View more