Hello @Saurab Dahal , You should use the hive context object to connect and query hive Here in the answer you can see a small example https://community.hortonworks.com/questions/93392/how-to-connect-and-run-hive-query-from-apache-spar.html Michel ... View more

Hi, I do t know for the snapshot but you can have the same result by doing an export and the. And import of your table. In the following link you have an example how to do it: http://www.rotanovs.com/hbase/hbase-importexport/ Michel ... View more

You can add compression when you write your data. This will speed up the saving because the size of the data will smaller. Also increase the number of partition ... View more

Hi, You just need put a processor "puthdfs", then righ click to open the configuration panel. they you need to provide the configuration file of hdfs (hdfis-site.xml, core-site.xml) and the folder where you want to put the data. This is to put data to hdfs. To read data (for example locally) use the processor tailfile. ... View more

Hi @Adnan Alvee, In order to parrallelize the write to hdfs, you just need to increase the number of partitions for your data and or increase the number of executor. To increase the number of executor, when you submit your spark job specify the option: --num-executors x where the x is the number of executor that you want. more you have more parallelism your have. to increase the number of partition, in your code, you have to call the function repartition(x) on the RDD or the Dataset, it will spread the data over x node (container) and each node will write in parallel. Last thing, don't increase to much the repartition because the result can be that you create too many small file. So I advice, Size of full data (in MB) / 128 = repartition number Michel ... View more

Hi @asubramanian, Thanks for your reply. I followed the HCP documentation and it's never mention that the user metron should run the process. Moreover in the documentation it's specify to install and run the rest-api and metron-UI manually in command line. HCP doc Do you have any docuementation or tutorial to run rest-api and metron-ui with ambari? In my case, If I run the rest-api and metron-ui with metron user I will have the same problem, which is a permission denied when I try to create a new sensor, because the hdfs path is /apps/metron/patterns has 755 right access. Should I change the owner of the folder to metron? Thanks, Michel ... View more

same question as that one: https://community.hortonworks.com/questions/113885/hive-table-on-hbase-table-showing-null-for-integer.html ... View more