@Smart Solutions When you add Spark through Ambari, you will be asked to choose where to deploy master service (Spark History Service) And then to choose where to deploy clients services Finally you will be asked for several properties screen-shot-2016-03-03-at-61725-pm.png ... View more

how to increase it for no vm please @Neeraj Sabharwal ... View more

Not really. You mean as a persisted storage layer under hibernate and ejbs correct? Hive wouldn't work well for this since it's not an oltp database. It is a wareshoue.. So that would leave hbase most likely with Apache Phoenix. I Googled it a bit and focused on hibernate because that seems to be the most popular recently and did not find a connector for Phoenix. Doesn't mean it's not possible to write one. Googled a bit more and there is Hibernate OGM for NoSQL stores as well. Unfortunately it currently does not support HBase. http://hibernate.org/ogm/ So the two possibilities would be to write an extension for OGM for HBase or rewrite a connector for Apache Phoenix. I wrote one for Netezza a while back and it should not be terribly difficult, although the Phoenix syntax has some differences to standard SQL ( UPSERT instead of INSERT ... ) ... View more

@Prakash Punj If you are using MySQL then you definitely followed the below steps! The password in my case was "rangerdba" on the UI if you key in the password you used during the setup all should be fine ,otherwise you strictly need to do the initail MySQL setup corrcetly ... View more

@Artem Ervits @Mehrdad Niasari I believe we can lose this question. i have opened new one on default namespace here. ... View more

@Shishir Saxena, Yes GetFile processor also worked for shared drive. i have doubt on how to pass the credentials for access network drive? For example: my shared drive wants prompt for credentials for access folder inside it. If my shared folder have permission for everyone then i can able to access it. But if shared drive prompts for Credentials then ListFile seems doesn't work. So can you suggest the way to access shared drive with username and password in nifi processors? ... View more

Hi, I am struggling with the ame Problem. Mainserver: hadoopmain.hadoop.local Host1: node1.hadoop.local Host2. node2.hadoop.local I configured as it was set in the manual and when I try to connect via ssh it is working without password So I am logged in as root in the Mainserver hadoopmain.hadoop.local I then enter: ssh root@node1.hadoop.local And then I am logged on the node1 without being asked for a password. Nevertheless I a getting the failure: ========================== Creating target directory... ========================== Command start time 2019-02-15 12:12:13 Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). SSH command execution finished host=node1.hadoop.local, exitcode=255 Command end time 2019-02-15 12:12:13 ERROR: Bootstrap of host node1.hadoop.local fails because previous action finished with non-zero exit code (255) ERROR MESSAGE: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). STDOUT: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password). ... View more

For me adding the line below to spark-defaults.conf helped based on packages installed on my test cluster. spark.executor.extraLibraryPath /usr/hdp/current/hadoop-client/lib/native/:/usr/hdp/current/share/lzo/0.6.0/lib/native/Linux-amd64-64/ ... View more