About MobinRanjbar

MobinRanjbar · ‎11-17-2024

Hi there, I want to split the fetching operations from MySQL DB into 4 parts in NiFi. I put 4 ExecuteSQLRecord sequentially and I want to have all the data in the last part(I am aware of MergeContent, But I want the success signal of all parts separately.). I have test it but only the flowfiles of last processor was available. The scenario is like this: ExecuteSQLRecord>ExecuteSQLRecord>ExecuteSQLRecord>ExecuteSQLRecord>PutFile How Can I have all the flowfiles in the result? Thanks

MobinRanjbar · ‎07-30-2017

Thanks for your answer. I have tested both a and b successfully but the point is I am not using CM(CDH) and I have compiled Hue itself and ran it. I did run my Hive on Spark query via Beeswax successfully, but when I save my document and design a job my job will run in MR mode(hive.execution.engine property is set both in my document and by job.properties). How can I do that? Thanks, Mobin

MobinRanjbar · ‎07-29-2017

Hi there, I have compiled Hue and configured HiveServer2 and Spark but all of my jobs will run in MapReduce mode instead of Spark on Hive mode even I set 'hive.execution.engine=spark' and 'spark.master=yarn'. How can I do that? I think this is a duty of Oozie but I cannot find anything related to run Hive on Spark in YARN in that. Thanks in advance, Mobin

Online	Offline
Last Visited	‎11-18-2024 02:06 AM

Member Since	‎09-20-2015 08:18 AM
Last Visited	‎11-18-2024 02:06 AM
Posts	5
Kudos received	1

Cloudera Community

How can I transfer input flowfiles sequentially to...

Re: Hive on Spark in Hue/Oozie

Hive on Spark in Hue/Oozie