hortonworks1 --> This is the pwd ... View more

Hi @sudhir reddy I have the same use case and i am currently stuck at the same point. Were you able to fix your issue. If yes, could you please reply back. ... View more

Hi @Alann Luhl.. Even find the directory. Did you find it yet? ... View more

Desc <Table_name>; you'll come to know your table would have columns like _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8, _col9.. What you need to do is Add the alias to your existing table so that your column names are the actual names and not default _col1, etc. ... View more

Try changing the execution engine to MR.. Run your query.. If its working fine. Change the execution engine to tez. this is how you do it. set hive.execution.engine=mr; set hive.execution.engine=tez; ... View more

@Sateesh Mandumula Obviously You cannot have transactional Properties on top of external table as Hive just reads the file present in HDFS. Its not suppose to change the content of the External files. If you really want to use Transactional Property, Create an internal table select * from external table and use transaction properly on this internal table. ... View more

Hi @Simran Kaur If you want to use this within the script, you can do the following. set hivevar:DATE=current_date; INSERT OVERWRITE DIRECTORY '/user/xyz/reports/oos_table_sales/${DATE}' ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' SELECT * FROM outputs.oos_table_sale; Cheers, Sagar ... View more

Hi @rama The below query will make your query run faster. insert into table dropme_master_6 select * from dropme_master_5 a left outer join dropme_master_6 b on a.consumer_sequence_id = b.consumer_sequence_id where b.consumer_sequence_id is null; ... View more

Hi @rama , Please change your query to this: insert into table dropme_master_6 select * from dropme_master_5 a left outer join dropme_master_6 b on a.consumer_sequence_id = b.consumer_sequence_id where b.consumer_sequence_id is null; I am pretty confident this will improve your performance. Please let me know if it works and give me a thumps up. 🙂 Regards, Sagar Morakhia ... View more

@Ravi Chinni insert into some_test_table select 'c1_val',named_struct('c2_a',array(cast (null as string)),'c2_c',cast (null as string)),array(named_struct('c3_a',cast (null as string) ,'c3_b',cast (null as string))) from z_dummy; This will work for you. Needless to say, please upvote if the answer was useful. 🙂 ... View more

Can you provide your sample input entry.? ... View more

Hi @rama , First of all, I would suggest you to kill such jobs after 2-2.5 Hours, especially when your job finishes in half n hour on a normal day. 1 probable cause could be any other job is utilizing 90+% CPU, hence slowing down your job process. If you can provide me your entire query, I may be able to provide you few set parameters which will help running the query faster. Cheers, Sagar ... View more

@bkosaraju Will try this and update you. Thanks 🙂 ... View more

@Timothy Spann Thats something I am already donig, but my problem is with the transfer speed. ... View more

Thanks @Christophe Vico, Ill try with the 1st option and update you. ... View more

Hi, Nice Article. I found a faster way of doing the same from Official documentation of sqoop. https://oozie.apache.org/docs/4.1.0/DG_WorkflowReRun.html So generally, rerunning the Oozie jobs are ad-hoc tasks and you may not want to create xml file just for re-running the job. So command line argument goes as below: oozie job -oozie http://localhost:11000/oozie -rerun 14-20090525161321-oozie-joe -Doozie.wf.rerun.skip.nodes=<> Example for the same oozie job -oozie http://localhost:11000/oozie -rerun 14-20090525161321-oozie-joe -Doozie.wf.rerun.skip.nodes=action1,action2,action3 where http://localhost:11000/oozie --> host where Oozie is running 14-20090525161321-oozi-joe --> is your Oozie Job name action1,action2,action3 --> are the steps that you want to skip. It is eventually doing the same thing as mentioned in the article, but with this, we don't have to create the config file. Cheers, Sagar ... View more