0: jdbc:mysql://hdp1.demo.lab/hive> set mapred.job.queue.name=root.admin; Error: Unknown system variable 'job' (state=HY000,code=1193) 0: jdbc:mysql://hdp1.demo.lab/hive> set tez.queue.name=root.admin; Error: Unknown system variable 'queue' (state=HY000,code=1193) 0: jdbc:mysql://hdp1.demo.lab/hive> SET tez.queue.name=root.admin; Error: Unknown system variable 'queue' (state=HY000,code=1193) 0: jdbc:mysql://hdp1.demo.lab/hive> SET TEZ.QUEUE.NAME=ROOT.ADMIN 0: jdbc:mysql://hdp1.demo.lab/hive> SET TEZ.QUEUE.NAME=ROOT.ADMIN; Error: Unknown system variable 'QUEUE' (state=HY000,code=1193) 0: jdbc:mysql://hdp1.demo.lab/hive> set TEZ.queue.name=root.admin; Error: Unknown system variable 'queue' (state=HY000,code=1193) 0: jdbc:mysql://hdp1.demo.lab/hive> SET tez.queue.name=ROOT.ADMIN; Error: Unknown system variable 'queue' (state=HY000,code=1193) 0: jdbc:mysql://hdp1.demo.lab/hive> SET tez.queue.name=admin; Error: Unknown system variable 'queue' (state=HY000,code=1193) 0: jdbc:mysql://hdp1.demo.lab/hive> SET tez.job.queue.name=admin; Error: Unknown system variable 'job' (state=HY000,code=1193) 0: jdbc:mysql://hdp1.demo.lab/hive> ... View more

All, Just adding for knowledge gain , if my source is kerberos enabled while target is not , then the command to be executed will be hadoop distcp -D ipc.client.fallback-to-simple-auth-allowed=true webhdfs://source-ip webhdfs://target-ip hadoop distcp -D ipc.client.fallback-to-simple-auth-allowed=true : this command overrides values present in the hive-site.xml. thanks, Rishit Shah ... View more

Yes it fails with select queries. i checked above that but i dont know how to make us of the patch? thanks, Rishit Shah ... View more

Hard to say from the info you gave. Since you load the data into a DataFrame, the Oracle part should be abstracted, as long as the schema fits - and I guess you checked the schema of "tran1" You could try to select from tran1 into another dataframe trans2 to control all columns, check schema and try to write tran2 ... View more

@Rishit shah It seems that you found the response to your own question. I believe that the new question should be separate from the current question. We want to prevent open-ended questions. Could you open a different question and notify @Artem Ervits? This way, he can place his response and if that helps, please vote and accept his response or any response that makes sense to you on the new question. That question is worth it a full discussion and it is of larger interest. ... View more

i am getting following error Caused by: java.lang.ClassNotFoundException: org.apache.hive.hcatalog.streaming.RecordWriter thanks, Rishit Shah ... View more