Re: Insert overwrite query failing with Execution ...

praveenpatel56 · ‎01-10-2019

I faced similar issue. fortunatly for me , the destination dir was not present. once i create it. the error got resolved.

praveenpatel56 · ‎05-15-2018

I am trying to run sqoop import with jdbc client configured. there is a CLOB column in the oracle source. I tried to give the "--map-column-java <colName>=String" option . Still getting below error. Error: java.io.IOException: SQLException in nextKeyValue at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556) at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)

praveenpatel56 · ‎04-19-2018

I have implemented wait and notify in a single flow. if there are 100 flow file passing to wait processor and waiting for notify to complete. Notify got only 99 files and updated the cache will all 99. Due to this 1 missing notify other flowfiles are getting stuck in the flow. current sithuation : Notify : all 99 notified and moved to sucess. Wait only 40 passed and rest 60(this include the 1 missing flowfile) are in wait loop.

praveenpatel56 · ‎04-19-2018

Hi Geoffrey , Thanks for the suggestion . I am using ORC format for both table. it is only the sequence of the column that is causing the issue . EG: A(name string,sal decimal(3,2),DOB timestamp) B(name String , DOB Date, sal decimal(3,2)) When i insert data from B to A using a select query i am getting this error. if i drop table A and create it in the same sequence as of B it works fine. Is there a solution which can be applied here to force hive to insert data based on name of column instead their Sequence .

praveenpatel56 · ‎04-19-2018

When i run insert overwrite from B to table A having all column present but not in the same sequence , i am getting a conversion error. IS there a solution available where we can force the insert by name of column insted of sequence.

praveenpatel56 · ‎11-22-2017

Thanks Matt , one more good article from you. If my nifi went down or processor stopped somehow. After restart what will be the value of the columns present ? (reset or will it keep the updated value) also eagerly waiting for this processor to handle the actual cdc data from database change log file.that will solve many use cases i hope and may reduce the cost of other CDC based tools.

Online	Offline
Last Visited	‎07-09-2019 02:36 AM

Date Registered	‎07-11-2017 12:12 PM
Last Visited	‎07-09-2019 02:36 AM
Total Messages Posted	7

Re: Insert overwrite query failing with Execution ...

Sqoop import running with jdbc connection mode . F...

Wait is escaping notify in queue

Re: insert overwrite table A select * from B; unde...

insert overwrite table A select * from B; under Hi...

Re: Incremental Fetch in NiFi with QueryDatabaseTa...