Member since
07-11-2017
7
Posts
0
Kudos Received
0
Solutions
01-10-2019
08:10 AM
I faced similar issue. fortunatly for me , the destination dir was not present. once i create it. the error got resolved.
... View more
05-15-2018
08:53 AM
I am trying to run sqoop import with jdbc client configured. there is a CLOB column in the oracle source. I tried to give the "--map-column-java <colName>=String" option . Still getting below error. Error: java.io.IOException: SQLException in nextKeyValue
at org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:556)
at org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
... View more
Labels:
- Labels:
-
Apache Sqoop
04-19-2018
07:56 AM
I have implemented wait and notify in a single flow. if there are 100 flow file passing to wait processor and waiting for notify to complete. Notify got only 99 files and updated the cache will all 99. Due to this 1 missing notify other flowfiles are getting stuck in the flow. current sithuation : Notify : all 99 notified and moved to sucess. Wait only 40 passed and rest 60(this include the 1 missing flowfile) are in wait loop.
... View more
Labels:
- Labels:
-
Apache NiFi
04-19-2018
07:46 AM
Hi Geoffrey , Thanks for the suggestion . I am using ORC format for both table. it is only the sequence of the column that is causing the issue . EG: A(name string,sal decimal(3,2),DOB timestamp) B(name String , DOB Date, sal decimal(3,2)) When i insert data from B to A using a select query i am getting this error. if i drop table A and create it in the same sequence as of B it works fine. Is there a solution which can be applied here to force hive to insert data based on name of column instead their Sequence .
... View more
04-19-2018
07:12 AM
When i run insert overwrite from B to table A having all column present but not in the same sequence , i am getting a conversion error. IS there a solution available where we can force the insert by name of column insted of sequence.
... View more
Labels:
- Labels:
-
Apache Hive
11-22-2017
07:39 AM
Thanks Matt , one more good article from you. If my nifi went down or processor stopped somehow. After restart what will be the value of the columns present ? (reset or will it keep the updated value) also eagerly waiting for this processor to handle the actual cdc data from database change log file.that will solve many use cases i hope and may reduce the cost of other CDC based tools.
... View more