Member since
01-14-2016
15
Posts
10
Kudos Received
0
Solutions
12-15-2022
05:24 AM
This is working fine. Can we provide Search Value and Replacement Value as Variable or flowfile attribute. As I wanted to use same replace text processor to convert different input files with different number of columns. Basically I want to parameterised the Search Value and Replacement Value in replace text processor. @mpayne @ltsimps1 @kpulagam @jpercivall @other
... View more
03-25-2016
06:42 AM
1 Kudo
This should do it: /**
* If this is an incremental import then we save the user's state back to the metastore
*/
private void saveIncrementalState(SqoopOptions options) throws IOException {
if (!isIncremental(options)) {
return;
}
Map<String,String> descriptor=options.getStorageDescriptor();
String jobName=options.getJobName();
if (null != jobName && null != descriptor) {
LOG.info("Saving incremental import state to the metastore");
JobStorageFactory ssf=new JobStorageFactory(options.getConf());
JobStorage storage=ssf.getJobStorage(descriptor);
storage.open(descriptor);
try {
JobData data=new JobData(options.getParent(),this);
storage.update(jobName,data);
LOG.info("Updated data for job: " + jobName);
}
finally {
storage.close();
}
}
}
... View more
02-29-2016
07:54 PM
1 Kudo
@mburgess I am using nifi-0.4.0. This version does not have the ExecuteScript processor. How can I install this processor and configure the processor to run a Java program? -KS
... View more
02-12-2016
12:39 PM
Can you provide the schema you are loadings? I'm just starting nifi and ConvertCSVtoAvro seems to be the easiet one bot I have no idea how the schema should look like...
... View more
03-30-2017
05:14 AM
@Jeremy Dyer I understand how a global replacement works, but am struggling when I just want to replace certain occurrences. Let's say my Flowfile looks like this: xyz key=AABBBBCC foo bar AABBBBCC Another one looks like this: xyz key=DDEEEEFF foo bar DDEEEEFF I only want to replace the values that are prepended by key= I tried with Regular Expression key=(\S+) and Matching Group 1 , which didn't work. What did work was setting the Regex to key=(AABBBBCC|DDEEEEFF), but this unfortunately makes the regex static.
... View more