Hi, I want to split that file name('_') and store split values in variable for further operation. The file name is combination of various parameter. file Name = BBAS_2018091873_COEP_20180918141337_Cleaned_txt_scorable.csv Stores the values in variable like, like a=BBAS ,b=2018091873 , c=COEP, d=20180918141337 , e=Cleaned, f=txt , g=scorable.csv Thanks in advance!!! ... View more

Hello, I have created custom processor same like ExecuteSQL. after executing query all data get in resultset . I have to add one external string value . String queryID="123456" -it may be static or dynamic. Where I have to add that value in resultSet or flowfile?? and how to add that value?? using convert AvroToJson I have take that queryID using EvaluateJsonPath processor and use further operation. the code is same like below, Can someone point me at an example to get me going -------------------------------------------------------------------------------------------------------------------- fileToProcess = session.write(fileToProcess, new OutputStreamCallback() { @Overrid public void process(final OutputStream out) throws IOException { try { logger.debug("Executing query {}", new Object[]{selectQuery}); final ResultSet resultSet = st.executeQuery(selectQuery); final JdbcCommon.AvroConversionOptions options = JdbcCommon.AvroConversionOptions.builder() .convertNames(convertNamesForAvro) .useLogicalTypes(useAvroLogicalTypes) .defaultPrecision(defaultPrecision) .defaultScale(defaultScale) .build(); nrOfRows.set(JdbcCommon.convertToAvroStream(resultSet, out, options, null)); } catch (final SQLException e) { throw new ProcessException(e); } } }); long duration = stopWatch.getElapsed(TimeUnit.MILLISECONDS); // set attribute how many rows were selected fileToProcess = session.putAttribute(fileToProcess, RESULT_ROW_COUNT, String.valueOf(nrOfRows.get())); fileToProcess = session.putAttribute(fileToProcess, RESULT_QUERY_DURATION, String.valueOf(duration)); fileToProcess = session.putAttribute(fileToProcess, CoreAttributes.MIME_TYPE.key(), JdbcCommon.MIME_TYPE_AVRO_BINARY); logger.info("{} contains {} Avro records; transferring to 'success'", new Object[]{fileToProcess, nrOfRows.get()}); session.getProvenanceReporter().modifyContent(fileToProcess, "Retrieved " + nrOfRows.get() + " rows", duration); session.transfer(fileToProcess, REL_SUCCESS); ----------------------------------------------------------------------------------------------------------------------------------------------- ... View more

Hello, My NIFI flow is successfully run After that I have seen that the In,Read/Write,Out in processor view But after 5 min the all information is flush from processor view I check the processor code, there is no code for flush information after 5 min that is happen in every processor I have to change that time, how can I do that ... View more

Hello, I have Designed the bellow data flow 1 - -> 2 - ConvertAvroToJSON -> 3 - splitJSon -> 4 - EvaluateJsonPath -> 5 - UpdateAttribute -> 6 ExecuteSQL -> 7 - replaceText -> 8- putSQL. 1 - 2 - 3 : query your table and split by row. You will have one flowfile by row. Use $ for the JsonPathExpression in the split processor. 4 - Retrieve the query_id and the query_execute in two attributes of each flowfile (values of your properties are $.query_id and $.query_execute) 5 - Create a new attribute query_startTime with the value ${now():format('HH:mm:ss') 6 - Execute the query ${query_execute} 7 - Write your insert query : INSERT INTO queryExecutionInfo VALUES (${query_id}, ${query_startTime},{${now():format('HH:mm:ss')); 8 - Execute your insert problem: In 5th step query_startTime for all query is same ExecuteSQL processor is required some time to execute the query. after the first query execute the value are inserted into queryExecutionInfo table sucessfully. but when second query execution completed the query_startTime same as first query_startTime and end time is different. I have to insert second query_startTime as first query_endTime and vice versa. Can someone point me at an example to get me going ... View more