Member since
12-03-2017
156
Posts
26
Kudos Received
11
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2076 | 11-03-2023 12:17 AM | |
4138 | 12-12-2022 09:16 PM | |
1562 | 07-14-2022 03:25 AM | |
2389 | 07-28-2021 04:42 AM | |
3318 | 06-23-2020 10:08 PM |
11-15-2022
10:26 AM
Hello experts, I am using below api to create and update variable registry variables.. /nifi-api/process-groups/" + processGroupId + "/variable-registry/update-requests But I am unable to delete any already created variable from specific processor group variable registry using nifi api. Which api I am suppose to use to delete a variable registry variables? Thanks, Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
11-03-2022
04:32 AM
@MattWho @araujo @smdas Just tagging top solution authors to notify
... View more
11-02-2022
04:46 AM
Hello Experts, I need to execute java class or a java method during Nifi bootup. This is to register/integrate my org health check sdk (which has to be done at nifi bootup time) Is there any option to invoke/execute my java code snippet or a java class during bootup ? Any suggestion would be appreciated. One option I have is to write a custom logback appender class and add that custom appender is logback.xml so nifi will run this during bootup. I am looking for better option. Thanks, Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
10-17-2022
02:38 AM
Hi When 'Event Hub Namespace' is set with invalid, incoming flow files are getting stuck (not moving to failure relation) and also its keep on opening connection (files) and which is making Nifi is to go down.. Any suggestion how can I take care of this ? In my use case these 'Event Hub Namespace' and other fields are configured from an UI by an end customer so possibility of invalid data Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
08-12-2022
03:55 AM
Hello Experts, Any idea why we cant increase cuncurrent task of ConsumeAzureEventHub processor? And what is main difference between GetAzureEventHub vs ConsumeAzureEventHub processors? When should I use which one? Any info is much appreciated. Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi
08-09-2022
08:54 PM
Hello Experts, I am new to Flink CEP and trying to test basic things - In below code my expectation is all the input should matched in patter and should print as matched result. But somehow nothing is matching ('matechedStream.print()') any idea about the reason ? Any suggestion/help would be much appreciated. package com.o9.flink;
import com.o9.flink.asyncio.DemandSupply;
import org.apache.flink.cep.CEP;
import java.util.ArrayList;
import java.util.List;
import java.util.Map;
import org.apache.flink.cep.PatternStream;
import org.apache.flink.cep.functions.PatternProcessFunction;
import org.apache.flink.cep.pattern.Pattern;
import org.apache.flink.cep.pattern.conditions.SimpleCondition;
import org.apache.flink.streaming.api.datastream.DataStream;
import org.apache.flink.streaming.api.environment.StreamExecutionEnvironment;
import org.apache.flink.streaming.api.windowing.time.Time;
import org.apache.flink.util.Collector;
public class DemandSupplyPattern {
public static void main(String[] args) throws Exception {
StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
env.setParallelism(1);
DataStream<String> keyedInputStream = env.fromElements("AAA","BBB","CCC");
Pattern<String, ?> dspattern = Pattern.<String>begin("start");
PatternStream<String> patternStream = CEP.pattern(keyedInputStream, dspattern);
DataStream<String> matechedStream = patternStream.process(new PatternProcessFunction<String, String>() {
@Override
public void processMatch(Map<String, List<String>> map, Context context, Collector<String> collector) throws Exception {
collector.collect(map.get("start").toString());
}
});
matechedStream.print();
env.execute("DemandSupply-CEP");
}
} <dependencies>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-runtime</artifactId>
<version>${flink.version}</version>
<!--<scope>test</scope>-->
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-core</artifactId>
<version>${flink.version}</version>
<!--<scope>provided</scope>-->
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-java</artifactId>
<version>${flink.version}</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-avro</artifactId>
<version>${flink.version}</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-streaming-java</artifactId>
<version>${flink.version}</version>
<!--<scope>provided</scope>-->
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-clients</artifactId>
<version>${flink.version}</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-connector-kafka</artifactId>
<version>${flink.version}</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-statebackend-rocksdb</artifactId>
<version>${flink.version}</version>
<!--<scope>test</scope>-->
</dependency>
<dependency>
<groupId>org.asynchttpclient</groupId>
<artifactId>async-http-client</artifactId>
<version>2.2.0</version>
</dependency>
<dependency>
<groupId>org.apache.flink</groupId>
<artifactId>flink-cep</artifactId>
<version>${flink.version}</version>
<!--<scope>provided</scope>-->
</dependency>
</dependencies>
... View more
Labels:
- Labels:
-
Apache NiFi
08-01-2022
09:07 PM
1 Kudo
@MattWho - We have separated out ebs volumes of each repos and also 3 ebs volumes each for content and provenance repos. Now looks like issue is pretty much resolved ! Thanks for all your suggestions, helped a lot Thanks Mahendra
... View more
08-01-2022
09:05 PM
Hello Experts, Any idea when will be prod usable version of this alpha version will be available ? https://mvnrepository.com/artifact/org.apache.hive/hive-jdbc/4.0.0-alpha-1 Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache Hive
08-01-2022
12:34 AM
Unfortunately dont find anything. I enabled DEBUG logger also for HandleHttpRequest processors but nothing over there
... View more
07-31-2022
10:25 AM
Hello Experts, I have HandleHttpRequest processors which works fine when I start my load test and after 100K + records suddenly stops taking any more request (does not emit any ff also from processor) for 10-15 seconds and then again resumes ! Any idea what could be the reason, it does not show any log also. Thanks Mahendra
... View more
Labels:
- Labels:
-
Apache NiFi