Member since
04-05-2016
130
Posts
93
Kudos Received
29
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3828 | 06-05-2018 01:00 AM | |
5166 | 04-10-2018 08:23 AM | |
5675 | 07-18-2017 02:16 AM | |
2939 | 07-11-2017 01:02 PM | |
3369 | 07-10-2017 02:10 AM |
02-13-2017
01:17 PM
Hello @Ali Mohammadi Shanghoshabad The error message on Solr server might be this Solr issue, if so, it's ok to ignore based on the JIRA. https://issues.apache.org/jira/browse/SOLR-6688 Could you confirm that the Solr HTTP endpoint is accessible from NiFi server? For example using cURL command? To rule out networking issue: # from NiFi server terminal
curl -i http://172.17.0.2:8983/solr Thank you, Koji
... View more
02-13-2017
01:17 PM
1 Kudo
Hi Shanghoosh, Your English is fine 🙂 HTTP/1.1 302 Found is a good response showing that it can connect to the remote HTTP endpoint. Sorry I should have add a trailing '/' then you should have a result with 'HTTP/1.1 200 OK'. Are you referring to a tutorial or an example? If so, would you share the link with us? I tried this example, started a Solr Cloud and I was able to connect PutSolrContentStream to it with following configuration: https://cwiki.apache.org/confluence/display/solr/Getting+Started+with+SolrCloud
... View more
02-13-2017
09:35 AM
2 Kudos
Hi @Avijeet Dash I had a hard time to understand how should I write a Jolt spec before, and wrote this blog post to memorandum what I've learnt based on my experience. It's not an official documentation, but I hope it'll be helpful in someway. http://ijokarumawak.github.io/nifi/2016/11/22/nifi-jolt/ Thanks, Koji
... View more
02-13-2017
09:29 AM
4 Kudos
Hi @Avijeet Dash What @Jobin George suggested would help to share common static configuratiosn at various part of a NiFi flow. In addition to that, if you'd like to know how to Put/Get from distributed cache, and how to enrich FlowFiles with cached values, this example might be helpful: Template file is available here: https://gist.github.com/ijokarumawak/8ba9a2a1b224603f877e960a942a6f2b Thanks, Koji
... View more
02-09-2017
05:50 AM
Forgot to mention that, instead of using ListenX, if you can deploy NiFi or use NiFi Site-to-Site client library in your client program, you don't have to deploy additional stuff to distribute load among remote NiFi cluster nodes. Site-to-Site client knows which nodes exist in a remote cluster, then automatically distribute data transmission.
... View more
02-09-2017
05:45 AM
Hi @Raj B, ListenX processors can be run on every node in a NiFi cluster, but a client that sends a request has to specify a host to send to. Zookeeper doesn't provide any help to do that. If you write a custom client that retrieves NiFi cluster topology and round-robin requests among nodes at client side, it's doable. Otherwise, a DNS server or reverse proxy such as HAProxy is needed in the middle of a client and NiFi nodes. Thanks!
... View more
02-06-2017
05:45 AM
2 Kudos
Hello @Ward Bekker Although it's very useful, I couldn't find such URL or URL parameter that directly open a ProcessGroup in NiFi canvas by searching through NiFi code. However, a bookmarklet may be useful to share. After opening NiFi UI from a browser, specify following javascript at browser address bar, then it opens a ProcessGroup: javascript:nf.CanvasUtils.enterGroup('02769185-015a-1000-2e6d-29eab04dde5d') The uuid argument for enterGroup function is a ProcessGroup uuid.
... View more
01-24-2017
03:50 AM
4 Kudos
Hi @Bart Maes I was able to see the same behavior, with Oracle Amazon RDS and Oracle jdbc-drivers-12c. As for Numeric columns, I think there're few problems ATM: 1. Oracle uses NUMBER even if the column is defined with INT [1] (This is not a driver side issue, I guess.) 2. JDBC driver maps Number to BigDecimal 3. NiFi implementation maps BigDecimal to String, since at that time, Avro didn't support BigDecimal mapping until Avro 1.8.1. Current NiFi uses Avro 1.7.7. With Avro 1.8.1, we can utilize LogicalType [2] to map BigDecimal or Date more user friendly way. 4. There's an ongoing effort in NiFi project [3] to use LogicalType mechanism, so that those data types can be mapped with more appropriate data types. Excuse me for not being able to share a workaround for current situation, but once that change has been merged to NiFi, your experience with those data types will be better. Or other folks may know other solution. 1. http://stackoverflow.com/questions/1419109/resultsetmetadata-returning-bigdecimal-insted-of-int 2. http://avro.apache.org/docs/1.8.1/spec.html#Logical+Types 3. https://issues.apache.org/jira/browse/NIFI-2624 Hope this helps, Koji
... View more
01-20-2017
01:07 AM
Maybe Wait/Notify processor might be useful for some use cases, too. It will support waiting for multiple signals from next version of NiFi. There's a sample flow image, a part of flow waits for other part of flow send notification signal: https://github.com/apache/nifi/pull/1420
... View more
01-11-2017
01:17 AM
A JIRA is created https://issues.apache.org/jira/browse/NIFI-3318
... View more