Member since
04-29-2016
192
Posts
20
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1678 | 07-14-2017 05:01 PM | |
2844 | 06-28-2017 05:20 PM |
03-28-2017
06:55 PM
thanks @Bryan Bende, our Java Developer is looking into the custom code
... View more
03-27-2017
03:20 PM
Hi All, I have a NiFi dataflow on a standalone NiFi instance, with a custom processor that is a modified version of the ListenTCP processor; the NiFi instance is ingesting data from an external system, which pushes the data to NiFi instance. I made a copy of the dataflow, and by mistake I had both dataflows running (the original and the copy), which resulted in an error, possibly because both dataflows were trying to read data on the same port on the ListenTCP processor. Is this the expected behavior (failing) or it should have worked load balancing the incoming data between the 2 dataflows ? I understand the proper way to load balance is to ingest the data only once on the primary node and using a RPG distribute the data across the nodes in the cluster. Second question I have is, I stopped the original dataflow and started to run the copy, but now the data ingestion is not working, with an unusual error shown in the log - java.lang.NumberFormatException: For input string:"2147486900"; the string the error is pointing to does not exist in the incoming data from the external system; and the number in the error message seems to increment with each occurrence of the error in the log, like "2147486900", "2147487000", "2147487100",.... Any thoughts on what could be causing this error: Thanks in advance.
... View more
Labels:
- Labels:
-
Apache NiFi
03-23-2017
03:12 PM
@Matt Clarke thank you, it worked perfectly. And thanks for the explanation as well. In the post I was using as reference, both instances were hosted on the same machine, so I couldn't quite figure out this difference that you elaborated on.
... View more
03-23-2017
02:19 PM
@Bryan Bende, we're experiencing the same issue this morning, thanks for clarifying.
... View more
03-22-2017
09:01 PM
Hi All, I'm trying to have NiFi Provenance data from the NiFi cluster sent to a standalone NiFi instance. Both NiFi instances are unsecure; I followed the instructions in this post - https://community.hortonworks.com/articles/72727/extracting-nifi-provenance-data-using-sitetositepr.html My setup is shown below; I modified the site-to-site properties in nifi.properties file of the Provenance instance and setup the SiteToSiteProvenanceReportingTask on the NiFi Cluster, the properties of that are listed in the image below; When I start the SiteToSiteProvenanceReportingTask, I see the "Connection refused" error in the 2nd picture below; Any help is appreciated. Thanks,
... View more
Labels:
- Labels:
-
Apache NiFi
03-14-2017
06:17 PM
1 Kudo
good eyes @Matt Clarke 🙂
... View more
03-13-2017
02:21 PM
Hi @spdvnz, I'm interested in this too; when I asked around earlier here in HCC about error capturing, one recommendation that was given was to grab the error data from nifi-app.log using the "tail file" approach. We've not implemented it yet, thought I share it with you.
... View more
03-10-2017
05:36 PM
Hi @Ryan Cicak, I checked the metastore URI, it was not correct, so I fixed that, but now I'm getting a different error; no Kerberos on my setup; and our HDP is HA This error is similar to what @Matt Burgess pointed to as an issue at onetime in the past - NIFI-2873, but that issue should be resolved in NiFi 1.1.0 and above; I am trying this in NiFi 1.1.2, but still same issue as pre-1.1.0 Any thoughts ??
... View more
03-09-2017
08:19 PM
@Matt Burgess this is what I see: 2017-03-09 14:06:53,516 ERROR [NiFi logging handler] org.apache.nifi.StdErr [Timer-Driven Process Thread-2] ERROR org.apache.nifi.processors.hive.PutHiveStreaming - PutHiveStreaming[id=015a1000-2600-129d-1dc2-b20f16685c5c] PutHiveStreaming[id=015a1000-2600-129d-1dc2-b20f16685c5c] failed to process due to com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: Unable to instantiate org.apache.hive.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient; rolling back session: com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: Unable to instantiate org.apache.hive.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient
2017-03-09 14:06:53,520 ERROR [NiFi logging handler] org.apache.nifi.StdErr com.google.common.util.concurrent.UncheckedExecutionException: java.lang.RuntimeException: Unable to instantiate org.apache.hive.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient
... View more
03-09-2017
08:03 PM
Thanks @Ryan Cicak; I'm getting an error with PutHiveStreaming processor - "Unable to instantiate org.apache.hive.hcatalog.common.HiveClientCache$CacheableHiveMetaStoreClient"; I posted the question already in HCC, but no takers yet. https://community.hortonworks.com/questions/87435/unable-to-instantiate-orgapachehivehcatalogcommonh.html
... View more