Member since
07-27-2015
92
Posts
4
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3042 | 12-15-2019 07:05 PM |
11-01-2019
05:23 PM
@Matt Thanks, I solved this issue when i follow your point. Paul
... View more
11-01-2019
12:26 AM
Hello, My new CDF cluster include 3 nifi nodes. I enable SSL in nifi . but there is not SSL on LDAP. I don't what is the reason got the error: 2019-11-01 13:42:28,489 WARN org.apache.nifi.cluster.coordination.http.replication.ThreadPoolRequestReplicator: Failed to replicate request GET /nifi-api/flow/current-user to xx-cmf02.beta1.nn/10.202.252.92:8080 due to java.net.ConnectException: Failed to connect to xx-cmf02.beta1.nn/10.202.252.92:8080
at okhttp3.internal.connection.RealConnection.connectSocket(RealConnection.java:242)
at okhttp3.internal.connection.RealConnection.connect(RealConnection.java:160)
......
Caused by: java.net.ConnectException: Connection refused (Connection refused)
at java.net.PlainSocketImpl.socketConnect(Native Method) The behavior is very strange that one node access else node 8080 port but i did not to config it. So, what did i miss it? Thank you for your advice first. Paul
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
11-01-2019
12:13 AM
@Matt Thank you, I'm doing what you point me to do.
... View more
10-31-2019
02:23 AM
Hello!
Urgent problem I'm working on Cloudera Flow Management 1.0.1 and to evaluate the feasibility to move HDF to CDF. I'm meeting a problem that is how to config the Multi-Tenant Authorization with kerberos/LDAP in cloudera manager. Could you please help me for the following questions ? For HDF, there is apache ranger can config and implement the Multi-Tenant Authorization. It can be config in Ranger Admin GUI. How can I do the Multi-Tenant Authorization like HDF with CFM?
Thanks,
Paul
... View more
Labels:
- Labels:
-
Cloudera DataFlow (CDF)
02-07-2018
11:06 PM
HI Any update for the last question I cannot get the correctly numfound after i run: HADOOP_OPTS="-Djava.security.auth.login.config=jaas.conf" \ hadoop --config /etc/hadoop/conf jar /opt/cloudera/parcels/CDH/lib/hbase-solr/tools/hbase-indexer-mr-1.5-cdh5.11.2-job.jar --conf /etc/hbase/conf/hbase-site.xml -Dmapreduce.job.queuename=root.hadoop.plarch --hbase-indexer-zk oddev03:2181,oddev04:2181,oddev05:2181 --hbase-indexer-name onedata_order_orderIndexer --go-live Is this a known issue? if so, how to workaround? if no, how to correct the above command line? Thanks for your reply. BR Paul
... View more
12-21-2017
06:44 PM
HI, I meet the same issue, maybe is another. I do reltime indexer for hbase with Clouder search lily indexer. There are a collection with 3 shards and 6 replications . Fortunately, It is correct that the numfound of index documents when I query . After the reltime indexer executing. I do index with hbase-indexer-mr-1.5-*-job.jar , and the issue come on. the numfound of query become very strange. the numfound is 80. the numfound should be 40, since the hbase table is just 40 rows. the below is result fo query that I do as your metioned. http://oddev05.dev1.fn:8983/solr/test_lily_solr_shard1_replica2/select?q=*:*&distrib=false <result name="response" numFound="28" start="0">
http://oddev03.dev1.fn:8983/solr/test_lily_solr_shard1_replica1/select?q=*:*&distrib=false <result name="response" numFound="28" start="0">
http://oddev03.dev1.fn:8983/solr/test_lily_solr_shard2_replica2/select?q=*:*&distrib=false <result name="response" numFound="28" start="0">
http://oddev04.dev1.fn:8983/solr/test_lily_solr_shard2_replica1/select?q=*:*&distrib=false <result name="response" numFound="28" start="0">
http://oddev04.dev1.fn:8983/solr/test_lily_solr_shard3_replica2/select?q=*:*&distrib=false <result name="response" numFound="24" start="0">
http://oddev05.dev1.fn:8983/solr/test_lily_solr_shard3_replica1/select?q=*:*&distrib=false <result name="response" numFound="24" start="0">
*the total of the numfound of the 3 shards is 80 *
http://oddev04.dev1.fn:8983/solr/test_lily_solr/select?q=*:*&start=0&rows=100 <result name="response" numFound="40" start="0" maxScore="1.0"> *correct*
http://oddev04.dev1.fn:8983/solr/test_lily_solr/select?q=*:*&start=0&rows=10 <result name="response" numFound="80" start="0" maxScore="1.0">
http://oddev04.dev1.fn:8983/solr/test_lily_solr/select?q=*:* <result name="response" numFound="80" start="0" maxScore="1.0"> I google got: Preventing the problem is easy -- always index documents onto the correct shard. I think maybe it's right. But how to index documents onto the correct and same shard with lily and mapreduce? I would like to know more keys. Thank you
... View more
05-04-2017
08:02 AM
@Matt Clarke Thanks.
... View more
04-07-2017
05:18 AM
HI, We work on NIFI 1.0.0.2.0.0.0-579(HDF) with 3 nodes. The cluster work fine almost 4 months until 3 days ago. The behavior is the node suddenly disconnected and connected, and the primary node and coordinator node changed often. What is the cause? cannot connect the zookeeper? or heavy-load? or another? The below is the common errors: -------------------------------------- 2017-04-07 11:22:44,055 ERROR [Leader Election Notification Thread-4] o.a.c.f.recipes.leader.LeaderSelector The leader threw an exception
java.lang.InterruptedException: null
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1326) ~[na:1.8.0_92]
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) ~[na:1.8.0_92]
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:325) ~[curator-client-2.11.0.jar:na] ----------------------------------------- 2017-04-07 10:34:33,416 ERROR [Leader Election Notification Thread-1] o.a.c.f.recipes.leader.LeaderSelector The leader threw an exception
java.lang.IllegalMonitorStateException: You do not own the lock: /nifi/leaders/Cluster Coordinator
at org.apache.curator.framework.recipes.locks.InterProcessMutex.release(InterProcessMutex.java:140) ~[curator-recipes-2.11.0.jar:na] --------------------------------------------- 2017-04-07 09:14:26,386 ERROR [Leader Election Notification Thread-4] o.a.c.f.recipes.leader.LeaderSelector The leader threw an exception
java.lang.IllegalMonitorStateException: You do not own the lock: /nifi/leaders/Primary Node ----------------------------------- 2017-04-06 16:28:31,555 ERROR [Curator-Framework-0] o.a.c.f.imps.CuratorFrameworkImpl Background operation retry gave up
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
at org.apache.curator.framework.imps.CuratorFrameworkImpl.checkBackgroundRetry(CuratorFrameworkImpl.java:728) [curator-framework-2.11.0.jar:na]
... View more
Labels:
- Labels:
-
Apache NiFi
11-22-2016
07:00 AM
Thanks for your response. For me I cannot got the first step of client secret key, there is not CN<something_you_typed>_OU=ApacheNiFi.p12 file , I just do the second step : keytool -importkeystore -srckeystore <keystore.jks> -destkeystore keystore.p12 -deststoretype PKCS12
openssl pkcs12 -in keystore.p12 -out nifi-01.pem -nodes
So I put the nifi-01.pem to : conn=httplib.HTTPSConnection('nifi-test01.beta1.fn', 9091, key_file=None, cert_file="nifi-01.pem")
and it works. BTW , I really don't need to put username and password and I can access the rest get api. Of course, I did not to use post or delete api, is it the correct behavior? Thanks again.
... View more
11-21-2016
12:49 PM
HI, We have a kerberos enabled FDT cluster, I want to access the nifi api through https of python. But I cannot got it. I don't know how to put the parameter, self.key, and self.cert: how to get the private key, and the certificate chain. httplib.HTTPSConnection(host,key_file=self.key,cert_file=self.cert,timeout=timeout)
there is my https config nifi-cofig.png Could you give me any point. Thanks. Paul
... View more
Labels:
- Labels:
-
Apache NiFi