Member since
12-26-2017
40
Posts
9
Kudos Received
0
Solutions
01-04-2019
07:16 AM
Thanks @Matt Clarke for quick repl. As per "nifi-bootstrap.log" i am getting ################## org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 21089 org.apache.nifi.bootstrap.RunNiFi NiFi never started. Will not restart NiFi o.a.n.b.NotificationServiceManager Successfully loaded the following 0 services: [] org.apache.nifi.bootstrap.Command Apache NiFi is not running As per "nifi-app.log" i am getting ##################### ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.net.ConnectException: Connection refused (Connection refused) java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at org.apache.nifi.BootstrapListener.sendCommand(BootstrapListener.java:100) at org.apache.nifi.BootstrapListener.start(BootstrapListener.java:83) at org.apache.nifi.NiFi.<init>(NiFi.java:102) at org.apache.nifi.NiFi.<init>(NiFi.java:71) at org.apache.nifi.NiFi.main(NiFi.java:296) 2019-01-03 10:14:26,252 INFO [Thread-1] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2019-01-03 10:14:26,253 INFO [Thread-1] org.apache.nifi.NiFi Jetty web server shutdown completed (nicely or otherwise). 2019-01-03 10:20:48,165 INFO [main] org.apache.nifi.NiFi Launching NiFi... 2019-01-03 10:20:48,509 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Determined default nifi.properties path to be '/root/nifi-1.8.0/./conf/nifi.properties' Now could you ple suggest where to and what to change in properties files. Thanks.
... View more
01-03-2019
10:42 AM
Hi, I am running NiFi on centos-7, but its not running. I tried many times but the same issue came. I used command ./bin/nifi.sh restart and the output came "org.apache.nifi.bootstrap.Command Apache NiFi is not running" . If i am missing anything pls let me know. Java home: /usr/lib/jvm/java-1.8.0-openjdk NiFi home: /root/nifi-1.8.0 Thanks.
... View more
Labels:
- Labels:
-
Apache NiFi
10-09-2018
07:06 AM
@Jay Kumar SenSharma Thanks for your quick reply. I tried telnet $HS 10000 and nc -v $HS 10000, but nothing is coming. When i run the command "nc -v $HS Host 10000", i got only this Ncat: Version 7.50 ( https://nmap.org/ncat ) Ncat: Connection refused. Then tried netstat -tnlpa | grep 10000 but nothing is coming. When i run i got below error ls -l /var/log/hive/hiveserver2.log Caused by: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=10096, maxMemory=7936. Could you pls let me know more about it.
... View more
10-09-2018
05:20 AM
Hi, I installed HiveServer2 on ambari 2.6. Whlie accessing hive through terminal or webUI, its not working. The error is comming Error: Could not open client transport with JDBC Url: jdbc:hive2://ip:10000/transportMode=binary:Java.net.ConnectionException (Connection Refused). SET hive.exec.dynamic.partition = true; SET hive.exec.dynamic.partition.mode = nonstrict; SET hive.exec.max.dynamic.partitions = 10000; SET hive.exec.max.dynamic.partitions.pernode = 1000; these are the configuration which is available on config file. Could anybody help regarding this issue would be great. Thanks.
... View more
Labels:
- Labels:
-
Apache Hive
09-25-2018
12:47 PM
@Geoffrey Shelton Okot it is also taking the same time. I run query select count(ayx) from test_table. It took 17 Sec. and while i run select count(1) from test_table, the time remains same. Could you please explore more about hive query fast processing. Thanks
... View more
09-08-2018
06:51 AM
Hi thanks for quick reply @Felix Albani I tried but i didn't find out any way to connect. I am getting below error. Opened transport
Fatal error: Uncaught exception
'Thrift\Exception\TApplicationException' with message 'Invalid method
name: 'OpenSession'' in
/var/www/html/hs2/hive/org/apache/hive/service/cli/thrift/TCLIService.php:89
Stack trace:
#0
/var/www/html/hs2/hive/org/apache/hive/service/cli/thrift/TCLIService.php(56):
org\apache\hive\service\cli\thrift\TCLIServiceClient->recv_OpenSession()
#1 /var/www/html/hs2/HS2Client.php(40):
org\apache\hive\service\cli\thrift\TCLIServiceClient->OpenSession(Object(org\apache\hive\service\cli\thrift\TOpenSessionReq))
#2 {main}
thrown in /var/www/html/hs2/hive/org/apache/hive/service/cli/thrift/TCLIService.php on line 89 Could you pls let me know any solution.
... View more
09-07-2018
10:17 AM
Hi, I have 4 node HDPcluster . In that second node I installed Hiveserver2 and apache lamp server. I want to connect HiveServer2 to PHP. Is there any way to connect. I tried but unable to resolve the issue. Could anybody suggest any idea or blog. Thanks.
... View more
Labels:
- Labels:
-
Apache Hive
09-06-2018
08:33 AM
Hi @Vincent Jiang, How you solved this issue. Bcz i am facing same issue on Ambari server. could you post your config or solution here. Thanks.
... View more
09-05-2018
12:55 PM
Thanks for such a nice community. I run bin/nifi.sh run and now i am able to run NiFi in background. Thanks @Matt Clarke
... View more
09-05-2018
12:47 PM
sorry @Matt Clarke thanks for quick response. I was missed to put dot(.). I am using NiFi version 1.6.0. And my question is same which you posted.
... View more
09-05-2018
06:50 AM
Hi, I installed NiFi 16.6 is my local system. I want, the NiFi should be working in background after shutdown the system and again starting the system we can directly open it through browser. No need to start again and again. So is there any way in NiFi so that i can make it 24*7 up-time. Help would be great appreciated. Thanks.
... View more
Labels:
- Labels:
-
Apache NiFi
08-29-2018
06:42 AM
Hi @Patrick Maggiulli I tried the same flow, i am putting the data into HBase from HTTP. I have one CSV file that contains field (ID,Movie,Type), In GetFile processor i am taking this file and flow remains same as yours. In UpdateAttribute i am giving schema.name is "MoviesRecord". But getting error in ConvertRecord processor that ConvertRecord is failed to process StandardFlowFileRecord "will route to failure Field field_0 can not be null. " Any help that would be great. Thanks
... View more
08-29-2018
04:10 AM
Thanks for your quick reply. I tried but unable to figure out the problem. The same error occurs while putting data into HBase.
... View more
08-25-2018
05:38 AM
Should i copy all the xml's file from server nifi conf to local nifi conf server nifi/conf/.xml --> local nifi/conf/.xml or which files need to be copy, bcz i did not get actual answer. Pls ...
... View more
08-24-2018
02:08 PM
Hi @Josh Elser I am putting my GPS device data using MQTT to kafka and from kafka to HBase. but i am getting stuck while putting data into HBase. Could you suggest any flow which can help me. MQTT --> Kafka --> HBase or HTTP --> Kafka --> HBase And how to define PutHBaseJSON processor property. I am running NiFi in localhost and i am putting data on cloud ambari HBase. any help it would be great. Thanks.
... View more
08-24-2018
01:12 PM
Hi @Shu I am running NiFi in localhost. I want to store data on server instead of local. So how to define the server property in Hadoop Configuration Resources. Bcz it requires ip address and path of the core-site.xml. If you help it would be great. Thanks, Surendra
... View more
08-17-2018
11:19 AM
Thanks for this great community. could you suggest any work flow to get data from GPS device to cassandra table with using Kafka.
... View more
08-17-2018
11:15 AM
We are using unsecure Kafka connection and not using MiNiFi, instead of that we are using MQTT. this is our NiFi flow ..... MQTT --> PublishKafka --> ConsumeKafka --> PutCassandraQL. What you suggest to use NiFi flow for below process ... MQTT --> PublishKafka --> ConsumeKafka --> PutCassandraQL
... View more
08-17-2018
06:04 AM
Hi @Matt Burgess thanks for your quick response. I tried as per your suggestion but the error remains same. Is there any template related to this.
... View more
08-17-2018
05:35 AM
Hi @dbains, thanks for your quick response. I am using PublishKafka_0_10_1.0.0 processor. and i have given FQDN in kafka property but still getting an error. Do you have any demo template or any further help.
... View more
08-16-2018
12:57 PM
Hi @dbains I am getting the same issue while pulling the data into PublishKafka procesor. My conf for PublishKafka is : Kafka Brokers: ip:6667 Security Protocol: PLAINTEXT Topic Name: test Delivery Guarantee: Best Effort Key Attribute Encoding: UTF-8 Encoded Max Request Size: 1 MB Acknowledgement Wait Time: 5 secs Max Metadata Wait Time: 5 secs It throws the error Failed to update metadata 5000 ms. Could you provide me any solution for this. Thanks you.
... View more
08-16-2018
11:56 AM
1 Kudo
Hi @Timothy Spann, I am doing the same but unable to figure out this problem. Could you share me demo flow for this project. Thank you.
... View more
08-13-2018
11:26 AM
Hi @Matt Burgess thank you for your quick response. I tried as per your comment but problem still remains. Can you go through below attached image. I am not getting data in ConvertJSONToSQL processor. My main objective is to put data into cassandra table through NiFI flow.
... View more
08-10-2018
12:41 PM
I am using ConsumerKafka processor to pull data from putkafka. Now i want to put same data into cassandra table. But i am getting errors. I am using PutCassandraQL processor to put data into cassandra table. Is there any way to put data directly from ConsumerKafka to PutCassandraQL. Response will be appreciated. Thanks.
... View more
Labels:
- Labels:
-
Apache NiFi
02-02-2018
03:55 PM
Thanks @kgautam. I will try the same and let you know.
... View more
01-30-2018
10:39 AM
Hi, I want to use spark memory instead of hard disk. So is their any way to run spark job on memory only. I am getting space error in hard disk so want to run job on memory only not in hard disk.
... View more
Labels:
- Labels:
-
Apache Spark
01-13-2018
05:51 AM
2 Kudos
Thanks @Shu For such a nice help.
... View more
01-13-2018
05:03 AM
1 Kudo
Thanks for your overwhelming response, this will help me a great.
... View more
01-13-2018
03:42 AM
1 Kudo
Thanks @shu for your reply ... and I am looking for the same output which you send me. I want the output in CSV file like Surendra,24,Chennai,TN,24. And output will stored in local machine only.
... View more