Thanks @Matt Clarke for quick repl. As per "nifi-bootstrap.log" i am getting ################## org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 21089 org.apache.nifi.bootstrap.RunNiFi NiFi never started. Will not restart NiFi o.a.n.b.NotificationServiceManager Successfully loaded the following 0 services: [] org.apache.nifi.bootstrap.Command Apache NiFi is not running As per "nifi-app.log" i am getting ##################### ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.net.ConnectException: Connection refused (Connection refused) java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at org.apache.nifi.BootstrapListener.sendCommand(BootstrapListener.java:100) at org.apache.nifi.BootstrapListener.start(BootstrapListener.java:83) at org.apache.nifi.NiFi.<init>(NiFi.java:102) at org.apache.nifi.NiFi.<init>(NiFi.java:71) at org.apache.nifi.NiFi.main(NiFi.java:296) 2019-01-03 10:14:26,252 INFO [Thread-1] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2019-01-03 10:14:26,253 INFO [Thread-1] org.apache.nifi.NiFi Jetty web server shutdown completed (nicely or otherwise). 2019-01-03 10:20:48,165 INFO [main] org.apache.nifi.NiFi Launching NiFi... 2019-01-03 10:20:48,509 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Determined default nifi.properties path to be '/root/nifi-1.8.0/./conf/nifi.properties' Now could you ple suggest where to and what to change in properties files. Thanks. ... View more

Its working fine now . Thank you @Jay Kumar SenSharma ... View more

@Jay Kumar SenSharma Thanks for your quick reply. I tried telnet $HS 10000 and nc -v $HS 10000, but nothing is coming. When i run the command "nc -v $HS Host 10000", i got only this Ncat: Version 7.50 ( https://nmap.org/ncat ) Ncat: Connection refused. Then tried netstat -tnlpa | grep 10000 but nothing is coming. When i run i got below error ls -l /var/log/hive/hiveserver2.log Caused by: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=10096, maxMemory=7936. Could you pls let me know more about it. ... View more

@Geoffrey Shelton Okot it is also taking the same time. I run query select count(ayx) from test_table. It took 17 Sec. and while i run select count(1) from test_table, the time remains same. Could you please explore more about hive query fast processing. Thanks ... View more

Hi thanks for quick reply @Felix Albani I tried but i didn't find out any way to connect. I am getting below error. Opened transport Fatal error: Uncaught exception 'Thrift\Exception\TApplicationException' with message 'Invalid method name: 'OpenSession'' in /var/www/html/hs2/hive/org/apache/hive/service/cli/thrift/TCLIService.php:89 Stack trace: #0 /var/www/html/hs2/hive/org/apache/hive/service/cli/thrift/TCLIService.php(56): org\apache\hive\service\cli\thrift\TCLIServiceClient->recv_OpenSession() #1 /var/www/html/hs2/HS2Client.php(40): org\apache\hive\service\cli\thrift\TCLIServiceClient->OpenSession(Object(org\apache\hive\service\cli\thrift\TOpenSessionReq)) #2 {main} thrown in /var/www/html/hs2/hive/org/apache/hive/service/cli/thrift/TCLIService.php on line 89 Could you pls let me know any solution. ... View more

Hi @Vincent Jiang, How you solved this issue. Bcz i am facing same issue on Ambari server. could you post your config or solution here. Thanks. ... View more

Thanks for such a nice community. I run bin/nifi.sh run and now i am able to run NiFi in background. Thanks @Matt Clarke ... View more

sorry @Matt Clarke thanks for quick response. I was missed to put dot(.). I am using NiFi version 1.6.0. And my question is same which you posted. ... View more

Hi @Patrick Maggiulli I tried the same flow, i am putting the data into HBase from HTTP. I have one CSV file that contains field (ID,Movie,Type), In GetFile processor i am taking this file and flow remains same as yours. In UpdateAttribute i am giving schema.name is "MoviesRecord". But getting error in ConvertRecord processor that ConvertRecord is failed to process StandardFlowFileRecord "will route to failure Field field_0 can not be null. " Any help that would be great. Thanks ... View more

Thanks for your quick reply. I tried but unable to figure out the problem. The same error occurs while putting data into HBase. ... View more

Should i copy all the xml's file from server nifi conf to local nifi conf server nifi/conf/.xml --> local nifi/conf/.xml or which files need to be copy, bcz i did not get actual answer. Pls ... ... View more

Hi @Josh Elser I am putting my GPS device data using MQTT to kafka and from kafka to HBase. but i am getting stuck while putting data into HBase. Could you suggest any flow which can help me. MQTT --> Kafka --> HBase or HTTP --> Kafka --> HBase And how to define PutHBaseJSON processor property. I am running NiFi in localhost and i am putting data on cloud ambari HBase. any help it would be great. Thanks. ... View more

Hi @Shu I am running NiFi in localhost. I want to store data on server instead of local. So how to define the server property in Hadoop Configuration Resources. Bcz it requires ip address and path of the core-site.xml. If you help it would be great. Thanks, Surendra ... View more

Thanks for this great community. could you suggest any work flow to get data from GPS device to cassandra table with using Kafka. ... View more

We are using unsecure Kafka connection and not using MiNiFi, instead of that we are using MQTT. this is our NiFi flow ..... MQTT --> PublishKafka --> ConsumeKafka --> PutCassandraQL. What you suggest to use NiFi flow for below process ... MQTT --> PublishKafka --> ConsumeKafka --> PutCassandraQL ... View more

Hi @Matt Burgess thanks for your quick response. I tried as per your suggestion but the error remains same. Is there any template related to this. ... View more

Hi @dbains, thanks for your quick response. I am using PublishKafka_0_10_1.0.0 processor. and i have given FQDN in kafka property but still getting an error. Do you have any demo template or any further help. ... View more

Hi @dbains I am getting the same issue while pulling the data into PublishKafka procesor. My conf for PublishKafka is : Kafka Brokers: ip:6667 Security Protocol: PLAINTEXT Topic Name: test Delivery Guarantee: Best Effort Key Attribute Encoding: UTF-8 Encoded Max Request Size: 1 MB Acknowledgement Wait Time: 5 secs Max Metadata Wait Time: 5 secs It throws the error Failed to update metadata 5000 ms. Could you provide me any solution for this. Thanks you. ... View more

Hi @Timothy Spann, I am doing the same but unable to figure out this problem. Could you share me demo flow for this project. Thank you. ... View more

Hi @Matt Burgess thank you for your quick response. I tried as per your comment but problem still remains. Can you go through below attached image. I am not getting data in ConvertJSONToSQL processor. My main objective is to put data into cassandra table through NiFI flow. ... View more

Thanks @kgautam. I will try the same and let you know. ... View more

Thanks @Shu For such a nice help. ... View more

Thanks for your overwhelming response, this will help me a great. ... View more

Thanks @shu for your reply ... and I am looking for the same output which you send me. I want the output in CSV file like Surendra,24,Chennai,TN,24. And output will stored in local machine only. ... View more