Member since
08-10-2018
21
Posts
0
Kudos Received
0
Solutions
09-10-2018
12:05 PM
@Chiran Ravani Thank you, Can you refer me a configuration and package details for ODBC Connectivity? give me an Example Code for the hive and PHP ODBC connectivity. I referred this link also https://cwiki.apache.org/confluence/display/Hive/HiveODBC but, I can't able to connect with Hive Properly.
... View more
09-07-2018
06:39 AM
Hello, I have 4 node HDPcluster .in that second node I installed Hiveserver2 and apache lamp server. What are all the configurations should I give for thrift PHP and Hive. I want to know the prerequisites for thrift with hive and steps to connect hive and php
... View more
Labels:
- Labels:
-
Apache Hive
09-05-2018
01:16 PM
Hi, I already metioned nifi.web.http(s).host=(my server ip) in nifi.properties. But problem still remains same. I mentioned my IP insteead of my FQDN.
... View more
09-05-2018
01:07 PM
i am running NiFi on ambari server, at the starting time i am getting this error. As per your response, which file port or what to be changed in system. Bcz i did not understand your answer. And in my /etc/hosts i configured 4 host server ip with FQDN I am running NiFi only one Host and so how it can communicate to another process(main application) where to find out second NiFi process in ambari. I downloaded NiFi-1.6.0 on 1 host and it was configured. @Matt Clarke
... View more
09-05-2018
06:32 AM
NIFI START: bin]# ./nifi.sh start Java home: /usr/jdk64/jdk1.8.0_112/ NiFi home: /usr/src/nifi-1.7.1 Bootstrap Config File: /usr/src/nifi-1.7.1/conf/bootstrap.conf bin]# NIFI BOOTSTRAP.log 2018-09-05 06:13:50,068 INFO [main] o.a.n.b.NotificationServiceManager Successfully loaded the following 0 services: [] 2018-09-05 06:13:50,083 INFO [main] org.apache.nifi.bootstrap.RunNiFi Registered no Notification Services for Notification Type NIFI_STARTE D 2018-09-05 06:13:50,083 INFO [main] org.apache.nifi.bootstrap.RunNiFi Registered no Notification Services for Notification Type NIFI_STOPPE D 2018-09-05 06:13:50,083 INFO [main] org.apache.nifi.bootstrap.RunNiFi Registered no Notification Services for Notification Type NIFI_DIED 2018-09-05 06:13:50,087 INFO [main] org.apache.nifi.bootstrap.Command Apache NiFi is not currently running 2018-09-05 06:14:24,885 INFO [main] o.a.n.b.NotificationServiceManager Successfully loaded the following 0 services: [] 2018-09-05 06:14:24,889 INFO [main] org.apache.nifi.bootstrap.RunNiFi Registered no Notification Services for Notification Type NIFI_STARTE D 2018-09-05 06:14:24,889 INFO [main] org.apache.nifi.bootstrap.RunNiFi Registered no Notification Services for Notification Type NIFI_STOPPE D 2018-09-05 06:14:24,889 INFO [main] org.apache.nifi.bootstrap.RunNiFi Registered no Notification Services for Notification Type NIFI_DIED 2018-09-05 06:14:25,019 INFO [main] org.apache.nifi.bootstrap.Command Starting Apache NiFi... 2018-09-05 06:14:25,020 INFO [main] org.apache.nifi.bootstrap.Command Working Directory: /usr/src/nifi-1.7.1 2018-09-05 06:14:25,020 INFO [main] org.apache.nifi.bootstrap.Command Command: /usr/jdk64/jdk1.8.0_112/bin/java -classpath /usr/src/nifi-1. 7.1/./conf:/usr/src/nifi-1.7.1/./lib/jcl-over-slf4j-1.7.25.jar:/usr/src/nifi-1.7.1/./lib/nifi-nar-utils-1.7.1.jar:/usr/src/nifi-1.7.1/./lib /log4j-over-slf4j-1.7.25.jar:/usr/src/nifi-1.7.1/./lib/nifi-properties-1.7.1.jar:/usr/src/nifi-1.7.1/./lib/jul-to-slf4j-1.7.25.jar:/usr/src /nifi-1.7.1/./lib/nifi-runtime-1.7.1.jar:/usr/src/nifi-1.7.1/./lib/javax.servlet-api-3.1.0.jar:/usr/src/nifi-1.7.1/./lib/nifi-framework-api -1.7.1.jar:/usr/src/nifi-1.7.1/./lib/jetty-schemas-3.1.jar:/usr/src/nifi-1.7.1/./lib/logback-classic-1.2.3.jar:/usr/src/nifi-1.7.1/./lib/lo gback-core-1.2.3.jar:/usr/src/nifi-1.7.1/./lib/slf4j-api-1.7.25.jar:/usr/src/nifi-1.7.1/./lib/nifi-api-1.7.1.jar -Dorg.apache.jasper.compil er.disablejsr199=true -Xmx512m -Xms512m -Djavax.security.auth.useSubjectCredsOnly=true -Djava.security.egd=file:/dev/urandom -Dsun.net.http .allowRestrictedHeaders=true -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -XX:+UseG1GC -Djava.protocol.handler.pkgs=sun.net.www .protocol -Dnifi.properties.file.path=/usr/src/nifi-1.7.1/./conf/nifi.properties -Dnifi.bootstrap.listen.port=18979 -Dapp=NiFi -Dorg.apache .nifi.bootstrap.config.log.dir=/usr/src/nifi-1.7.1/logs org.apache.nifi.NiFi 2018-09-05 06:14:25,097 INFO [main] org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 19438 2018-09-05 06:14:28,120 INFO [main] org.apache.nifi.bootstrap.RunNiFi NiFi never started. Will not restart NiFi NIFI-APP.log logs]# cat nifi-app.log 2018-09-05 06:14:26,418 INFO [main] org.apache.nifi.NiFi Launching NiFi... 2018-09-05 06:14:27,546 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Determined default nifi.properties path to be '/usr/src/nifi-1 .7.1/./conf/nifi.properties' 2018-09-05 06:14:27,551 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Loaded 148 properties from /usr/src/nifi-1.7.1/./conf/nifi.pro perties 2018-09-05 06:14:27,558 INFO [main] org.apache.nifi.NiFi Loaded 148 properties 2018-09-05 06:14:27,581 INFO [main] org.apache.nifi.BootstrapListener Started Bootstrap Listener, Listening for incoming requests on port 2 4264 2018-09-05 06:14:27,587 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.net.ConnectException: Connection refused (Conn ection refused) java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at org.apache.nifi.BootstrapListener.sendCommand(BootstrapListener.java:100) at org.apache.nifi.BootstrapListener.start(BootstrapListener.java:83) at org.apache.nifi.NiFi.<init>(NiFi.java:102) at org.apache.nifi.NiFi.<init>(NiFi.java:71) at org.apache.nifi.NiFi.main(NiFi.java:292) 2018-09-05 06:14:27,594 INFO [Thread-1] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2018-09-05 06:14:27,594 INFO [Thread-1] org.apache.nifi.NiFi Jetty web server shutdown completed (nicely or otherwise). NOTE :I already tried this following configuration. 1. My java path is correct 2.etc/hosts are also correct 3.nifi.properties http.port is 8090 I installed NIFI without Ambari in centos but, I am using Ambari on the same server already I did wget <repo>from apache NIFI and extracted in to the /usr/src/ folder
... View more
Labels:
- Labels:
-
Apache NiFi
08-25-2018
05:31 AM
when i tried to run nifi bin]# ./nifi.sh start Java home: /usr/jdk64/jdk1.8.0_112/ NiFi home: /usr/src/nifi-1.6.0 Bootstrap Config File: /usr/src/nifi-1.6.0/conf/bootstrap.conf bin]# nifi.app.log 2018-08-25 05:04:09,166 INFO [main] org.apache.nifi.NiFi Launching NiFi... 2018-08-25 05:04:09,452 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Determined default nifi.properties path to be '/usr/src/nifi-1.6.0/./conf/nifi.properties' 2018-08-25 05:04:09,455 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Loaded 146 properties from /usr/src/nifi-1.6.0/./conf/nifi.properties 2018-08-25 05:04:09,462 INFO [main] org.apache.nifi.NiFi Loaded 146 properties 2018-08-25 05:04:09,470 INFO [main] org.apache.nifi.BootstrapListener Started Bootstrap Listener, Listening for incoming requests on port 45601 2018-08-25 05:04:09,475 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.net.ConnectException: Connection refused (Connection refused) java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at org.apache.nifi.BootstrapListener.sendCommand(BootstrapListener.java:100) at org.apache.nifi.BootstrapListener.start(BootstrapListener.java:83) at org.apache.nifi.NiFi.<init>(NiFi.java:102) at org.apache.nifi.NiFi.<init>(NiFi.java:71) at org.apache.nifi.NiFi.main(NiFi.java:292) 2018-08-25 05:04:09,475 INFO [Thread-1] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2018-08-25 05:04:09,476 INFO [Thread-1] org.apache.nifi.NiFi Jetty web server shutdown completed (nicely or otherwise). 2018-08-25 05:18:38,994 INFO [main] org.apache.nifi.NiFi Launching NiFi... 2018-08-25 05:18:39,278 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Determined default nifi.properties path to be '/usr/src/nifi-1.6.0/./conf/nifi.properties' 2018-08-25 05:18:39,281 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Loaded 146 properties from /usr/src/nifi-1.6.0/./conf/nifi.properties 2018-08-25 05:18:39,289 INFO [main] org.apache.nifi.NiFi Loaded 146 properties 2018-08-25 05:18:39,297 INFO [main] org.apache.nifi.BootstrapListener Started Bootstrap Listener, Listening for incoming requests on port 42511 2018-08-25 05:18:39,301 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.net.ConnectException: Connection refused (Connection refused) java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at org.apache.nifi.BootstrapListener.sendCommand(BootstrapListener.java:100) at org.apache.nifi.BootstrapListener.start(BootstrapListener.java:83) at org.apache.nifi.NiFi.<init>(NiFi.java:102) at org.apache.nifi.NiFi.<init>(NiFi.java:71) at org.apache.nifi.NiFi.main(NiFi.java:292) 2018-08-25 05:18:39,302 INFO [Thread-1] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2018-08-25 05:18:39,302 INFO [Thread-1] org.apache.nifi.NiFi Jetty web server shutdown completed (nicely or otherwise). 2018-08-25 05:25:03,091 INFO [main] org.apache.nifi.NiFi Launching NiFi... 2018-08-25 05:25:03,443 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Determined default nifi.properties path to be '/usr/src/nifi-1.6.0/./conf/nifi.properties' 2018-08-25 05:25:03,446 INFO [main] o.a.nifi.properties.NiFiPropertiesLoader Loaded 146 properties from /usr/src/nifi-1.6.0/./conf/nifi.properties 2018-08-25 05:25:03,453 INFO [main] org.apache.nifi.NiFi Loaded 146 properties 2018-08-25 05:25:03,462 INFO [main] org.apache.nifi.BootstrapListener Started Bootstrap Listener, Listening for incoming requests on port 34170 2018-08-25 05:25:03,466 ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to java.net.ConnectException: Connection refused (Connection refused) java.net.ConnectException: Connection refused (Connection refused) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:589) at java.net.Socket.connect(Socket.java:538) at org.apache.nifi.BootstrapListener.sendCommand(BootstrapListener.java:100) at org.apache.nifi.BootstrapListener.start(BootstrapListener.java:83) at org.apache.nifi.NiFi.<init>(NiFi.java:102) at org.apache.nifi.NiFi.<init>(NiFi.java:71) at org.apache.nifi.NiFi.main(NiFi.java:292) 2018-08-25 05:25:03,467 INFO [Thread-1] org.apache.nifi.NiFi Initiating shutdown of Jetty web server... 2018-08-25 05:25:03,467 INFO [Thread-1] org.apache.nifi.NiFi Jetty web server shutdown completed (nicely or otherwise). nifi-boostrap.log /nifi.properties -Dnifi.bootstrap.listen.port=35814 -Dapp=NiFi -Dorg.apache.nifi.bootstrap.config.log.dir=/usr/src/nifi-1.6.0/logs org.apache.nifi.NiFi
2018-08-25 05:25:02,775 INFO [main] org.apache.nifi.bootstrap.Command Launched Apache NiFi with Process ID 3121
2018-08-25 05:25:03,777 INFO [main] org.apache.nifi.bootstrap.RunNiFi NiFi never started. Will not restart NiFi
... View more
Labels:
- Labels:
-
Apache NiFi
08-20-2018
04:41 AM
HDP-2.6.3.0 NIFI 1.60 How to insert data into the hive table from Kafka consumer? KafkaConsumer ----->PutHiveQL
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Kafka
-
Apache NiFi
08-17-2018
12:25 PM
I want to store GPS device data with Device---->mqtt ---> kafka-----> to both (cassandra and hive) I am using --------> HDP-2.6.3.0 NIFI 1.60 1.which processors i want to choose for this flow? 2.for this version this flow will work? 3.i am getting raw data from the device .how to store that raw data into cassandra table and hdfs table?..
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi
08-16-2018
12:30 PM
i too wanted it
... View more
08-10-2018
01:29 PM
I am listening data from GPS devices I want to listen this datas into ListenTCP . Problem is 1.Device is sending data through only TCP 2.ListenTCP is not listening that data. If you have any other alternative solutions also let me know for how to listen TCP data?
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache NiFi
- « Previous
-
- 1
- 2
- Next »