Member since
07-07-2016
19
Posts
5
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1049 | 09-01-2016 08:04 AM |
06-19-2017
06:45 AM
1 Kudo
In my case I was able to connect to mysql from terminal using user hive [mysql -u hive -p] . So I was sure that the issue was happening only when trying to connect to mysql programatically using JDBC driver. But when tried to establish connection from java then also got the 'Communications link failure' . But once I replace the server name FQDN in JDBC url with 127.0.0.1 the problem is gone. Alternately I change the value of 'bind-address' in the mysql configuration file /etc/mysql/mysql.conf.d/mysqld.cnf to '0.0.0.0'. Then the connection got established even with server FQDN in JDBC url.
... View more
06-18-2017
04:57 PM
1 Kudo
There are 2 solutions to this : 1. Change the value of 'bind-address' in the mysql configuration file /etc/mysql/mysql.conf.d/mysqld.cnf to '0.0.0.0'
cd /etc/mysql/mysql.conf.d
gedit mysqld.cnf
2. Change the mysql server hostname with IP address in the 'Metastore connection URL'. So in your case change 'jdbc:mysql://adrien.cluster/hive?createDatabaseIfNotExist=true' to 'jdbc:mysql://127.0.0.1/hive?createDatabaseIfNotExist=true'. If the ip address is different from 127.0.0.1 then please use that.
... View more
05-21-2017
08:09 AM
thanks for the resolution. this resolved the falcon issue after upgrading to HDP-2.6.0.3 .
... View more
03-20-2017
04:27 PM
@Namit MaheshwariThank you very much for the guidance and appropriate answer. With the above settings the issue got resolved.
... View more
03-19-2017
03:33 PM
I guess there is some problem with Tez config. As when I execute by checking ''Execute on Tez" it hungs and when unchecked (running as MapReduce) it works fine (attaching the log while executed as MapReduce).pig-script-success-when-exec-as-mapreduce.txt
... View more
03-19-2017
02:59 PM
Thanks for replying. Attaching the yarn log retrieved from shell.
... View more
03-18-2017
06:26 PM
pig-script-error.txt I'm trying to execute a pig script from Hortontonworks tutorial "Lab 3 - Pig Risk Factor Analysis Introduction". I'm trying with 'Execute on Tez' option checked. But the script shows running for long time and finally I had to kill the job (after more than 30Mins of execution). I did syntax check before executing and no errors found. I didn't executed the script from shell yet. Does anybody give me an idea that what might be causing this issue ? Attached is the log and the script as as below : a = LOAD 'geolocation' USING org.apache.hive.hcatalog.pig.HCatLoader();
b = FILTER a BY event != 'normal';
c = FOREACH b GENERATE driverid, event, (int) '1' as occurance;
d = GROUP c BY driverid;
e = FOREACH d GENERATE group as driverid, SUM(c.occurance) as t_occ;
g = LOAD 'driver_mileage' USING org.apache.hive.hcatalog.pig.HCatLoader();
h = JOIN e BY driverid, g BY driverid;
final_data = foreach h generate $0 as driverid, $1 as events, $3 as totmiles, (float) $3/$1 as riskfactor;
STORE final_data INTO 'riskfactor' using org.apache.hive.hcatalog.pig.HCatStorer();
... View more
Labels:
- Labels:
-
Apache Pig
-
Apache Tez
09-05-2016
02:20 PM
Hi @Chakra, After adding all the jars mentioned by you, to build path and executing the program getting error as follows : Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/thrift/transport/TTransportException
at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105)
at java.sql.DriverManager.getConnection(DriverManager.java:664)
at java.sql.DriverManager.getConnection(DriverManager.java:247)
at edu.thenet.pc1.connect.hive.HiveJdbcConnector.main(HiveJdbcConnector.java:27)
Caused by: java.lang.ClassNotFoundException: org.apache.thrift.transport.TTransportException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 4 more Can you please help me to identify which other jars are also required ? Thank you, Subrata
... View more
09-01-2016
08:04 AM
Issue Resolved. The problem was with registering the HDP 2.4 version. While registering the version I entered 2.4 in the text-box (aside the HDP version dropdown) which is wrong. So I deregistered the version and done a new registration and entered 2.0 in the textbox. After that installation gone smooth. Following article was helpful (Step 6) : https://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_upgrading_Ambari/content/_upgrading_HDP_register_target_version.html
... View more
08-30-2016
08:42 PM
Getting the following error while trying to install HDP-2.4 over Ambari-2.2.x. Attaching the error log and screen-shot. Failure while computing actual version. Error: Could not determine actual version. This stack's root directory (/usr/hdp) exists but was not able to determine the actual repository version installed. Please help with your expert comment. hdp-24-stack-upgradation-error.txthdp-24-stack-upgradation-error.png
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)