Hi, HDP 2.3.4.0 cluster in 4 nodes has been set up and it is working fine. We are trying to evaluate Atlas using demo in below link: https://github.com/shivajid/atlas/tree/master/tutorial We are facing issue while using Sqoop during execution of above demo. Full description of issue is as below: 1) Sqoop and MySql databases are in different hosts. 2) MySql jar is in both the hosts and also in lib folder of sqoop home /usr/hdp/2.3.4.0-3485/sqoop/lib/ 3) Have provided below privilege in MySql to avoid privilege issues: grant all privileges on *.* to 'trucker1'@'%' identified by 'trucker'; flush privileges; 4) Now trying to import data using below command: sqoop import --connect jdbc:mysql://3.209.124.206:3306/test --username trucker1 --password trucker --table DRIVERS -m 1 --target-dir demo$1 --hive-import --hive-table hortondrivers$1 5) Facing below error when executing above command. 16/02/19 18:20:45 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead. 16/02/19 18:20:45 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. 16/02/19 18:20:45 INFO tool.CodeGenTool: Beginning code generation 16/02/19 18:20:45 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver java.lang.RuntimeException: Could not load db driver class: com.mysql.jdbc.Driver at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:636) at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:525) at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:548) at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:191) at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:175) at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:262) at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235) at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060) at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:390) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476) at org.apache.sqoop.Sqoop.run(Sqoop.java:145) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) at org.apache.sqoop.Sqoop.main(Sqoop.java:238) at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) Looking for your help as we need to understand how Atlas work for data governance. Thanks! ... View more

Hi, We have built HDP 2.3.4.0 cluster using Ambari and the cluster is working fine. We would like to set up Nagios and Ganglia in that cluster. Can you please relevant steps to achieve the same? Thanks! ... View more

I am facing below issue while using Hive view from Ambari console: E090 HDFS020 Could not write file /user/admin/hive/jobs/hive-job-3-2016-02-12_12-55/query.hql [HdfsApiException] Searching through the guides I found out that HDFS user directory set up needs to be done. Following that guide am issuing command hadoop fs -mkdir /user/admin from HDFS user but it throws the below error. -bash-4.1$ hadoop fs -mkdir /user/admin mkdir: `/user/admin': Input/output error Need your help on this issue. Note : Using HDP 2.3.4.0 and it was configured using Amabri and also in that host HDFS client is running. ... View more

We have configured HDP 2.3.4.0 with Ambari in CentOS 6.4. Post installation we can see that the Hive Metastore service is getting stopped everytime it is started through Ambari. We had chosen MySQL for Hive metastore but in logs we can see it tries to connect with Derby. Looking for your help. ... View more