About b_arshad

b_arshad · ‎02-20-2017

I am trying to populate data from mysql to view in Atlas via Sqoop. I tried the following link: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.5.3/bk_data-access/content/using_sqoop_to_move_data_into_hive.html I ran the following command: sqoop import --connect jdbc:mysql://localhost:3306/saliva --table saliva_test and it resulted in the following error: 17/02/20 16:13:39 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6 17/02/20 16:13:39 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. 17/02/20 16:13:39 INFO tool.CodeGenTool: Beginning code generation Exception in thread "main" java.lang.UnsupportedClassVersionError: com/mysql/jdbc/Driver : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:803) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:442) at java.net.URLClassLoader.access$100(URLClassLoader.java:64) at java.net.URLClassLoader$1.run(URLClassLoader.java:354) at java.net.URLClassLoader$1.run(URLClassLoader.java:348) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:347) at java.lang.ClassLoader.loadClass(ClassLoader.java:425) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:358) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:195) at org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:854) at org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:744) at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:767) at org.apache.sqoop.manager.SqlManager.getColumnInfoForRawQuery(SqlManager.java:270) at org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:241) at org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:227) at org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:295) at org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1833) at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1645) at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:107) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478) at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605) at org.apache.sqoop.Sqoop.run(Sqoop.java:143) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227) at org.apache.sqoop.Sqoop.main(Sqoop.java:236) Can you kindly suggest how to fix the issue? Thanking you in anticipation.

b_arshad · ‎02-20-2017

@Ayub Khan When I try checking its status with the command mentioned above I am getting the following: * Hostname was NOT found in DNS cache * Trying 127.0.0.1... * Connected to localhost (127.0.0.1) port 21000 (#0) > GET /api/atlas/admin/version HTTP/1.1 > User-Agent: curl/7.35.0 > Host: localhost:21000 > Accept: */* > * Empty reply from server * Connection #0 to host localhost left intact curl: (52) Empty reply from server Trying to load quick start model is giving me the same exception as above.

b_arshad · ‎02-19-2017

I have installed an embedded hbase and solr installation of Atlas and when I tried to run bin/quick_start.py I am getting the following error: Creating sample types: Exception in thread "main" com.sun.jersey.api.client.ClientHandlerException: java.net.SocketException: Connection reset at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:155) at com.sun.jersey.api.client.filter.HTTPBasicAuthFilter.handle(HTTPBasicAuthFilter.java:105) at com.sun.jersey.api.client.Client.handle(Client.java:652) at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682) at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74) at com.sun.jersey.api.client.WebResource$Builder.method(WebResource.java:634) at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:297) at org.apache.atlas.AtlasBaseClient.callAPIWithResource(AtlasBaseClient.java:287) at org.apache.atlas.AtlasBaseClient.callAPI(AtlasBaseClient.java:430) at org.apache.atlas.AtlasTypedefClientV2.createAtlasTypeDefs(AtlasTypedefClientV2.java:171) at org.apache.atlas.examples.QuickStartV2.createTypes(QuickStartV2.java:196) at org.apache.atlas.examples.QuickStartV2.runQuickstart(QuickStartV2.java:143) at org.apache.atlas.examples.QuickStartV2.main(QuickStartV2.java:128) Caused by: java.net.SocketException: Connection reset at java.net.SocketInputStream.read(SocketInputStream.java:197) at java.net.SocketInputStream.read(SocketInputStream.java:122) at java.io.BufferedInputStream.fill(BufferedInputStream.java:235) at java.io.BufferedInputStream.read1(BufferedInputStream.java:275) at java.io.BufferedInputStream.read(BufferedInputStream.java:334) at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:690) at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:633) at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:661) at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1371) at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:468) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:253) at com.sun.jersey.client.urlconnection.URLConnectionClientHandler.handle(URLConnectionClientHandler.java:153) ... 12 more No sample data added to Apache Atlas Server. I am using the username and password 'admin'. Can you kindly suggest what might be going wrong? Thanking you in anticipation. @Ayub Khan any suggestions since you are my first point of contact for Atlas.

b_arshad · ‎02-16-2017

@Ned Shawa I tried to follow the example above to import a csv file named drivers. hbase(main):001:0> hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.separator=, –Dimporttsv.columns=”HBASE_ROW_KEY,driver_id,driver_name,certified,wage_plan” drivers /home/bilal/drivers.csv SyntaxError: (hbase):1: syntax error, unexpected ',' hbase org.apache.hadoop.hbase.mapreduce.ImportTsv -Dimporttsv.separator=, ^ I am getting the following SyntaxError unexpected ','. Would you be kind enough to suggest the solution? Thanking you in anticipation.

b_arshad · ‎02-16-2017

@Ayub Khan any suggestions Sir?

b_arshad · ‎02-16-2017

I am trying to install Apache Atlas with external Hbase and Solr using the following link: http://atlas.incubator.apache.org/InstallationSteps.html When i tried installing solr, it worked fine when i start the solr using the command: solr/bin/solr start -c -z localhost:2181 -p 8983 In order to create collections I entered the following command: solr/bin/solr create -c vertex_index -d /home/atlas/incubator-atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/solr/server/solr/configsets/basic_configs/conf -shards 1 -replicationFactor 1 but got the following issue: Specified configuration directory /home/atlas/incubator-atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/solr/server/solr/configsets/basic_configs/conf not found! When I tried to access the above mentioned folder it did contain the configuration file, not sure why the system is issuing the error. Any help would be highly appreciated. Note: /home/atlas/incubator-atlas/distro/target/apache-atlas-0.8-incubating-SNAPSHOT-bin/apache-atlas-0.8-incubating-SNAPSHOT/solr/server/solr/configsets/basic_configs/conf contains the following files: currency.xml lang protwords.txt _rest_managed.json schema.xml solrconfig.xml stopwords.txt synonyms.txt

b_arshad · ‎02-13-2017

Thank you @Ayub Khan, I am using an embedded hbase-solr configuration of Atlas so I presume I need to set the configurations manually.

b_arshad · ‎02-13-2017

@anaik thank you for the response. Would you be kind enough to provide a step by step guide on how to import metadata from mySQL database to Atlas if possible?

b_arshad · ‎02-13-2017

@Vadim Vaks would you be kind enough to provide the implementation details for the above? Thanking you in anticipation.

b_arshad · ‎02-13-2017

I am a complete newbie to Apache Atlas and HBase. Need to display/browse metadata from a sample HBase table using Apache Atlas, any ideas where to begin with? I have an embedded hbase and solr installation of Apache Atlas on a VM. Any suggestions would be highly appreciated! Kind Regards

Online	Offline
Last Visited	‎09-20-2017 02:30 PM

Member Since	‎10-31-2016 06:10 PM
Last Visited	‎09-20-2017 02:30 PM
Posts	62
Kudos received	3

Cloudera Community

Populating data from mysql to Atlas via Sqoop

Re: Exception in thread main - connection reset

Exception in thread main - connection reset

Re: Import CSV data into HBase using importtsv

Re: Specified Configuration Directory Not Found - ...

Specified Configuration Directory Not Found - SOLR...

Re: Populate metadata repository from RDBMS in Apa...

Re: Populate metadata repository from RDBMS in Apa...

Re: Populate metadata repository from RDBMS in Apa...

Display/browse metadata from a sample hbase table ...