Hello all   I have 2 tables, first one is CSV file and second one is parquet table. I am selecting and inserting data from first one to second one.    I am inserting data with following sql      insert overwrite header partition (p_tar = 2017112702) select FL_SEQ, REC_SEQ, EVNT_TYP, EVNT_SUB_TYP, Z1, Z2, K12, K24, K44, K45, K49, K53, K54, K66, K67, K68, K91, K92, K93, K94 from sgn.scsv where substr(cast (z2 as string), 1,10)="2017112702";     SQL statement inserted many records but I am getting following error 27 times      WARNINGS: Error converting column: 1 TO INT (Data is: ▒'▒@▒▒) file: hdfs://nahadoop01:8020/grid1/hive/warehouse/sgn.db/scsv/20171127_02.csv record: @[u▒;▒'▒@▒▒;;;;;;;;;;;;;;;;;;;;;;;;; CSV table's first 6 columns like that      Query: describe sgn.scsv +--------------+-----------+---------+ | name | type | comment | +--------------+-----------+---------+ | fl_dt | int | | | fl_seq | int | | | rec_seq | int | | | evnt_typ | int | | | evnt_sub_typ | int | | | z1 | bigint | |   And parquet table is similar to CSV table   Query: describe header +------------------+-----------+ | name | type | +------------------+-----------+ | fl_seq | int | | rec_seq | int | | evnt_typ | int | | evnt_sub_typ | int | | strt_ts | bigint | | end_ts | bigint | I downloaded /grid1/hive/warehouse/sgn.db/scsv/20171127_02.csv file to Linux filesystem and then checked the file contents    There is only one line for error and it's not in first columns   impala@hadoop01:$ grep -n "@\[u" 20171127_02.csv 59404785:20171127;2189;1575;10;220;20171126225552922;20171126225706058;;;;;;;;;;;;;;;;;104;28;31;161;;;;;;;;;;;;;;;;;;;80;47457;;80;60006;;;;;;;;;;;;;;;;158313;610798;2531;339864;802705;966917;4;73075;73136164;7@[u▒;▒'▒@▒▒;;;;;;;;;;;;;;;;;;;;;;;;;32;864;1546;0;;;;Mozilla/5.▒▒oYE=D"▒F▒▒▒ So I am wondering why I am getting same error 27 times if I have one line in csv file ? and more important question is why I am getting this error for "column 1" even column 1 is already has valid data ?     Do you have any idea ?   ... View more

Hello   I am using impalad version 2.2.0-cdh5.4.5 community edition. I have a problem that intermittently occurs.  Some commands' execution takes too long time. The commands are physical database management commands not select, insert commands.    show create table <table name>  (it takes more than 15 mins today, so I terminated with Ctrl+C) create table <table name>, create table <table name> like <other table name> drop table <table name>    (even empty table's drop operation may takes more than 20 mins today, so I had to terminate it too)   There is no error while command executing. Following lines show today's WARNING and ERROR entries in log files. I am not sure the lines are related or not      impala@hdpdnode03:/var/log/impalad$ grep 0725 impalad.ERROR impala@hdpdnode03:/var/log/impalad$ grep 0725 impalad.WARNING java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/10.160.15.142:60725 remote=/10.160.15.142:50010] W0623 05:35:54.195564 58466 DFSInputStream.java:657] Failed to connect to /10.160.15.142:50010 for block, add to deadNodes and continue. java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/10.160.15.142:60725 remote=/10.160.15.142:50010] java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/10.160.15.142:60725 remote=/10.160.15.142:50010] java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/10.160.15.142:60725 remote=/10.160.15.142:50010] W0624 17:34:47.654734 58470 DFSInputStream.java:657] Failed to connect to /10.160.15.142:50010 for block, add to deadNodes and continue. java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/10.160.15.142:60725 remote=/10.160.15.142:50010] java.net.SocketTimeoutException: 60000 millis timeout while waiting for channel to be ready for read. ch : java.nio.channels.SocketChannel[connected local=/10.160.15.142:60725 remote=/10.160.15.142:50010] W0725 00:03:12.909853 58553 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 01:03:15.475993 58517 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 02:03:31.348456 58544 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 03:03:24.569105 58506 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 04:03:17.290172 58533 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 05:03:10.648597 58511 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 06:03:37.333330 58555 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 07:03:17.709178 58515 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 08:03:11.393440 58544 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 09:03:14.093744 58506 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 10:03:20.556089 58523 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 11:03:23.019448 58533 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 12:03:12.509655 58519 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 13:03:14.731720 58509 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 14:03:21.690156 58502 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. W0725 15:03:16.251411 58525 HdfsScanNode.java:784] Per-host mem cost 8.25GB exceeded per-host upper bound 7.50GB. impala@hdpdnode03:/var/log/impalad$     Do you have any idea why I am waiting at this commands ?   Thanks ... View more

Hello    I have csv files and I want to convert them to gzip compressed parquet tables. So I have information about what column must be what type of data and column names(headers) for CSV file. So I have created a parquet table according CSV field information.   And then I tried convert data after set compression_codec=gzip command and used insert overwrite .... command.   When I run the insert commands I got 8 times of following errors whole one day. ( I have to use masking operation for some data so I use *** for data masking)   Error converting column: 15 TO BIGINT (Data is: numbers=lat Error converting column: 18 TO INT (Data is: *** Error converting column: 20 TO INT (Data is: ***) Error converting column: 29 TO INT (Data is: **) Error converting column: 35 TO BIGINT (Data is: Unspecified Error converting column: 49 TO INT (Data is: Unspecified)   But inserted lots of records into parquet table as compressed   When I check the source table and target parquet table, source table has 159183859 but target parquet table has 39328054.  So I have 119855805 records are missing even I got 8 errors while conversion. This lost is very huge and I don't know why   So I tried with csv --> partitioned csv convertion I got same results I mean same lost record numbers   So I am looking for a reason why I lost this number of records. Lost is about %25 of data  Do you have any idea/explanation why I lost this huge data? why I did not got any error other than 8 column conversion errors.   Thanks for your helps Suluhan   ... View more

Hello    I could not start Hive service, I got following error.   I did not change anything on OS and/or Cloudera configuration except legal restriction about timezone. Timezone configuration applied on all Hadoop hosts. The port (10000) was not using, when I try to start Hive service.    Error starting HiveServer2: could not start ThriftBinaryCLIService org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:10000. at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:109) at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:91) at org.apache.thrift.transport.TServerSocket.<init>(TServerSocket.java:87) at org.apache.hive.service.auth.HiveAuthFactory.getServerSocket(HiveAuthFactory.java:244) at org.apache.hive.service.cli.thrift.ThriftBinaryCLIService.run(ThriftBinaryCLIService.java:66) at java.lang.Thread.run(Thread.java:745)       So do you have any idea about problem ?   Best regards         ... View more

Hello    I am inserting (copying) data from parquet table to gzipped parquet table with paralel insert overwrite ... select .. from table statements. Sometimes I get following error. (BTW If I monitor this problem correctly it occurs on copying data that inserting into same table)    My environment is RHEL 6.6,  impalad version 2.2.0-cdh5.4.5 $ java -version java version "1.7.0_65" OpenJDK Runtime Environment (rhel-2.5.1.2.el6_5-x86_64 u65-b17) OpenJDK 64-Bit Server VM (build 24.65-b04, mixed mode)   Is there any way to fix this error ? Should I worry about it ?   Thanks   InternalException: Error updating lastDdlTime CAUSED BY: MetaException: javax.jdo.JDOUserException: Object with id "" is managed by a different persistence manager at org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:549) at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:165) at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:491) at org.apache.hadoop.hive.metastore.ObjectStore.getTable(ObjectStore.java:970) at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:98) at com.sun.proxy.$Proxy2.getTable(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1772) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_core(HiveMetaStore.java:3343) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_with_environment_context(HiveMetaStore.java:3325) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:102) at com.sun.proxy.$Proxy4.alter_table_with_environment_context(Unknown Source) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_table_with_environment_context.getResult(ThriftHiveMetastore.java:9105) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_table_with_environment_context.getResult(ThriftHiveMetastore.java:9089) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) NestedThrowablesStackTrace: Object with id "" is managed by a different persistence manager org.datanucleus.exceptions.NucleusUserException: Object with id "" is managed by a different persistence manager at org.datanucleus.ExecutionContextImpl.detachObject(ExecutionContextImpl.java:2843) at org.datanucleus.ExecutionContextThreadedImpl.detachObject(ExecutionContextThreadedImpl.java:329) at org.datanucleus.store.types.SCOUtils.detachForCollection(SCOUtils.java:1139) at org.datanucleus.store.fieldmanager.DetachFieldManager.internalFetchObjectField(DetachFieldManager.java:177) at org.datanucleus.store.fieldmanager.AbstractFetchDepthFieldManager.fetchObjectField(AbstractFetchDepthFieldManager.java:113) at org.datanucleus.state.JDOStateManager.detach(JDOStateManager.java:3995) at org.datanucleus.ExecutionContextImpl.performDetachAllOnTxnEnd(ExecutionContextImpl.java:4610) at org.datanucleus.ExecutionContextImpl.postCommit(ExecutionContextImpl.java:4709) at org.datanucleus.ExecutionContextImpl.transactionCommitted(ExecutionContextImpl.java:659) at org.datanucleus.TransactionImpl.internalPostCommit(TransactionImpl.java:554) at org.datanucleus.TransactionImpl.commit(TransactionImpl.java:335) at org.datanucleus.api.jdo.JDOTransaction.commit(JDOTransaction.java:98) at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:491) at org.apache.hadoop.hive.metastore.ObjectStore.getTable(ObjectStore.java:970) at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.hive.metastore.RawStoreProxy.invoke(RawStoreProxy.java:98) at com.sun.proxy.$Proxy2.getTable(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1772) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_core(HiveMetaStore.java:3343) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.alter_table_with_environment_context(HiveMetaStore.java:3325) at sun.reflect.GeneratedMethodAccessor62.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:102) at com.sun.proxy.$Proxy4.alter_table_with_environment_context(Unknown Source) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_table_with_environment_context.getResult(ThriftHiveMetastore.java:9105) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$alter_table_with_environment_context.getResult(ThriftHiveMetastore.java:9089) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:110) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor$1.run(TUGIBasedProcessor.java:106) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:118) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:285) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)   ... View more

Hello   I am so sorry but I could not find out change passsword section. How can I change my password ? Actually I also want to change my security question   Thanks ... View more

Hello   My colleague runs big SQLs through HUE interface on Impala (he knows only sql 🙂 ). Sometimes we get following error on hue interface. Does this error related with impala ? If yes, is there any way to fix that ?   AnalysisException: Exceeded the maximum number of child expressions (10000). Expression has 12061 children: CASE WHEN (longitude BETWEEN 28.4360479702 AND 28.4480394711) AND (latitude BETW...   Above error occured while he was running about 12000 lines of SQL  🙂   Best regards   ... View more

Hello   I am trying to copy parquet files between 2 different Impala database that they are working 2 different Cloudera installation.   I created tables on target with exactly same type of columns and partitions I copied parquet files from source and copied into target fs then moved into hdfs location and then I run refresh <table> command on impala-shell   For nonpartitioned tables :--> there is no problem after refresh command. I could see all the data in target tables   For partitioned tables --> there is no data after refresh command, so I tried with following procedure   dropped partitioned tables from target, recreated tables on target without partition. I created source table's partitioned columns as normal columns on target copied parquet files into hdfs location then refresh table command   When I check the target table, I could see data in target table except on some column/s of target table which they are created as partitioned columns on source table   What is the proper way of parquet file copy operation between 2 impala database, if the tables have partitions?   Thanks     ... View more

Hello   I created some tables like following command sequence set compression_codec=gzip create table1 stored as parquet as select col1, col2, col3, col4 from table2 But when I checked show files in table1 output, I could see there is no compression.   | | transient_lastDdlTime | 1449221112 | | | NULL | NULL | | # Storage Information | NULL | NULL | | SerDe Library: | org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe | NULL | | InputFormat: | org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat | NULL | | OutputFormat: | org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat | NULL | | Compressed: | No | NULL |   I also controlled set command output, compression_codec was gzip, also tried compute stats table1 command and checked again but no progress.   I could not figured out my error. Could you help me about to crerate gzip compressed parquet table?   Thanks ... View more

Hello   I am writing a code to Oracle to Impala data mirroring with python. I am using cx_Oracle for Oracle connection and impyla for Impala connections.I have created Impala tables' fields with similar type of Oracle tables' fields   I am reading varchar2 type variable from Oracle without any error but could not insert it into Impala as string. So I try to insert like following statement   sql = "insert into test01.testdcr values (%f, cast('%s' as VARCHAR(128)), %f, %f, %f, %f, %f, %f, %f, %f, %f, %f, '%s')" % \ (row[0], row[1], row[3], row[4], row[5], row[6], row[7], row[8], row[9], row[10], row[11], row[12], row[2]) curImpala.execute (sql) There was no error in above code so I could successfully insert my data   But there is a note in Impala documentation about string data type    You can use CAST() to convert STRING values to TINYINT , SMALLINT , INT , BIGINT , FLOAT , DOUBLE , or TIMESTAMP .     So there is no VARCHAR type conversion from STRING.   My question is can I trust my code ? If not what is the proper way of this conversion ?   Best regards       ... View more

Hello   How can I get table's file format in impala db. descrive [formatted] tableName does not help us or I could not identify in formatted output   By the way what is "table type" in formatted output. What are the possible values for this property ?   Thanks msuluhan   ... View more

Hello all   I tried to configure and run sqoo2 job to import data from Oracle2HDFS. My configuration details in following lines sqoop:000> show link +----+----------+--------------+------------------------+---------+ | Id | Name | Connector Id | Connector Name | Enabled | +----+----------+--------------+------------------------+---------+ | 1 | TPLink | 1 | generic-jdbc-connector | true | | 2 | HDFSLink | 2 | kite-connector | true | +----+----------+--------------+------------------------+---------+ sqoop:000> show job --all 1 job(s) to show: Job with id 1 and name TPJob (Enabled: true, Created by cloudera-scm at 10/6/15 2:48 PM, Updated by cloudera-scm at 10/6/15 2:48 PM) Using link id 1 and Connector id 1 From database configuration Schema name: ####### Table name: ######### Table SQL statement: Table column names: Partition column name: TIME_STAMP Null value allowed for the partition column: Boundary query: Throttling resources Extractors: 2 Loaders: 2 To Kite Dataset Configuration Dataset URI: dataset:hdfs:/tmp/TPSqoop2 File format: PARQUET sqoop:000> show link --all 2 link(s) to show: link with id 1 and name TPLink (Enabled: true, Created by cloudera-scm at 10/6/15 1:49 PM, Updated by cloudera-scm at 10/6/15 1:49 PM) Using Connector generic-jdbc-connector with id 1 Link configuration JDBC Driver Class: oracle.jdbc.driver.OracleDriver JDBC Connection String: jdbc:oracle:thin:@x.y.z.d:1521:<serviceName> Username: ######### Password: JDBC Connection Properties: link with id 2 and name HDFSLink (Enabled: true, Created by cloudera-scm at 10/6/15 2:40 PM, Updated by cloudera-scm at 10/6/15 2:40 PM) Using Connector kite-connector with id 2 Link Configuration HDFS host and port: <hdfshost>:50070 sqoop:000> When I try to run this job I got following error and could not find any recommendation about it maybe I am searching with wrong parameters   sqoop:000> start job -j 1 Exception has occurred during processing command Exception: java.lang.RuntimeException Message: java.lang.ClassNotFoundException: org.kitesdk.data.DatasetIOException Stack trace: at org.apache.sqoop.utils.ClassUtils (ClassUtils.java:65) at org.apache.sqoop.utils.ClassUtils (ClassUtils.java:84) at org.apache.sqoop.json.ThrowableBean (ThrowableBean.java:123) at org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:127) at org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179) at org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112) at org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154) at org.apache.sqoop.client.SqoopClient (SqoopClient.java:460) at org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80) at org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51) at org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127) at org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103) at org.codehaus.groovy.tools.shell.Command$execute (null:-1) at org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42) at org.codehaus.groovy.tools.shell.Command$execute (null:-1) at org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90) at groovy.lang.MetaMethod (MetaMethod.java:233) at groovy.lang.MetaClassImpl (MetaClassImpl.java:1054) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121) at org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114) at org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1) at org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88) at org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90) at groovy.lang.MetaMethod (MetaMethod.java:233) at groovy.lang.MetaClassImpl (MetaClassImpl.java:1054) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148) at org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137) at org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57) at org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90) at groovy.lang.MetaMethod (MetaMethod.java:233) at groovy.lang.MetaClassImpl (MetaClassImpl.java:1054) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148) at org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66) at java_lang_Runnable$run (null:-1) at org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42) at org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108) at org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402) at org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128) Caused by: Exception: java.lang.ClassNotFoundException Message: org.kitesdk.data.DatasetIOException Stack trace: at java.net.URLClassLoader (URLClassLoader.java:381) at java.lang.ClassLoader (ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader (Launcher.java:331) at java.lang.ClassLoader (ClassLoader.java:357) at org.apache.sqoop.utils.ClassUtils (ClassUtils.java:61) at org.apache.sqoop.utils.ClassUtils (ClassUtils.java:84) at org.apache.sqoop.json.ThrowableBean (ThrowableBean.java:123) at org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:127) at org.apache.sqoop.client.request.ResourceRequest (ResourceRequest.java:179) at org.apache.sqoop.client.request.JobResourceRequest (JobResourceRequest.java:112) at org.apache.sqoop.client.request.SqoopResourceRequests (SqoopResourceRequests.java:154) at org.apache.sqoop.client.SqoopClient (SqoopClient.java:460) at org.apache.sqoop.shell.StartJobFunction (StartJobFunction.java:80) at org.apache.sqoop.shell.SqoopFunction (SqoopFunction.java:51) at org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:127) at org.apache.sqoop.shell.SqoopCommand (SqoopCommand.java:103) at org.codehaus.groovy.tools.shell.Command$execute (null:-1) at org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42) at org.codehaus.groovy.tools.shell.Command$execute (null:-1) at org.codehaus.groovy.tools.shell.Shell (Shell.groovy:101) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:-1) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90) at groovy.lang.MetaMethod (MetaMethod.java:233) at groovy.lang.MetaClassImpl (MetaClassImpl.java:1054) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:173) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:141) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:121) at org.codehaus.groovy.tools.shell.Shell (Shell.groovy:114) at org.codehaus.groovy.tools.shell.Shell$leftShift$0 (null:-1) at org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:88) at org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90) at groovy.lang.MetaMethod (MetaMethod.java:233) at groovy.lang.MetaClassImpl (MetaClassImpl.java:1054) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148) at org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:100) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce (PogoMetaMethodSite.java:267) at org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite (PogoMetaMethodSite.java:52) at org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:137) at org.codehaus.groovy.tools.shell.ShellRunner (ShellRunner.groovy:57) at org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:-1) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:-2) at sun.reflect.NativeMethodAccessorImpl (NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl (DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method (Method.java:497) at org.codehaus.groovy.reflection.CachedMethod (CachedMethod.java:90) at groovy.lang.MetaMethod (MetaMethod.java:233) at groovy.lang.MetaClassImpl (MetaClassImpl.java:1054) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:128) at org.codehaus.groovy.runtime.ScriptBytecodeAdapter (ScriptBytecodeAdapter.java:148) at org.codehaus.groovy.tools.shell.InteractiveShellRunner (InteractiveShellRunner.groovy:66) at java_lang_Runnable$run (null:-1) at org.codehaus.groovy.runtime.callsite.CallSiteArray (CallSiteArray.java:42) at org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:108) at org.codehaus.groovy.runtime.callsite.AbstractCallSite (AbstractCallSite.java:112) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:463) at org.codehaus.groovy.tools.shell.Groovysh (Groovysh.groovy:402) at org.apache.sqoop.shell.SqoopShell (SqoopShell.java:128) sqoop:000>   Thanks for your helps Best regards msuluhan ... View more