@younes kafi The create table is incorrect, it is not possible to store the data in avro format into orc format. The best possible way is as below: CREATE TABLE avro_table ROW FORMAT SERDE'org.apache.hadoop.hive.serde2.avro.AvroSerDe' LOCATION '/user/someuser/avro_folder/' TBLPROPERTIES ('avro.schema.url'='hdfs:///user/someuser/schema.avsc'); Create orc file as below: CREATE TABLE orc_table stored as orc; INSERT INTO TABLE orc_table SELECT * FROM avro_table; ... View more

@Rinku Singh Unfortunately, it is not possible. The definition of External table itself explains the location for the file: "An EXTERNAL table points to any HDFS location for its storage, rather than being stored in a folder specified by the configuration property hive.metastore.warehouse.dir ." https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-ExternalTables ... View more

@Gayathri Reddy G The property "Dorg.apache.sqoop.splitter.allow_text_splitter=true" is required when you are using --split-by is used on a column which is of text type. There is difference in the TextSplitter class of Sqoop jars in HDP 2.4 and HDP 2.5 because of sqoop command fails without the required argument in HDP 2.5. ... View more

@Kaliyug Antagonist This is actually a known issue, and there is a Jira for a documentation bug to get this fixed in a later HDP release. Sqoop uses 1.8.0 of avro and there are other Hadoop components using 1.7.5 or 1.7.4 avro. Please add the following property after 'import': -Dmapreduce.job.user.classpath.first=true Example: sqoop import -Dmapreduce.job.user.classpath.first=true -Dhadoop.security.credential.provider.path=jceks://x.jceks --connect jdbc:db2://xxx:60000/x2 --username xx -password-alias xx --as-avrodatafile --target-dir xx/data/test --fields-terminated-by '\001' --table xx -m 1 ... View more

@Sergio Aparicio This is actually a known issue, and there is a Jira for a documentation bug to get this fixed in a later HDP release. Sqoop uses 1.8.0 of avro and there are other Hadoop components using 1.7.5 or 1.7.4 avro. Please add the following property after 'import': -Dmapreduce.job.user.classpath.first=true Example: sqoop import -Dmapreduce.job.user.classpath.first=true -Dhadoop.security.credential.provider.path=jceks://x.jceks --connect jdbc:db2://xxx:60000/VKTXAP02 --username xx -password-alias xx --as-avrodatafile --target-dir xx/data/test --fields-terminated-by '\001' --table xx -m 1 ... View more