About ram_

ram_ · ‎10-14-2021

No, that's not working for me. I already mentioned the error in question. https://git-wip-us.apache.org/repos/asf?p=sqoop.git;a=blob;f=src/docs/user/hcatalog.txt;h=96a90f75ca7e6e3ee9e0e086759ed6a8cde0d44b;hb=be260e3096a6a2710e661c7fe33f6b402ce66476 in reference to above link, can you please tell me why --hcatalog-external-table is not working?? The workaround is good, but I have many tables to move and it may not be easy for me to do the table creation manually.

ram_ · ‎10-14-2021

Hi COE, I don't get what you changed, But, I got the below error ERROR tool.ImportTool: Import failed: No primary key could be found for table dup_07jul. Please specify one with --split-by or perform a sequential import with '-m 1'. after adding '-m 1', I got ERROR tool.ImportTool: Import failed: org.apache.hive.hcatalog.common.HCatException : 2016 : Error operation not supported : Store into a transactional table default.duplicates_1 from Pig/Mapreduce is not supported

ram_ · ‎10-13-2021

I'm trying to sqoop some tables from Postgres to Hive and convert them to ORC while sqooping. 1. I used the below command. sqoop import --hcatalog-home /usr/hdp/current/hive-webhcat --connect jdbc:postgresql://<host>/<database> --username user --password pwd --table table --hcatalog-database default --hcatalog-table table --hcatalog-storage-stanza "stored as orcfile" --create-hcatalog-table -m 1 I was getting the below error: ERROR tool.ImportTool: Import failed: org.apache.hive.hcatalog.common.HCatException : 2016 : Error operation not supported : Store into a transactional table default.agent from Pig/Mapreduce is not supported 2. I changed the sqoop to look like this. sqoop import --hcatalog-home /usr/hdp/current/hive-webhcat --connect jdbc:postgresql://<host>/<database> --username user --password pwd --table table --hcatalog-database default --hcatalog-table table --hcatalog-storage-stanza "stored as orcfile tblproperties (\"transactional\"=\"false\")" --create-hcatalog-table -m 1 Error: INFO hcat.SqoopHCatUtilities: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. MetaException(message:Table default.duplicates failed strict managed table checks due to the following reason: Table is marked as a managed table but is not transactional.) 3. and I added the below after some googling, sqoop import --hcatalog-home /usr/hdp/current/hive-webhcat --connect jdbc:postgresql://<host>/<database> --username user --password pwd --table table --hcatalog-database default --hcatalog-table table --hcatalog-storage-stanza "stored as orcfile tblproperties (\"transactional\"=\"false\")" --create-hcatalog-table --hcatalog-external-table -m 1 sqoop import --hcatalog-home /usr/hdp/current/hive-webhcat --connect jdbc:postgresql://<host>/<database> --username user --password pwd --table table --hcatalog-database default --hcatalog-external-table table --hcatalog-storage-stanza "stored as orcfile tblproperties (\"transactional\"=\"false\")" --create-hcatalog-table -m 1 I tried both given above, This is the Error: ERROR tool.BaseSqoopTool: Unrecognized argument: --hcatalog-external-table Now, I don't know what to do.. Please help me out here.

ram_ · ‎07-05-2021

is this the truth? HDP is no longer free?? if all the underlying software are opensource, how come they can ask money for this?? can some one please confirm, HDP is no longer free.

Online	Offline
Last Visited	‎12-06-2021 09:18 AM

Member Since	‎07-05-2021 03:11 AM
Last Visited	‎12-06-2021 09:18 AM
Posts	4

Cloudera Community

Re: Sqoop from Postgre to Hive and convert to ORC ...

Re: Sqoop from Postgre to Hive and convert to ORC ...

Sqoop from Postgre to Hive and convert to ORC form...

Re: How do I download the latest version of Ambari...