Member since
05-24-2019
309
Posts
8
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
842 | 07-22-2024 01:41 PM | |
1692 | 09-21-2023 06:52 AM | |
3996 | 02-17-2023 10:46 AM | |
2087 | 06-08-2022 08:39 AM |
10-11-2024
08:32 AM
1 Kudo
Are you able to reproduce at will? If so, provide the Cloudera Runtime version and the associated DDL/DML
... View more
09-24-2024
06:59 AM
1 Kudo
@hanumanth Your Python code is throwing this: OSError: [Errno 2] No such file or directory The stack is not enough to determine what is happening Please look at the following items: * job.properties / workflow.xml Is this being setup as a Shell Action? Are all the necessary files being provided? The action needs to setup the Python environment within a YARN container * Oozie launcher log Is Python code starting to execute and then hit a snag or it does fail from the get-go?
... View more
08-16-2024
02:12 PM
1 Kudo
@zhaiziha Are you running this query on DataHub or Hive VW? Please try your SELECT statement on Beeline from DataHub as follows and let us know how it works for you SET hive.server2.logging.operation.level=VERBOSE; SET hive.input.format = org.apache.hadoop.hive.ql.io.HiveInputFormat; SET fs.s3a.experimental.input.fadvise=random; SET fs.s3a.readahead.range=1024K; SET parquet.enable.dictionary=false; SELECT * FROM small; Should that fail, can you provide the beeline output and simple repro steps? Seems like some form of HADOOP-16109
... View more
07-22-2024
01:41 PM
Hello @StefanSs This does not seem like a Cloudera CDP distro / Oozie Supported version We suggest to reach the Oozie Mailing list and provide simple repro steps for the community to review or contact Amazon Support Hope this helps -JMP
... View more
07-18-2024
06:48 AM
OK.... So, sqlplus works from the same host SQOOP is being tried? What is the output from SQOOP eval for "SELECT COUNT(*) FROM <YOUR TABLE>;" vs import on the same table?
... View more
07-17-2024
01:38 PM
Hello, This seems more of an Oracle TNS listener misconfiguration Oracle native sqlplus should be able to connect before using SQOOP: sqlplus <USER>/<PASSWD>@prxd10-scan.intranet.slt.com.lk:1521/<listener> Hope this helps, -JMP
... View more
09-21-2023
06:52 AM
@Lorenzo Hive is unaware of Spark and won't use it to execute commands On the other hand, Spark can access Hive data using the HiveWarehouseConnector Hope this helps, -JMP
... View more
09-20-2023
11:53 AM
@Lorenzo On CDP Hive the Spark engine is deprecated if favor of TEZ
... View more
05-03-2023
01:14 PM
Hello! SQOOP takes advantage of YARN to create a distributed IMPORT/EXPORT job To do so, it needs to compile your query for the mappers to actually execute the job Check out the following links for further information: https://sqoop.apache.org/docs/1.4.7/SqoopUserGuide.html - Section 8.2 Table 18 https://github.com/apache/sqoop/blob/trunk/src/java/org/apache/sqoop/orm/CompilationManager.java#L50 Hope this helps, Sincerely, José M Martínez Poblete Cloudera Support Hive SME US/East/Shift5 my.cloudera.com/faq/support.html USA: 1-866-809-4659 INTL: 1-650-425-9421
... View more
02-17-2023
10:46 AM
PK, If you have access to the Sentry Store backend use a query like this: SELECT r.ROLE_NAME, g.GROUP_NAME, p.*, FROM_UNIXTIME(p.CREATE_TIME / 1000) as CREATE_TIME_DATE FROM SENTRY_ROLE r INNER JOIN SENTRY_ROLE_GROUP_MAP rgm ON r.ROLE_ID = rgm.ROLE_ID INNER JOIN SENTRY_GROUP g ON g.GROUP_ID = rgm.GROUP_ID INNER JOIN SENTRY_ROLE_DB_PRIVILEGE_MAP rpm ON r.ROLE_ID = rpm.ROLE_ID INNER JOIN SENTRY_DB_PRIVILEGE p ON p.DB_PRIVILEGE_ID = rpm.DB_PRIVILEGE_ID; Hope it helps, -JMP
... View more