Member since
11-11-2019
635
Posts
34
Kudos Received
27
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 542 | 10-09-2025 12:29 AM | |
| 5906 | 02-19-2025 09:43 PM | |
| 2244 | 02-28-2023 09:32 PM | |
| 4407 | 02-27-2023 03:33 AM | |
| 26215 | 12-24-2022 05:56 AM |
09-28-2021
04:37 AM
Hi @asish , I have uploaded the Nifi flow definition, so you can reproduce my issue.(In txt file because I can't upload json extension, just change the extension) It generates a csv: ``` allstring,mixedtype "foo","bar" "foo2",2 "foo3","bar2" ``` Then convert it to Parquet (V1). The issue comes from UpdateHive processor : Error while compiling statement: FAILED: Execution Error, return code 40000 from org.apache.hadoop.hive.ql.ddl.DDLTask. java.lang.UnsupportedOperationException: Unknown field type: uniontype<int,string> The issue is not present in Nifi when I convert to another format (Avro for example). But is present when I tried to read back the data from the table (from Hue): AnalysisException: Could not load table open_data.test from catalog CAUSED BY: TableLoadingException: Could not load table open_data.test from catalog CAUSED BY: TException: TGetPartialCatalogObjectResponse(status:TStatus(status_code:GENERAL, error_msgs:[TableLoadingException: Unsupported type 'uniontype' in column 'mixedtype' of table 'test']), lookup_status:OK) Currently, I am on the last version of Nifi CFM in CDP: 7.2.11 - Flow Management Light Duty with Apache NiFi, Apache NiFi Registry Thank you for your help, Best regards,
... View more
09-28-2021
12:43 AM
@David2 does the file exist?? What kind of file is this? Please share the DDL for the table. Please also share the application logs of the failed job Share application logs for the failed compaction job too.
... View more
09-28-2021
12:18 AM
@Venk123 I think you are hitting https://issues.apache.org/jira/browse/HIVE-3363 I would request to raise case to get it verified and if verified you would receive a patch.
... View more
09-27-2021
10:32 PM
@nareshbattula, Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
... View more
09-25-2021
11:57 AM
@mailsmail I am afraid authorisation tools might not be able to help us here. HIVE-18755 is talking about having two separate catalogs named hive and spark, under Hive metastore db for Hive and Spark services respectively. Here, you could either create databases with different names, or have multiple metastore instances, pointing them to different HMS databases. Then, you will need to have individual HS2 instance(with help of Config groups) connecting to separate Metastores.
... View more
09-22-2021
01:14 AM
You have to use com.cloudera.hive.jdbc.HS2Driver class for the driver. I don't have expertise on Websphere ,I can not help with JNDI.
... View more
09-21-2021
12:55 AM
Hi @dv_conan Has any of the replies helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information that is requested?
... View more
09-16-2021
10:06 AM
1 Kudo
@Sayed016 This error occurs if the HDFS files are under replicated. Did you see HDFS is under replicated when the issue occurred? Wait for the HDFS to gets replicated and you can query
... View more
09-09-2021
09:07 AM
DISTCP or import/export is not supported for ACID tables. You need to follow below mechanism: Distscp for ACID is not supported ,you have 2 approaches: Approach 1 ============= 1. Assuming that you have ACID in source and target clusters. 2. Create a external in source and target clusters. 3. Copy the data from ACID TO external in SOURCE CLUSTER INSERT into external select * from acid. 4. Perfrom distscp from source to target for external table. 5. Copy the data from external TO ACID IN SOURCE CLUSTER INSERT into acid select * from external. Approach 2 ========= Use DLM Refrence: https://community.cloudera.com/t5/Support-Questions/HIVE-ACID-table-Not-enough-history-available-for-0-x-Oldest/td-p/204551
... View more
08-31-2021
11:55 PM
Hi @yudh3 This application is deployed first time or it is an existing application. If it is first time then you need to tune according to what kind of operation you are doing. If an existing application, this issue is occurring recently or from long time it is there. If it is occurring recently, is there any data change or any hdfs/hive issues. Without understanding the logs, difficult to tell what is the exact issue. Please go ahead and create a case for this issue, we will work on.
... View more