Re: Add new Columns in Kudu Tables from Impala

Guarupe · ‎03-29-2022

Hi @Shelton, sorry for the delay in responding. I finally found the solution to my problem. I need to specify the column properties and then Compute Stats will work perfectly. ```sql ALTER TABLE myschema.mytable ADD COLUMNS (mycolumn1 TIMESTAMP NULL COMPRESSION DEFAULT_COMPRESSION, mycolumn2 TIMESTAMP NULL COMPRESSION DEFAULT_COMPRESSION); ```

Guarupe · ‎07-05-2021

Hi Shelton, The answer to all questions is yes. I'm using the Hue Impala Editor and all these commands were issued by HUE. As I've already solved the problem with a CREATE AS SELECT, I'm going to ask for a little time to simulate this problem again. Thanks again,

Guarupe · ‎07-05-2021

Hi Shelton, Thanks for your reply, but INVALIDATE METADATA didn't work for me. I still have the same error. My option was to recreate the table with a CREATE TABLE as SELECT from the previous table. Thanks again

Guarupe · ‎07-01-2021

Hi Folks, After adding new columns in Kudu tables from impala, I had some issues computing stats for this table. Everything works fine until the Compute Stats command; The alter table command ALTER TABLE myschema.mytable ADD COLUMNS (mycolumn TIMESTAMP DEFAULT now()); The issue when Compute Stats command. ImpalaRuntimeException: Error making 'updateTableColumnStatistics' RPC to Hive Metastore: CAUSED BY: MetaException: Column mycolumn doesn't exist in table mytable in database myschema Someone can help me, please?

Guarupe · ‎02-03-2021

Hi @ylchew93, Do you solve this issue? I have the same problem after enabled Kerberos in my cluster.

Guarupe · ‎01-28-2021

Hi @pvillard, I have some doubts about what kind of keytab file to create. I don't know much about Kerberos and do not find much information about the kind of Keytab file I should use to connect my Nifi Cluster to a kerberized Cloudera Cluster. Can you help me?

Guarupe · ‎10-15-2020

Hi, @zhxj, do you found some way to treat this issue? I have the same issue to convert timestamp data to Parquet. I try this in the schema, but do not work. { "name": "dat_timestamp", "type": { "type":"int64", "logicalType":"timestamp-millis", "isAdjustedToUTC" : "false"} }, Thanks,

Guarupe · ‎10-02-2019

Maybe do you are looking for SSoT (Single Source of Thruth). Kafka may be the best option to achieve this concept. The link bellow may help you: https://www.confluent.io/blog/messaging-single-source-truth/

Guarupe · ‎06-21-2019

After read the content of the link below a made some changes in both nifi.properties e boostrap.conf files. That changes solved the issue, for now. https://community.hortonworks.com/articles/7882/hdfnifi-best-practices-for-setting-up-a-high-perfo.html nifi.properties file: <nifi.queue.swap.threshold=100000/> Bootstrap.conf file: <# JVM memory settings java.arg.2=-Xms4g java.arg.3=-Xmx4g/> coment Garbage collector usage <# java.arg.13=-XX:+UseG1GC/>

Guarupe · ‎06-13-2019

We have the same issue, has anyone found any solution to this case?

Online	Offline
Last Visited	‎03-29-2022 05:36 PM

Date Registered	‎07-27-2018 04:46 AM
Last Visited	‎03-29-2022 05:36 PM
Total Messages Posted	10
Total Kudos Received	1

Re: Add new Columns in Kudu Tables from Impala

Re: Add new Columns in Kudu Tables from Impala

Re: Add new Columns in Kudu Tables from Impala

Re: Add new Columns in Kudu Tables from Impala

Add new Columns in Kudu Tables from Impala

Re: Caused by SSLError(SSLError("bad handshake: Er...

Re: how to use apache Nifi on kerberized HDP Clust...

Re: Is it possible to read parquet INT64 timestamp...

Re: Can we use apache NIFI as storage ? means pers...

Re: Nifi Cannot swap in FlowFiles from location

Re: Nifi Cannot swap in FlowFiles from location