Member since
05-04-2020
13
Posts
0
Kudos Received
0
Solutions
06-03-2021
02:56 AM
Hello @aakulov, In my Hive Configuration, hive.compactor.initiator.on = Enabled Here is the screenshot of Hive and hiveServer2 configurations: Now, Is there anything else that I have to check or configure to remove the older base and delta folders? Thank you again, Alex.
... View more
06-01-2021
09:21 PM
Hi @aakulov, I am using Cloudera 7.1.3 and HIVE version: 3.1.3 Table TBLPROPERTIES Output: Thanks in Advance.
... View more
06-01-2021
07:43 AM
I have run manually minor and major compaction. Table data is referring to the new delta and base folder but the old delta and base folders are not removing and it consumes the hive storage. Moreover, No running job is referring to this table. Queries: create table compaction_check.check_file(name string, age int);
insert into compaction_check.check_file values('user 1', 10),('user 2', 20),('user 3', 30);
insert into compaction_check.check_file values('user 4', 10),('user 5', 30),('user 6', 15);
ALTER TABLE compaction_check.check_file COMPACT 'major'; Check input files: select distinct INPUT__FILE__NAME FROM compaction_check.check_file; output: Actual table directory : Why stale the base and delta folders are not removed?
... View more
Labels:
01-05-2021
11:57 PM
@TimothySpann, Thanks for your response, Those configuration is working on confluent schema registry, but I can't do it on Cloudera(7.1.3) schema registry. I am getting this log when my Kafka producer run: from my schema registry, I want to make it false. auto.register.schema = false Thanks again.
... View more
01-05-2021
02:41 AM
Hello, In Cloudera 7.1.3 schema-registry Service, the schema is automatically generated (if it doesn't exist) or a new schema's version is created (if it exists). So that I want to disable auto-generated schema. I thought if I can set auto.register.schemas=false then it may works as expected. But I can not find where this parameter puts on schema registry configuration in Cloudera 7.1.3. Do you advise me on how can I fix it?
... View more
Labels:
- Labels:
-
Schema Registry
01-05-2021
02:02 AM
Hello, For pre-defined access policy controls access to one or more Schema Registry entities I need to add or enable the schema_registry ranger plugin. But I didn't configure how to enable or add in Service Manager for cm_schema_registy Policy List. Here is the link to Cloudera documentation for schema registry in ranger service. Schema registry security add-in ranger for example: As the documentation, ranger manage service seems like, But in my ranger service manager, didn’t see the cm_schema_registry policy. So, my question is how to enable or add or user control schema registry from ranger service?
... View more
Labels:
- Labels:
-
Apache Ranger
-
Schema Registry
01-04-2021
09:02 PM
Hello, I am facing the same issue, I know, if I can set auto.register.schemas=false then it may works as expected. But I can not find where this parameter puts on schema registry configuration in Cloudera 7.1.3. Do you advise me on how can I fix it?
... View more
07-03-2020
11:09 PM
This is OS related issue, Cloudera does not support all types of OS. Here the OS list supported by Cloudera. Red Hat Enterprise Linux ( 6 and 7) Oracle Enterprise Linux ( 6 and 7) Centos ( 6 and 7) SUSE Enterprise Linux 12 Ubuntu (16.04 LTS and 18.04 LTS) Check your OS version: cat /etc/os-release
... View more
05-04-2020
08:38 AM
When I enable the Ranger Service from HIVE in Cloudera Manager, it's getting an error like: "Hive Impersonation is enabled for Hive Server2 role 'HiveServer2 (node1)'. Hive Impersonation should be disabled to enable Hive authorization using Ranger" I want to access control from Ranger, But I cant Anybody, please help me.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Ranger
-
Cloudera Manager