The unpack command will not work without that extra dash. https://stackoverflow.com/questions/34573279/how-to-unzip-gz-files-in-a-new-directory-in-hadoop/43704452 I had another try with a file name as the destination.   hdfs dfs -cat /user/testuser/stage1.tar.gz | gzip -d | hdfs dfs -put - /user/testuser/test3/stage1   the file stage1 appeared in the test3 directory. There is something interesting. The stage1.tar.gz contains three empty txt files. "hdfs dfs -cat /user/testuser/test3/-" ouptut nothing and the file size is 0.1k "hdfs dfs -cat /user/testuser/test3/stage1" output some texts including original file names inside. Also the file size is 10k.   ... View more

@Shelton  After the apply of the workaround on the file /var/lib/ambari-agent/cache/custom_actions/scripts/remove_previous_stacks.py, I succeeded to execute the API request but there's no effect : the directory of the old version hasn't been removed on the servers of the cluster, and the results of the API queries GET http://localhost/api/v1/clusters/<cluster_name>/stack_versions,  http://localhost/api/v1/clusters/<cluster_name>/stack_versions/<id_oldversion>,  are the same.     ... View more

@Krpyto84  Your permission issue is linked to ZK ACL's my good guess is your Kafka is kerberized. Zookeeper requires you to set up a superuser using the zookeeper.DigestAuthenticationProvider.superDigest property. I don't know how you will integrate that procedure in your Ansible playbook You will then need to append this in y your KAFKA_OPTS env variable to set the JVM parameters export KAFKA_OPTS=-Djava.security.auth.login.config=/path/to/kafka_server_jaas.conf Please let me know whether that is your situation if that's the case then I will try to help you out   ... View more

Thanks @Shelton . But as I mentioned earlier, I have set the sync source to LDAP / AD. As per Cloudera customer support, we cannot sync Unix and LDAP / AD at the same time.    For the issue which I faced, I restarted Ranger KMS, and tried again using "hdfs" user. And was able to create the encryption zone. ... View more

ambari files view (same PB for Hue File browser) is not the good tool if you want to upload (very) big files. it's running in JVMs, and uploading big files will use more memory (you will hit maximum availaible mem very quickly and cause perfs issues to other users while you are uploading ) BTW it's possible to add other ambari server views to increase perfs (it may be dedicated to some teams/projects )   for very big files prefer Cli tools :   scp to EDGE NODE with a big FS + hdfs dfs -put.  or distcp or use an object storage accessible from you hadoop cluster with a good network bandwidth ... View more

Comparison between Apache Sentry and Apache Ranger based on features offered by them:   Feature Apache Sentry Apache Ranger Role-Based Access Control [RBAC] Yes Yes Deny Support No Yes Admin Web User Interface No Yes REST API Support No Yes CLI Support Yes No Audits Support No Yes Plugins Supported Impala, Hive, HDFS, Solr, Kafka Impala, Hive, HDFS, Solr, Kafka, HBase, Knox, Yarn, Storm, etc Tag-based policy No Yes Row Level Filtering No Yes Column Masking No Yes HDFS ACL Sync Yes No [Will be supported in upcoming CDP releases]   As we can see Apache Ranger supports more features like tag-based policy, row-level filtering, column masking, audits, admin web interface, more services, or plugins in CDP stack, and that's why its the default choice for the authorization service in CDP.   For more detailed comparison see this article by @EricL  https://www.ericlin.me/2020/01/introduction-to-apache-ranger-part-i/  ... View more

Hi,. I tried following the steps outlined in the document but still no progress. ... View more