About snm1523

snm1523 · ‎04-11-2024

Hello All, On CDP PB, like we send ranger audit logs of services thats support Ranger plugin to HDFS, can we also send logs of Stream Messaging Manager service to HDFS? I tried to look for config to achieve this, however, I could find only 2 configs (listed below) that allow us to configure the local path. However, there was nothing found to send these logs to HDFS. Ranger Streams Messaging Manager Plugin Audit Hdfs Spool Directory Path Ranger Streams Messaging Manager Plugin Audit Solr Spool Directory Path Any help / guidance will be highly appreciated. Thanks snm1523

snm1523 · ‎09-27-2023

@TommyH Login to DB server where CM is storing metadata and then will need to delete the authentication backend entry. Please refer to below queries: select ATTR, VALUE from CONFIGS where ATTR = 'auth_backend_order'; delete from CONFIGS where ATTR = “auth_backend_order” and SERVICE_ID is null Hope this helps. Thanks snm1523

snm1523 · ‎07-12-2023

Hello All, Just checking if anyone is aware or can guide me to a documentation that would provide details of comparison between CDP Private Cloud vs HPE Ezmeral Data Fabric Platform. I have read somewhere that HP took over MapR and then formed HPE Ezmeral. However, can't find what are the differences. Please advise. Thanks snm1523

snm1523 · ‎06-16-2023

Hello, We are on CDP 7.1.7 SP1 and as per my understanding when DistCp is executed with below parameters, it does the following: 1. update: this will update the files in destination that have got modified at source 2. delete: this will delete the files in destination that exist in destination but not in source. Apart feom above, it will copy over any new files at source that do not exist in destination. While copy and update is happening, it does not delete the files instead duplicates them and hence, the data count at destination is double than the source. Kindly help urgently as we are at the verge of initiating heavy data copy. Thanks snm1523

snm1523 · ‎06-09-2023

Thank you again @smruti 😊

snm1523 · ‎06-09-2023

Hello, How do we fetch the number of columns each table has in each DB from HMS DB? I have an urgent need to do a comparison for the number of columns each table has in each DB between 2 clusters. Doing that manually is practically impossible. Kindly help Thanks snm1523

snm1523 · ‎06-09-2023

@smruti - thank you for the response

snm1523 · ‎06-07-2023

Hi, How do we change the InputFormat and OutputFormat of an existing Hive table? I tried below, but got an error: alter table <table name> SET InputFormat "org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat"; Error: Cannot recognize input near 'SET' 'InputFormat' 'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat' Kindly suggest

snm1523 · ‎06-07-2023

Thank you for the respone @ggangadharan

snm1523 · ‎06-06-2023

Hello, Is there a way get the hdfs locations of all tables in CDP 7.1.7 SP1? I tried running a for loop against a list of tables on below command, however, it will take ages to get the list as I am looking forward to 66k+ tables. hive -e “desc formatted <table>;” | grep Location Thought of to get from HMS DB directly, however, I can only see DB location URI, but nothing specific to tables. Kindly help as this is urgent. Thanks snm1523

Online	Offline
Last Visited	‎04-01-2026 11:31 AM

Member Since	‎10-29-2015 07:36 PM
Last Visited	‎04-01-2026 11:31 AM
Posts	130
Kudos received	32

Cloudera Community

Re: Limit user access to Hue via Knox

Re: YARN and HDFS monitoring via Grafana

Re: Enable Admin account for Cloudera Manager

Re: Datanode not starting: SIGTERM error

Ranger audit log for Stream Messaging Manager serv...

Re: Enable Admin account for Cloudera Manager

CDP Private Cloud vs HPE Ezmeral Data Fabric Platf...

URGENT: Distcp -update -delete is not deleting fil...

Re: Number of columns each table has in Hive

Number of columns each table has in Hive

Re: Change input and output format of existing hiv...

Change input and output format of existing hive ta...

Re: All hive tables location

All hive tables location