Is there any way out for this? In Ambari, there is a role_command_order.json for custom service's component start/stop ordering. Anything similar in Cloudera Manager? ... View more

@pkotla Check the Apache doc if that helps. I am not very sure if that’s achievable but give it a try.  https://ranger.apache.org/apidocs/resource_ServiceREST.html#resource_ServiceREST_applyPolicy_POST ... View more

@JananiViswa1   Hue is a gateway to CDH cluster services (see   Hue Applications ) and both have completely separate permissions. Being a Hue superuser means nothing to HDFS, Hive, and so on. Important:   Hue and the underlying cluster services have completely separate permissions! Users who log on to the Hue UI must have permission to use Hue,   and also, each CDH service accessible within Hue.   Once Hue is authenticated by a service (for example, Hive),   Hue impersonates the user   (doAs) requesting use of that service (for example, to create a table). The service uses   Sentry   (essentially a   chmod   tool) to ensure the group to which that user belongs is authorized for that action. Hue user permissions are at the application level only. For example, a Hue superuser can filter Hue user access to a CDH service but cannot authorize the use of its features. Again, Sentry does that. Learn how to Authorize Hue User Groups with Sentry.   Ref Doc: https://docs.cloudera.com/documentation/enterprise/6/6.3/topics/hue_adm_permissions.html ... View more

@Boris_Rendon Yes in the base URL as well.  ... View more

@PrernaU You can check if ipc.client.fallback-to-simple-auth-allowed  to true in core-site.xml and see if that helps.   ... View more

@ateka_18 The downtime is better choice because KTS interacts with CDH cluster and failure/Down of KTS will hamper the CDH services hence the job.  ... View more

Hello, Thanks for the explanation and for the help. ... View more

Hi @JGUI , There is no requirement for deleting the data from the datanode that is going to be decommissioned. Once the DN is been decommissioned all the blocks in the DN would be replicated to a different DN.   And is there any error that you are encountering while you are decommissioning ? Typically, HDFS would self-heal and would re-replicate the under-replicated blocks that are due to the DN that is been decommissioned. And NN would start replicating the blocks with the other two replication that is present in HDFS. ... View more

@bobreynolds The service keytabs by default is in /var/run/cloudera-scm-agent/process/xxx-flume-xxxx . Hope you are checking in the same dir. If it's not there then you probably have to generate missing credentials from CM > Administration > Security > Kerberos Credentials and then regenerate.  ... View more

Hello    if you are already in contact with your account team please send a chaser   if you are new to Cloudera, please drop me an email with your company email, I will help you forward to the right team    ... View more

Hi @ryu, then you might need to build some customize in-house monitoring scripts using Yarn APIs or other tools like Prometheus or Grafana for your use case. Please also refer to the below links for more insights https://www.programmersought.com/article/61565532790/ http://rokroskar.github.io/monitoring-spark-on-hadoop-with-prometheus-and-grafana.html https://www.linkedin.com/pulse/how-monitor-yarn-application-via-restful-api-wayne-zhu/         ... View more

@suzu This might help you.  https://community.cloudera.com/t5/Community-Articles/Apache-Metron-TP-1-Install-Instructions-Single-Node-Vagrant/ta-p/245729 ... View more

@chris_snedaker Can you help me to understand what is the difference between if below two are similar in nature?  connection . close () &  conn_imp.close() I think you should try with  connection . close () and see if this works. Also is this the same behaviour outside of CDSW if you test the same code from host. This can help you to narrow down the situation.  ... View more

@muslihuddin It could be but I can't confirm since we don't have any insight may be the old logs digging can give some clue. I haven't seen this before.  ... View more

Thanks for the suggestion. Actually I implemented the virtual machine again, with the latest version of VirtualBox that I have installed, and for now the incident has not been repeated. ... View more

@tris This is due to your Hostname is not matching in Certificate in my opinion. Have you used IP address in Certificate? If yes please use FQDN and recreate certs. ... View more

@apeach You can download and use this driver if this works for you.  ... View more

@emeric I am afraid that MondoDB is not supported and hardly will work with Cloudera as this is NoSQL DB while the Cloudera Manager and other CDH service which requires database is needs to be RDBMS. So you have to go with any RDBMS listed in the supported matrix.    https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_database_requirements.html ... View more

@YingjieXie Did you mean you are able to download the Non-Chinese language files from CDSW? The error says file not found you may want to double check if the file really exist on the target. Check the Browser developer tools and see if you got some more information.  ... View more

@rhad84 The "unknown" statuses are normally when the agent could not collect monitoring data or the data had “unkonwn” status. Specifically when Agent attempted to collect network interface speed, the device didn't return any data or the data returned was “Unkonwn” at the time period of the alert. The collection is equivalen to the doing ethtool <device name> # Expected behaviour [root@nightly70x-1 ~]# ethtool eth0 Settings for eth0: Supported ports: [ ] Supported link modes: Not reported Supported pause frame use: No Supports auto-negotiation: No Supported FEC modes: Not reported Advertised link modes: Not reported Advertised pause frame use: No Advertised auto-negotiation: No Advertised FEC modes: Not reported Speed: 10000Mb/s <<<<<<<<<<<<<<<<<<<<<<<<<<<<< THIS Duplex: Full <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<< THIS Port: Twisted Pair PHYAD: 0 Transceiver: internal Auto-negotiation: off MDI-X: Unknown Link detected: yes Example of "Unknown" is :  So you have to fix this at network level or you can suppress the Alerts if you think networking is good.  ... View more

@cr @PowerofAI You might have to make sue that Impala packages is installed and then import the UDF something like this may be:    import pandas as pd from pyspark . sql . functions import pandas_udf , PandasUDFType from pyspark . sql import Window df = spark . createDataFrame ( [( 1 , 1.0 ), ( 1 , 2.0 ), ( 2 , 3.0 ), ( 2 , 5.0 ), ( 2 , 10.0 )], ( "id" , "v" )) @pandas_udf ( "double" , PandasUDFType . GROUPED_AGG ) def pandas_mean ( v ): return v . sum () df . select ( pandas_mean ( df [ 'v' ])). show () df . groupby ( "id" ). agg ( pandas_mean ( df [ 'v' ])). show () df . select ( pandas_mean ( df [ 'v' ]). over ( Window . partitionBy ( 'id' ))). show () Also we have to make sure that  pip install ibis-framework pip install imapala is there that might causing the issue.  ... View more