Hi, I have a custom parcel that I have distributed and activated in my Data Engineering DATAHUB cluster. With this parcel i am trying to load some jars that i need on every node and also export some classpaths that is needed. So w.r.t exporting I am trying to add some hive related classpath using the control script of my custom parcel in which I export some Environment variables. In parcel.json of my custom parcel I provide a tag [hive-plugin]. Now as we now, my control script will only be sourced when agent finds out that some other service parcel has also specified the [hive-pluging] tag in their csd. Now this intention of using the hive-plugin in my custom parcel was to ensure the classpath required by my custom service are exported and there is no need for some manual task to be done. This is working very well on the on-prem CDH 5.x and 6.x clusters beacuse when i check the proc.json of hive service for the on prem clusters, I find the [hive-plugin] mentioned in optional tags section, but the same is not the case with CDP DataHub DataEngineering 7.0.2 cluster. The optional tag is missing in Data Engineering clusters, hive proc.json file. I know I can use other ways to set additional configurations in Data Hub cluster like using the Advanced -> Cluster Extensions -> Custom Properties option but I am curious to know why such change was made with the hive service .i.e the removal of the hive-plugin optional tag. Thanks!! ... View more

Hi, Recently i was trying to create DataHub clusters in my CDP account. I was able to create Data Engineering, Real time Data Mart and operation Database clusters but while I was trying to create Data Mart cluster, i was getting error. Following is the cluster creation events: com.sequenceiq.cloudbreak.cm.ClouderaManagerOperationFailedException: Cluster template install failed: [Command [CreateImpalaUserDir], with id [1546333216] failed: Failed to create HDFS directory.] 3/16/2020, 12:22:33 PM Building cluster; Cluster manager ip:52.86.31.188 3/16/2020, 12:15:05 PM Starting cluster services 3/16/2020, 12:10:26 PM Setting up infrastructure metadata 3/16/2020, 12:08:36 PM Bootstrapping infrastructure cluster 3/16/2020, 12:08:22 PM Registering proxy configuration with Cluster Proxy 3/16/2020, 12:08:21 PM Infrastructure successfully provisioned 3/16/2020, 12:08:21 PM Infrastructure metadata collection finished 3/16/2020, 12:08:14 PM Infrastructure creation took 90 seconds 3/16/2020, 12:08:11 PM Creating infrastructure 3/16/2020, 12:06:41 PM Setting up CDP image 3/16/2020, 12:06:40 PM Thanks, Pradeep ... View more