Hello,   @Eric_B , thanks for the reply, after few search me to I have no permanente solution but for overcome this issue we work with insert (for all data) and make update gestion with materialized view hive. And work fine and fast for my usecase.   Best Regards ... View more

Hi @Shriniwas    Please refer our installation guide [1] and review the steps performed so far. I would suggest to review the steps under document [2] to ensure the environment is correctly setup before installation. Configure Network Names Disabling the Firewall Setting SELinux mode Enable an NTP Service Install Python 2.7 on Hue Hosts [1] https://docs.cloudera.com/documentation/enterprise/latest/topics/installation.html   [2] https://docs.cloudera.com/documentation/enterprise/latest/topics/installation.html#install_cm_cdh ... View more

@Priyan - You can use the below command to get the details. yarn applicationattempt -list <app_number>   You can refer below document to create the command based upon the use case.    https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YarnCommands.html#applicationattempt  ... View more

@Tomas79 -  I am not sure, what you are asking is possible. But you can control the size of the same using below properties.   We could set below parameters to restrict the size of local directories under NM and trigger DeletionService when the limit is reached.   # yarn.nodemanager.delete.thread-count: # yarn.nodemanager.localizer.cache.target-size-mb # yarn.nodemanager.localizer.cache.cleanup.interval-ms   Details under: https://blog.cloudera.com/resource-localization-in-yarn-deep-dive/   The yarn.nodemanager.localizer.cache.target-size-mb property defines decides the maximum disk space to be used for localizing resources. Once the total disk size of the cache exceeds the value defined in this property the deletion service will try to remove files which are not used by any running containers.   The yarn.nodemanager.localizer.cache.cleanup.interval-ms: defines this interval for the delete the unused resources if total cache size exceeds the configured max-size. Unused resources are those resources which are not referenced by any running container. ... View more

Okay, I see that the ATS puts the logs in /ats/done directory in HDFS and this is configured by property yarn.timeline-service.entity-group-fs-store.done-dir 1. What is the difference between  org.apache.hadoop.yarn.server.timeline.LeveldbTimelineStore and  org.apache.hadoop.yarn.server.timeline.EntityGroupFSTimelineStore ? Does the ATS generate logs in path /ats/done only if  yarn.timeline-service.entity-group-fs-store.summary-store is set to the EntityGroupFSTimelineStore ?  2. Do all three versions of the Application Timeline Server (1.0, 1.5, 2.0) generate logs in /ats/done or there is a difference in versions? 3. For some executed queries, I see that only single entity, summary logs get generated whereas for other executed queries I see multiple entity, summary logs getting generated. Is there any structure to this? Like when do we expect a single entity or summary logs or multiple? TIA ... View more

@ngarg - Thank you for the confirmation. ... View more