Basically issue is the Hadoop is running an id command against the user and not including -- in front of the user if the username starts with a -.   1.  As per POSIX standard, a username should not start with a hyphen character, and "-". It is causing this problem.  2. The authorization is done over Kerberos which is working fine. 3. Seems like this userid needs its Unix groups to perform some action on HDFS which is throwing this error (eg writing to a directory using group permissions). This is because the group lookup is not working due to above mentioned issue. ... View more

Hello Tim,   Thank you for your help in this thread.   Yes. For now, I have set the scratch limit for the specific resource pool. I set it to zero to prevent disk-to-spill and created a trigger to test whether it is working or not [IF (SELECT queries_spilled_memory_rate WHERE serviceName=$SERVICENAME AND max(queries_spilled_memory_rate) > 1) DO health:concerning]. Ideally, the trigger should not fire since the scratch limit is set to zero.   For your advice. ... View more