@Mike Wong Does the listFile exhibit the same behavior or does it list your file correctly? - The fact that the logs shows it the processor yielding tells me it found no work to do (meaning no files to list). It yields so that it does not consume not stop CPU looking for work that does not exist. - Did you check your properties for leading or trailing whitespace? Did you try removing the "\" from your file filter? - Thanks, Matt ... View more

@Gaurav Sharma I think I figured it out. When you asked me to check zoo.cfg, I noticed there were a block of ports ZK communicates over server.1=hdp.c.my-project-1519895027175.internal:2888:3888 server.2=slave1.c.my-project-1519895027175.internal:2888:3888 server.3=slave2.c.my-project-1519895027175.internal:2888:3888 In GCP, you have to configure the firewall manually (or that's what I'm doing at least). Once I added that range of ports to the firewall, I restarted the ZK servers and most of my services work now! I say most, because Spark2 History Server and Zeppelin still aren't working. But I'll open another thread for those. ... View more

you r the best ... View more

I figured it out, for that problem at least. I had to edit the pg_hba.conf file to add the IP range of 'host' machine. ... View more