A bash script has a few impala queries, similar to this:
impala-shell -q "use aaaa; select distinct fieldName from table" -o $OUTDIR/OUTFILE.txt &&
When I run this scrip manually it works no matter how many impala queries it has (or I did not hit a limit yet).
However when I schedule the same script via crontab then only first few impala queries run (I think nine), and the rest do not run.
Is there any limitation in the way I run it, any known issues? Perhaps limited number of impala connections? Any configuration tweaks that I could try? Any logs to check? I checked messages and cron logs (no errors).
Yes, even with more than 10, it works when run manually. So it seems as if something is either timing out or simply not allowing more connections?
This topic can be closed. The problem was related to some subtleties in Linux environment.
Hello! Can you please tell me what changes you did on the Linux environment to make it working? I have the same problem :( :(