Just a note about the CM API: From what I can tell, the API doesn't bring more parameters back that what you can see in the Configuration tab for each app/service. Being able to see them in the INFO logs was exactly what was needed.  However, it would be nice to be able to use the API to get the same info as the INFO logs provides.  I could see some automation opportunities in the future... ... View more

Not yet but I have a good bit of experience writing Python code using the CM API.  I'll look into it.  If there's anything useful, it might be helpful to post my findings here... ... View more

Hey Ben,   One very key thing you mentioned was the fact that the INFO logs write out the parameter settings.  Not sure if that includes defaults as I have not researched it yet but this is extremely useful as I may not have enough time to figure out why the servlets/services are not running or are not available but being able to see the parameter settings this way is more then sufficient.   For anyone needing a way to quickly see the parameters separated from the rest of the log information, you can use this egrep pattern I put together.  Hasn't been thoroughly tested but works so far: egrep '^--\w+=\w?+' /var/log/impalad/impalad.INFO   This command extracted 229 parameters from our INFO log file.  Sounds like a pretty complete list??? ... View more

Hey Ben,   >most services expose a "/conf" servlet in their WebUI which gives you the most complete set of actually used parameters. This should be the most promising source of thruth. Impala has a similar Servlet with path "/varz". I've been looking for this /varz path for Impala and cannot find the correct path.  Can you give me the port and path that it should be on?  Unless it's a name that is given during setup and it's different than "/varz"???     > The instance process view of Cloudera Manager shows you the actually distributed config files - which often helps a lot but does not include default values. You can reach it from a service (e.g. Impala) by clicking on "Instances" -> (the instance you want to see, e.g. Impala Catalog Server on a node) -> Processes I've seen this but I don't see anything that comes close to what I need.  This is the list of Impala related config files: impala-conf/fair-scheduler.xml impala-conf/llama-site.xml impala-conf/sentry-site.xml impala-conf/log4j.properties impala.keytab impala-conf/.htpasswd impala-conf/impalad_flags The only thing that comes close is impala-conf/impalad_flags file and that has no link.   Thanks!   ... View more

I'm going to take a poke at this and hope I'm not wasting your time...   This looks like a good start: https://kudu.apache.org/docs/developing.html   I have done minimal Python development using PySpark and Kudu.  It's not too bad...   ... View more

I'm going to take a poke at this and hope I'm not wasting your time...   This looks like a good start: https://kudu.apache.org/docs/developing.html   I have done minimal Python development using PySpark and Kudu.  It's not too bad...   ... View more