Support Questions

Find answers, ask questions, and share your expertise

Spark Action on Ambari Workflow Manager

Super Collaborator

Hello All,

I have a simple pyspark application that queries a hive table using HiveContext and dumps the result to a csv file on to HDFS. The application runs fine on my cluster (kerberized) when I do spark submit. I do have a valid ticket, so there isn't any issue in submitting the job.

When I run the same job via the Ambari WorkFlow manager, I get a GSS Exception : No Valid Credentials Provided. How do I pass on the user credentials to the workflow?



Expert Contributor

Yon can can create workflow by referring below link

Then you can import it in WFM.

Super Collaborator

I have the hcat credentails as a part of my workflow. Somehow that isn't getting picked up.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.