Support Questions
Find answers, ask questions, and share your expertise

Spark Action on Ambari Workflow Manager

Super Collaborator

Hello All,

I have a simple pyspark application that queries a hive table using HiveContext and dumps the result to a csv file on to HDFS. The application runs fine on my cluster (kerberized) when I do spark submit. I do have a valid ticket, so there isn't any issue in submitting the job.

When I run the same job via the Ambari WorkFlow manager, I get a GSS Exception : No Valid Credentials Provided. How do I pass on the user credentials to the workflow?

Thanks
-ak-

2 REPLIES 2

Expert Contributor

Yon can can create workflow by referring below link

https://community.hortonworks.com/articles/88288/spark-action-to-access-hive-using-hivecontext.html

Then you can import it in WFM.

Super Collaborator

I have the hcat credentails as a part of my workflow. Somehow that isn't getting picked up.