- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Run 2 kerberos ticket in a server for transferring data
Created 09-20-2023 04:27 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I want to transfer data from HDP 2.6 with kerberos authentication via spark to CDP with kerberos authentication. I am trying to run 2 kerberos ticket in a server but not able to run. One kerberos ticket will be used for reading data from HDP and second kerberos ticket for writing data in CDP cluster. Anyone has any better idea apart from spark please let me know
Created 10-02-2023 06:26 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Inorder for KDC to allow a client, it must be trusted. Unfortunately you need to have the principle trusted through cross realm trust to allow a client from different KDC
Created 09-20-2023 11:36 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@itsyash001 Welcome to the Cloudera Community!
To help you get the best possible solution, I have tagged our CDP experts @Daming Xue @samglo who may be able to assist you further.
Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
Regards,
Diana Torres,Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Created 09-25-2023 02:51 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@venkatsambath @aakulov Any insights here? Thanks!
Regards,
Diana Torres,Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Created 09-26-2023 07:44 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Can you clarify more on this? Are you doing the kinit in 2 different unix user account or same user account? Are these jobs expected to be triggered in parallel? What is the current issue you are facing?
Created 09-28-2023 01:00 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi we are using 2 different kinit in same unix user account.the job is not parrallel.
Our requirement is such that.
Currently we are using Ambari 2.6.0 and HDFS/YARN version 2.7.3 to write the data in HDFS using spark version 2.x.
We are using airflow as scheduler.
Similarly our use case is to write the data in another HDFS cluster which has CDP in the same spark job we are writing to our HDFS data.
Both the HDFS clusters are kerberised and we are able to connect.
We do not want setup cross-realm trust between 2 cluster but should write data in same spark job to both HDFS.
We tried combining krb5.conf and exported different keytab principal but its not working.
Can you help us how can we achieve this.
Writing data to 2 different kerberised cluster in one spark job(HDP and CDP).
Created 10-02-2023 06:26 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Inorder for KDC to allow a client, it must be trusted. Unfortunately you need to have the principle trusted through cross realm trust to allow a client from different KDC
Created 10-06-2023 04:34 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@itsyash001 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
Regards,
Diana Torres,Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
