Reply
New Contributor
Posts: 5
Registered: ‎11-01-2016

How to decrypt a PGP file in Hadoop using either Scala or Shell script

Hi,

 

Can we decrypt a PGP file in Hadoop by using Scala or Shell script.

 

for more details regarding PGP PGP_Wiki

 

Thanks,

Raghunath.

Thanks,
L Raghunath.
Cloudera Employee
Posts: 447
Registered: ‎08-11-2014

Re: How to decrypt a PGP file in Hadoop using either Scala or Shell script

You can use a library, or you can possibly invoke the gpg binary locally. I don't think this is specific to Spark or Scala.

New Contributor
Posts: 5
Registered: ‎11-01-2016

Re: How to decrypt a PGP file in Hadoop using either Scala or Shell script

Hi Srowen,

 

You are correct it is not specific to Spark or scala. Do we have any process to invoke gpg binary or Jar library.

 

I tried below 2 cases.

 

Case 1:
GPG binary is installed on all nodes (Data nodes and Edge node).In this process I am able to decrypt local file (file on edge node) but when I try to decrypt HDFS file I got error as no file found.

 

Case 2:
I found a third party Jar file, which is working fine with Edge node file as Case 1. When I try to decrypt HDFS file, throws error file not found.

 

Thanks,
Raghunath.

Thanks,
L Raghunath.
Announcements

Currently incubating in Cloudera Labs:

Envelope
HTrace
Ibis
Impyla
Livy
Oryx
Phoenix
Spark Runner for Beam SDK
Time Series for Spark
YCSB