Support Questions
Find answers, ask questions, and share your expertise

how to encrypt specific data of file stored in HDFS ?

how to encrypt specific data of file stored in HDFS ?

Expert Contributor

Hi,

I am fetching data(csv) files from SFTP server and storing in HDFS. Using PIG i am converting the csv file in structured format and storing in HIVE. which storing structured data in HIVE, there are some fields i want to encrypt. How can I perform this ?

Thank you.

1 REPLY 1
Highlighted

Re: how to encrypt specific data of file stored in HDFS ?

Mentor

@heta desai

Masking a column in Hive is achieved by using the dynamic column masking feature in Apache Ranger. This is available in HDP2.5 and later.

See this HW document Dynamic Column Masking & Row-Level Filtering furthermore you could enforce it with Atlas tagging

HTH