https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98708#M61808 <P>Hi I am new to Hadoop Platform and i have been asked to work on the data encryption and decryption.</P><P>Let me give you the background so that you can suggest me how to achieve this task. - I am sqooping the data from Teradata to my HDFS stg/src-a folder and creating external table on stg/src-a and pushing this data to my another layer tgt/input - this one is managed table, once data populated from stg/src-a to tgt/input, will cleanup stg/src-a folder.</P><P>whenever i bring data to stg/src-a, i need to left outer join with tgt/input data to load only newer record and wherever there is a match update to be triggered based on certain conditions. - question is, when i encrypt tgt/input folder it is not allowing to read data to join with stg/src-a external table.</P><P>Question 2: if the above one is successful, i need to expose the data to end-user by splitting total table and for some of the user i need to expose portion of the table by creating views or so. - If anyone of you worked on similar activites, please show some light on that. Thanks</P> Fri, 11 Dec 2015 07:40:37 GMT babuyadav 2015-12-11T07:40:37Z https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98708#M61808 <P>Hi I am new to Hadoop Platform and i have been asked to work on the data encryption and decryption.</P><P>Let me give you the background so that you can suggest me how to achieve this task. - I am sqooping the data from Teradata to my HDFS stg/src-a folder and creating external table on stg/src-a and pushing this data to my another layer tgt/input - this one is managed table, once data populated from stg/src-a to tgt/input, will cleanup stg/src-a folder.</P><P>whenever i bring data to stg/src-a, i need to left outer join with tgt/input data to load only newer record and wherever there is a match update to be triggered based on certain conditions. - question is, when i encrypt tgt/input folder it is not allowing to read data to join with stg/src-a external table.</P><P>Question 2: if the above one is successful, i need to expose the data to end-user by splitting total table and for some of the user i need to expose portion of the table by creating views or so. - If anyone of you worked on similar activites, please show some light on that. Thanks</P> Fri, 11 Dec 2015 07:40:37 GMT https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98708#M61808 babuyadav 2015-12-11T07:40:37Z https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98709#M61809 <P>Are you using Transparent Data Encryption on HDFS?</P> Fri, 11 Dec 2015 09:16:15 GMT https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98709#M61809 deepesh1 2015-12-11T09:16:15Z https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98710#M61810 <P>Are you using Hive? The only support engine for Hive to run with HDFS TDE is MR. Hive on Tez doesn't work yet today but will be in the near future. If you are using Hive on MR, can you post here the exception? What is your ranger policy defined for that encrypted folder? </P> Fri, 11 Dec 2015 11:27:26 GMT https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98710#M61810 rgarcia 2015-12-11T11:27:26Z https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98711#M61811 <P>Yes Deepesh.</P> Tue, 15 Dec 2015 05:55:52 GMT https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98711#M61811 babuyadav 2015-12-15T05:55:52Z https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98712#M61812 <P>Yes I am using Hive not Hive on Tez - I am not sure about the policy what has been defined.</P> Tue, 15 Dec 2015 05:56:53 GMT https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98712#M61812 babuyadav 2015-12-15T05:56:53Z https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98713#M61813 <P>Are you still having issues babu?</P> Tue, 02 Feb 2016 02:50:12 GMT https://community.cloudera.com/t5/Support-Questions/Data-Encryption-and-Decryption-across-the-source-and-Target/m-p/98713#M61813 rgarcia 2016-02-02T02:50:12Z