About subhrajit

subhrajit · ‎05-01-2018

I have one requirement where I just want to use spark JDBC driver to read oracle data which is encrypted and after processing, I want to load into Oracle and while loading data should be encrypted.

subhrajit · ‎03-18-2018

for Cloudera manager, it needs minimum 8GB RAM. Is there any way I can replace current spark 1.6 version to 2 without using parcel so that I can run the VM with less than 8 GB?

subhrajit · ‎02-15-2018

Hi, I have follwed all the steps to install Spark2 in cloudera vm but getting following error when I am trying to Host spark2 parcel. CDH (5.8 and higher) parcel required for SPARK2 (2.2.0.cloudera2-1.cdh5.12.0.p0.232957) is not available. I am using CDH version : 5.12 and using http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera2/ link for parcel. Please help me with the configurtion.

subhrajit · ‎01-17-2017

dt1 = {'one':[0.3, 1.2, 1.3, 1.5, 1.4, 1],'two':[0.6, 1.2, 1.7, 1.5,1.4, 2]} dt = sc.parallelize([ (k,) + tuple(v[0:]) for k,v in dt1.items()]).toDF() dt.show() I want 'one' and 'two' to be column header and all list values should be column values

subhrajit · ‎07-31-2016

Thanks for the explanation.

subhrajit · ‎05-09-2016

thank you 🙂

subhrajit · ‎05-05-2016

Thanks for replying. if not hive can impala read all versions in HBase?

subhrajit · ‎05-04-2016

Online	Offline
Last Visited	‎07-09-2020 11:50 AM

Date Registered	‎06-29-2016 05:57 AM
Last Visited	‎07-09-2020 11:50 AM
Total Messages Posted	30
Total Kudos Received	5

Can spark read encrypted data from Oracle as well ...

Re: Can I install Spark 2 on the QuickStart VM?

Re: Installing Spark2

How to transpose a pyspark dataframe?

Re: save spark-csv output to hive in HDP 2.3.2

Re: how hive can read Hbase current and previous v...

Re: how hive can read Hbase current and previous v...

how hive can read Hbase current and previous versi...