About das_dineshk

asinghal · ‎08-02-2017

You can create a Schema(which is similar to databases) by using following grammar. https://phoenix.apache.org/language/index.html#create_schema Schema will be mapped to a namespace in HBase so your tables can be segregated logically as well as physically. https://phoenix.apache.org/namspace_mapping.html

das_dineshk · ‎04-04-2017

I got the fix. This was all because of docker version mismatching with selinux. I tried to install lesser version of docker and it worked for me yum -y install docker-engine-1.12.6-1.el7.centos docker-engine-selinux-1.12.6-1.el7.centos

das_dineshk · ‎06-20-2017

I believe #39 is wrong. Access after expiry shouldn't be Yes for all (public).Can you please tell me what format the date should be , is it fixed or we can change ?

jillmambetova5 · ‎01-09-2018

IBM offers free courses in Scala and other languages, they are free. There are tests at the end of the course once successful you can earn badges and showcase them. https://cognitiveclass.ai/

92guptahimanshu · ‎02-07-2019

val path = "adl://azuredatalakestore.net/xxx/Budget/*.xlsx" val sc = spark.sparkContext val data = sc.wholeTextFiles(path) var z: Array[String] = new Array[String](7) var i=1 val files = data.map { case (filename, content) => filename } files.collect.foreach(filename => { println(i + "->" + filename) z(i) = filename println(z(i)) i = i + 1})

das_dineshk · ‎02-10-2017

@Joe Widen Thank you Sir, But I think if we do join for a larger dataset memory issues will happen. So in such case can we use if/else or look up function here . My Aim is to match input_file DFwith gsam DF and if CCKT_NO = ckt_id and SEV_LVL = 3 then print complete row for that ckt_id.

erkansirin78 · ‎11-03-2017

I had the same error. Based on this recomendation I added new properties in Zeppelin Spark2 interpreter as spark.deploy.maxExecutorRetries=10 It worked for me.

das_dineshk · ‎02-10-2017

@Binu Mathew Thanks for the python code. Am tryin to do it in both scala n python for knowledge purpose. Am using Spark 1.6.2 . Yes I have created SQLContext.

jwiden · ‎02-08-2017

There is a JDBC RDD function: newJdbcRDD(sc: SparkContext, getConnection: () ⇒ Connection, sql: String, lowerBound: Long, upperBound: Long, numPartitions: Int, mapRow: (ResultSet) ⇒ T = JdbcRDD.resultSetToObjectArray)(implicit arg0: ClassTag[T])

das_dineshk · ‎02-09-2017

Hi Frank lu Can you provide me the code with the example i didnt exactly what you are saying

Online	Offline
Last Visited	‎08-13-2020 10:35 PM

Member Since	‎12-19-2016 01:09 PM
Last Visited	‎08-13-2020 10:35 PM
Posts	149
Kudos received	15

Cloudera Community

Re: Unable to install/start docker.

Re: how do I copy a file from aws ec2 instance to...

Re: Create database in Phoenix

Re: Unable to install/start docker.

Re: Using Atlas and Ranger to Enforce Data Expirat...

Re: Scala Certification

Re: How can I read all files in a directory using ...

Re: Can I join 2 dataframe with condition in colum...

Re: org.apache.spark.sql.AnalysisException: Table ...

Re: Comparing sql data with text file using Spark.

Re: Load MYSQL table in to RDD

Re: how can i delete older partitions data in hive