Hi guys, I am trying to install R on Hortonworks Sandbox, referring this right now: https://github.com/randerzander/r-service Install step got successful but getting the following error in Check R step. resource_management.core.exceptions.Fail: Execution of 'R --file=/var/lib/ambari-agent/cache/stacks/HDP/2.5/services/r-service/package/scripts/r/smoke_test.r' returned 1. Error in objects(db.pos, all.names = TRUE) : 2 arguments passed to .Internal(ls) which requires 3 Execution halted This repo was meant for HDP2.2 but I am using with 2.5, is there a updated version for this repo? ... View more

I am using Spark 1.6.2 and I have a data frame like this: |Extension| |gif | |gif | |gif | |gif | |html | |gif | |html | |html | | | | | |gif | As you can see, there are some blank rows. They are not null because when I ran isNull() on the data frame, it showed false for all records. Then I thought of replacing those blank values to something like 'None' using regexp_replace. It does not affect the data frame column values. Running the following command right now: %pyspark from pyspark.sql.functions import * extension_df3 = extension_df1.select(regexp_replace('Extension','\\s','None').alias('Extension')) extension_df3.show(100,truncate=False) I am replacing on the basis of white space which I guess is wrong. Can somebody please guide me how to do it? ... View more