About azeltov

azeltov · ‎11-11-2015

@Ned Shawa I got access to the Zeppelin Hub today, can I use the zeppelin part of the HDP 2.3.2 sandbox or do i need to install from apache zeppelin github?

azeltov · ‎11-11-2015

@Guilherme Braccialli thanks for trying this. I am just starting with my Spark journey, but it seems that any time I try to do in zeppelin or jyputer i keep hitting different issues, I guess I should just stick with CLI for now. I will give demo's in zeppelin @ customer sites but will know the limitations of the product for now.

azeltov · ‎11-11-2015

@Ali Bajwa @Neeraj have u encountered this issue with Pyspark and zeppelin?

azeltov · ‎11-11-2015

You have to switch master to "yarn-client" . I believe you will also need to have HADOOP_CONF_DIR and YARN_CONF_DIR and probably make a copy of those configs from sandbox to a directory that is on your classpath in eclipse. Sorry I have not done it personally

azeltov · ‎11-11-2015

If I execute this code from zeppelin: %pyspark base_rdd = sc.textFile("/tmp/philadelphia-crime-data-2015-ytd.csv") base_rdd.take(10) I am not getting any results back, if U execute from pyspark CLI same code i get valid data. Note: I am running pyspark in local mode in CLI, not in Yarn mode. Zeppelin is not returning any errors, and no errors in log files. I am using HDP 2.3.2 sandbox. Same code works using scala works in zeppelin and in cli Looks like a bug in zeppelin with pyspark?

azeltov · ‎11-11-2015

@Guilherme Braccialli Hopefully that JIRA will be fixed soon. Did you register the custom jar in the local maven of your sandbox? And that still did not work?

azeltov · ‎11-11-2015

That worked! Thanks @Ali Bajwa

azeltov · ‎11-10-2015

Awesome! Will check it out. Another question, i had problems with zeppelin registering a custom jar, i had to use a maven dependency, could not load it using the path. It works fine using CLI and passing --jars path-to-your-hive-udf.jar argument. Curious if u tried it in zeppelin?

azeltov · ‎11-10-2015

@Guilherme Braccialli thanks for the write up. Would love to see a sample implementation of the actual UDF. A basic shell of creating a scala project for the udf.

azeltov · ‎11-10-2015

I am trying to add Jupyter service, but the knox tab is forcing to input the master secret, but the field is greyed out and readonly. Anyone ran into this issue also?

Online	Offline
Last Visited	‎08-14-2019 06:45 PM

Member Since	‎09-29-2015 01:18 AM
Last Visited	‎08-14-2019 06:45 PM
Posts	155
Kudos received	171

Cloudera Community

Re: LivyServer exception

Re: Ranger Dynamic query rewrite available for hiv...

Re: HDP 2.5 + Zeppelin 0.6 + LDAP : Interpreters a...

Re: How to import External Libraries for Livy Inte...

Re: Is Zeppelin in HDP 2.5 support multi-tenancy o...

Re: Apache Zeppelin Walk Through

Re: Using Hive UDF/UDAF/UDTF with SparkSQL

Re: PySpark on Zeppelin in sandbox is not loading ...

Re: Eclipse to Sandbox

PySpark on Zeppelin in sandbox is not loading data

Re: Using Hive UDF/UDAF/UDTF with SparkSQL

Re: When adding new service , Knox tab is requirin...

Re: Using Hive UDF/UDAF/UDTF with SparkSQL

Re: Using Hive UDF/UDAF/UDTF with SparkSQL

When adding new service , Knox tab is requiring ma...