Cloudera Community
gbraccialli3
user rank
Guru

Re: Using Hive UDF/UDAF/UDTF with SparkSQL

by Guru in Community Articles
‎11-11-2015 02:57 AM
‎11-11-2015 02:57 AM
@azeltov@hortonworks.com I tried now and getting ClassNotFoundException with z.load("/path/to/jar") and also with maven local repo dependency. Could you make it work with zeppelin? ... View more

Re: Using Hive UDF/UDAF/UDTF with SparkSQL

by Guru in Community Articles
‎11-10-2015 09:41 PM
1 Kudo
‎11-10-2015 09:41 PM
1 Kudo
@azeltov@hortonworks.com see below github project for hive udf, exactly same jar built for hive project works fine with spark. The scala code is above: https://github.com/gbraccialli/HiveUtils ... View more

Spark MLBase (MLI and ML Optimizer) status

by Guru in Support Questions
‎11-09-2015 06:20 PM
‎11-09-2015 06:20 PM
Does anyone know the status of project MLBase: "Implementing and consuming Machine Learning at scale are difficult tasks. MLbase is a platform addressing both issues, and consists of three components -- MLlib, MLI, ML Optimizer." It seems that project and related information are not being updated for last 2 years: http://www.mlbase.org/ http://www.cs.berkeley.edu/~ameet/mlbase_website/mlbase_website/download.html https://github.com/amplab/MLI http://ampcamp.berkeley.edu/wp-content/uploads/2013/07/amp_camp_8_30_13-1.pdf ... View more

Re: Apache Zeppelin Walk Through

by Guru in Community Articles
‎11-09-2015 02:10 PM
1 Kudo
‎11-09-2015 02:10 PM
1 Kudo
Worth mentioning our Zeppelin Gallery: https://github.com/hortonworks-gallery/zeppelin-notebooks ... View more

Re: What size of tables make the best out of ORC f...

by Guru in Support Questions
‎11-09-2015 01:32 PM
1 Kudo
‎11-09-2015 01:32 PM
1 Kudo
Regarding table size, it can be tunned using stripe size, compress size and indexes, see this documentation: http://orc.apache.org/docs/hive-config.html About performance, I believe ORC will have better performance than text files in most of the situations, but I would say Avro or SequenceFile will have a better performance for queries/use cases that needs full scans with all the columns (in tables with lots of columns). There might be an overhead for ORC to rebuild lines with lots and lots of columns. ... View more

Re: New Visualization Feature in Hive View

by Guru in Community Articles
‎11-06-2015 03:55 PM
‎11-06-2015 03:55 PM
Same happened to me. I was shoing ambari views after a cluster installation to a prospect and prospect clicked on the Data Visualization tab. I said: WOW!!!! I haven't seen this before!!! Good stuff! ... View more

Zeppelin + SparkR

by Guru in Support Questions
‎11-05-2015 02:32 AM
2 Kudos
‎11-05-2015 02:32 AM
2 Kudos
does zeppelin support SparkR interpreter? ... View more
Labels:

Re: Tez with Transaction with Bucketing

by Guru in Support Questions
‎11-04-2015 11:45 AM
‎11-04-2015 11:45 AM
@pbalasundaram@hortonworks.com, @Ryan Templeton and @ravi@hortonworks.com found same issue. I think @ravi is interacting with engineering in order to fix or workaround it. ... View more

Old Nagios/Ganglia monitoring

by Guru in Support Questions
‎11-03-2015 03:06 PM
‎11-03-2015 03:06 PM
A prospect with Ambari 1.7 / HDP 2.2 still planing upgrade to Ambari 2.1.2 needs to setup SNMP traps and provide rest metrics/service to his current monitoring tools. Is it possible? Do we have any documentation for this using Nagios/Ganglia? ... View more
Labels:

Re: Azure (Linux VM) & HDP Demo

by Guru in Community Articles
‎11-02-2015 11:11 PM
‎11-02-2015 11:11 PM
@Neeraj what would be the steps to use WASB in a cluster deployed using cloudbreak? Would that work if I just add key to hdfs-site? ... View more
Contact Me
Online
Offline
Last Visited
‎09-28-2021 03:33 PM
Community Statistics
Member Since ‎09-25-2015 05:42 PM
Last Visited ‎09-28-2021 03:33 PM
Posts 230
Kudos received 236