About shaofengshi

shaofengshi · ‎01-08-2019

Hello Somnath, This is a known issue and recorded in https://issues.apache.org/jira/browse/KYLIN-3607. The workaround is: "After I added hbase-hadoop2-compat-*.jar and hbase-hadoop-compat-*.jar into $KYLIN_HOME/spark/jars, then it worked." The two jar files can be found in HBase's lib folder; As you already make the Spark assembly jar, you may need to re-package that and then upload to HDFS. After doting that, just resume Kylin's fail job, it will re-submit the spark job. Ideally, it will be okay.

shaofengshi · ‎01-07-2019

Hello Somnath, Kylin 2.5 needs Spark 2.1 (not Spark 2.2); The guide for Kylin 2.5 is in https://kylin.apache.org/docs/tutorial/cube_spark.html; (the link you provided above is the tutorial for Kylin 2.0, not matched with your version); Please try this: 1) build the assembly jar from the spark 2.1 that shipped with Kylin; 2) copy the sample cube to a new one, edit it, and then change the "engine type" to "spark"; Just take a try, it should be minor issue as many users are using Spark now.

shaofengshi · ‎01-05-2019

What's the version of Kylin and HDP that you're running? Please provide the full error trace for analysis. Also, please set SPARK_HOME to KYLIN_HOME/spark before starting up Kylin. Building Cube

shaofengshi · ‎09-04-2017

I got the same error on Azure HDInsight today, finally I got the solution in: http://kitmenke.com/blog/2017/08/05/classcastexception-submitting-spark-apps-to-hdinsight/ Hope it can help.

shaofengshi · ‎02-19-2016

Dropbox seems be blocked by our corp (security reason). Anyway, that is my issue, I will try to download that from home; Thanks for the reply!

shaofengshi · ‎02-18-2016

Hi Rahul, thanks for looking info; I'm also using a CentOS server, from US. Still get the same error, I will try more. Thanks for now.

shaofengshi · ‎02-17-2016

Hello, I'm following this tutorial: http://hortonworks.com/hadoop-tutorial/simulating-transporting-realtime-events-stream-apache-kafka/#section_3 Everything works fine before "Step 5: Download the Data"; In this step, need download a zip package from dropbox, but I found that link doesn't work now: wget https://www.dropbox.com/s/rv43a05czfaqjlj/Tutorials-master-2.3.zip --2016-02-17 00:37:50-- https://www.dropbox.com/s/rv43a05czfaqjlj/Tutorials-master-2.3.zip Resolving www.dropbox.com. 108.160.172.238, 108.160.172.206 Connecting to www.dropbox.com|108.160.172.238|:443. connected. Unable to establish SSL connection. In the article's comments part, I see someother user also have the problem. Now I'm blocked here; Could someone check and update the link? Thanks!

shaofengshi · ‎01-05-2016

(sorry for splitting my comments into several posts, as this forum doesn't allow comment more than 600 characters... ) Welcome to join our dev mailing list dev@kylin.apache.org (send to dev-subscribe@kylin.apache.org to subscribe), there are a lot of discussions; Regards, shaofengshi@apache.org

shaofengshi · ‎01-05-2016

6. "The more segments the slower performance can get (more scans)" comment: Yes, usually we suggest user to control the segment number e.g no more than 10, to gain a better query performance; But if the partition date column appears in the filtering condition, Kylin can smartly skip those unrelated segments, for this case, the segment number doesn't matter.

shaofengshi · ‎01-05-2016

5. “MDX adoption is very low, therefore its not currently supported” comment: If anyone want to do MDX using Kylin, we suggest try Mondrian, some users has been able to run that successfully, here is a document: https://www.inovex.de/fileadmin/files/Vortraege/2015/big-data-mdx-with-mondrian-and-apache-kylin-sebastien-jelsch-pcm-11-2015.pdf

Online	Offline
Last Visited	‎02-27-2019 01:16 PM

Member Since	‎01-05-2016 07:46 AM
Last Visited	‎02-27-2019 01:16 PM
Posts	21
Kudos received	11

Cloudera Community

Re: Apache Kylin with Spark

Re: Apache Kylin with Spark

Re: Apache Kylin with Spark

Re: Apache Kylin with Spark

Re: java.lang.ClassCastException: org.apache.xerce...

Re: Download link broken in tutorial "Realtime Eve...

Re: Download link broken in tutorial "Realtime Eve...

Download link broken in tutorial "Realtime Event P...

Re: A quick skinny on Apache Kylin

Re: A quick skinny on Apache Kylin

Re: A quick skinny on Apache Kylin