Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

I am trying to process 750 MB of dim table in Kylin and got below exception .

Solved Go to solution

I am trying to process 750 MB of dim table in Kylin and got below exception .

New Contributor
va.lang.IllegalStateException: Table snapshot should be no greater than 300 MB, but TableDesc [database=test_db name=TEST_KYLIN] size is 725341200
at org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:95)
at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:205)
at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:60)
at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
at org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictionaryJob.java:52)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:62)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
1 ACCEPTED SOLUTION

Accepted Solutions

Re: I am trying to process 750 MB of dim table in Kylin and got below exception .

2 REPLIES 2

Re: I am trying to process 750 MB of dim table in Kylin and got below exception .

Re: I am trying to process 750 MB of dim table in Kylin and got below exception .

New Contributor

Thanks for your suggestion . I was able to resolve this issue by setting kylin.table.snapshot.max_mb as 800 MB in kylin_job_conf.xml file .

Don't have an account?
Coming from Hortonworks? Activate your account here