I am trying to process 750 MB of dim table in Kylin and got below exception .

[#1]

va.lang.IllegalStateException: Table snapshot should be no greater than 300 MB, but TableDesc [database=test_db name=TEST_KYLIN] size is 725341200
at org.apache.kylin.dict.lookup.SnapshotManager.buildSnapshot(SnapshotManager.java:95)
at org.apache.kylin.cube.CubeManager.buildSnapshotTable(CubeManager.java:205)
at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:60)
at org.apache.kylin.cube.cli.DictionaryGeneratorCLI.processSegment(DictionaryGeneratorCLI.java:41)
at org.apache.kylin.job.hadoop.dict.CreateDictionaryJob.run(CreateDictionaryJob.java:52)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
at org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:62)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

[#2 · Accepted solution]

@Nelson KA Rajendran

See this http://mail-archives.apache.org/mod_mbox/kylin-user/201602.mbox/%3CCAPprPdRYnPrtWpba6kVHESxO94dUbpCK...

[#3]

Thanks for your suggestion . I was able to resolve this issue by setting kylin.table.snapshot.max_mb as 800 MB in kylin_job_conf.xml file .