Member since
12-27-2016
4
Posts
0
Kudos Received
0
Solutions
01-07-2017
06:36 AM
Hi, After I run that following command in Terminal I get an error that I can't solve. Any ideas? tried to restart the Spark & Yarn services but didn't help. [cloudera@quickstart ~]$ spark-shell --master yarn-client ERROR spark.SparkContext: Error initializing SparkContext. java.io.FileNotFoundException: File file:/user/spark/applicationHistory does not exist
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache YARN
-
Training
12-27-2016
02:03 AM
I've started the service but still I get the same error. Any ideas? ERROR sqoop.Sqoop: Got exception running Sqoop: org.kitesdk.data.DatasetOperationException: Hive MetaStore exception org.kitesdk.data.DatasetOperationException: Hive MetaStore exception at org.kitesdk.data.spi.hive.MetaStoreUtil.createTable(MetaStoreUtil.java:252) at org.kitesdk.data.spi.hive.HiveManagedMetadataProvider.create(HiveManagedMetadataProvider.java:87) at org.kitesdk.data.spi.hive.HiveManagedDatasetRepository.create(HiveManagedDatasetRepository.java:81) at org.kitesdk.data.Datasets.create(Datasets.java:239) at org.kitesdk.data.Datasets.create(Datasets.java:307) at org.apache.sqoop.mapreduce.ParquetJob.createDataset(ParquetJob.java:141) at org.apache.sqoop.mapreduce.ParquetJob.configureImportJob(ParquetJob.java:119) at org.apache.sqoop.mapreduce.DataDrivenImportJob.configureMapper(DataDrivenImportJob.java:130) at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:267) at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:692) at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:127) at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:507) at org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:111) at org.apache.sqoop.Sqoop.run(Sqoop.java:143) at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218) at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227) at org.apache.sqoop.Sqoop.main(Sqoop.java:236) Caused by: MetaException(message:Got exception: org.apache.hadoop.ipc.RemoteException Cannot create directory /user/hive/warehouse/categories. Name node is in safe mode. The reported blocks 0 needs additional 921 blocks to reach the threshold 0.9990 of total blocks 921. The number of live datanodes 0 has reached the minimum number 0. Safe mode will be turned off automatically once the thresholds have been reached.
... View more