Member since
02-01-2019
650
Posts
143
Kudos Received
117
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2612 | 04-01-2019 09:53 AM | |
1376 | 04-01-2019 09:34 AM | |
6473 | 01-28-2019 03:50 PM | |
1484 | 11-08-2018 09:26 AM | |
3609 | 11-08-2018 08:55 AM |
02-23-2017
01:36 PM
1 Kudo
@Oriane Try stopping the services which are not in use. This helps in freeing up the memory so that you can use spark.
... View more
02-23-2017
12:14 PM
1 Kudo
@Balakumar Balasundaram
Since you have tagged Spark , assuming that you are running a spark app on yarn-cluster mode. Create a log4j.properties file and set the log level there and use below command. spark-submit --files file:///home/spark/log4j.properties --driver-java-options "-Dlog4j.configuration=./log4j.properties" --conf "spark.executor.extraJavaOptions=-Dlog4j.configuration=./log4j.properties" --class org.apache.spark.examples.SparkPi --master yarn-cluster --num-executors 3 --driver-memory 512m --executor-memory 512m --executor-cores 1 /usr/hdp/current/spark-client/lib/spark-examples-1.6.2.2.5.3.0-37-hadoop2.7.3.2.5.3.0-37.jar 10 If not Spark, Please use the solution provided by @Jay SenSharma
... View more
02-10-2017
11:51 AM
@Seyma Menjour Here is the example kafka spout code : https://github.com/rajkrrsingh/KafkaSpoutStorm
... View more
02-09-2017
06:05 PM
@James Barney Just realised that workaround for 1 and 2 are same set "spark.sql.hive.convertMetastoreOrc", "false"
... View more
02-08-2017
06:15 PM
@Narasimha K I believe this issue was resolved after removing the old storm directory which was having the content that belongs to HDP 2.3.4 version.
... View more
01-24-2017
08:39 PM
@Timothy Spann Can you confirm if #2 is your case? if yes, I've got a workaround.
... View more
01-24-2017
08:36 PM
2 Kudos
@Satya yarn application log could give the actual error. Can you also check if you have set master inside the code?
... View more
01-17-2017
09:51 AM
@regie canada You can use hive export table command. (https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport#LanguageManualImportExport-ExportSyntax)
... View more
01-05-2017
08:51 PM
@Sergey Paramoshkin Were you able to fix this issue?
... View more
01-05-2017
08:39 PM
@swathi thukkaraju This programming guide should help you : http://spark.apache.org/docs/1.6.1/sql-programming-guide.html
... View more