Member since
03-16-2016
707
Posts
1753
Kudos Received
203
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 6984 | 09-21-2018 09:54 PM | |
| 8740 | 03-31-2018 03:59 AM | |
| 2622 | 03-31-2018 03:55 AM | |
| 2757 | 03-31-2018 03:31 AM | |
| 6185 | 03-27-2018 03:46 PM |
12-26-2016
07:36 PM
2 Kudos
@Mustafa El-badry My recommendation is to downgrade the ojdbc with older version "ojdbc14.jar", then change the ojdbc used in the path where sqoop references (see library paths in $HADOOP_CLASSPATH) and remove the newer "ori18n.jar" to avoid invokation of newer version classes which don't exist in the old ojdbcIf version. This is because you use an old version of Oracle. If this response helped, please vote and accept it as a best answer. I did a bit more research and found that you found the solution yourself. Please post an answer and accept it yourself. You are worth the HCC points.
... View more
12-26-2016
07:21 PM
2 Kudos
@Sergey Paramoshkin Your rdd is getting empty somewhere. The null pointer exception indicates that an aggregation task is attempted against of a null value. Check your data for null where not null should be present and especially on those columns that are subject of aggregation, like a reduce task, for example. In your case, it may be the id field.
... View more
12-26-2016
06:46 PM
1 Kudo
@ALFRED CHAN It is in every region. You have to go to EC2 service first then perform a search. After searching you should see a screen similar with the one that Sagar provided.
... View more
12-26-2016
06:38 PM
Secondly, I recommend you to create it as an external table if you don't want to lose the file neither to change the data (just for view), otherwise you lose the file because this is a Hive ingest when you create it as an internal Hive table.
... View more
12-26-2016
06:28 PM
1 Kudo
@vamsi valiveti If you look at your statement you will see that group by word and order by word are confused because word is part of the subquery also part of the main query. You need to be explicit on which word you want to order and group by. What was the point to use the alias w, if you are not going to use it? SELECT w.word, count(1) AS count FROM (SELECT explode(split(line,'\\s')) AS word FROM docs) w GROUP BY w.word ORDER BY w.word;
... View more
12-26-2016
06:19 PM
1 Kudo
@Maria Khan What is your Kafka version? Is your topic or other underreplicated? This could be due to a network connection temporary glitch. During the glitch the zookeeper nodes likely couldn't reach each other which leadto topic underreplication issues. You could restart brokers as a workaround.
... View more
12-26-2016
02:51 AM
1 Kudo
@Alicia Alicia What is on your 8080 port? http://localhost:8080 Per https://spark.apache.org/docs/1.4.1/spark-standalone.html, spark master web ui is 8080
... View more
12-25-2016
03:57 PM
@Aditya Mamidala Could you edit your question to separate problem description and text from code? You have some text at the end of the code block. It will be easier for contributors to respond. Additionally, please add more of the exception block (especially the CAUSED BY block). How many brokers in the cluster? Thanks.
... View more
12-24-2016
09:14 PM
3 Kudos
@Alicia Alicia if I understand correctly, you run Spark locally. Could you check what is running on your local port 4040? I assume that you use a Linux-like kernel, including mac OS: lsof -i :4040 | grep LISTEN Write down the PID and use the following command to learn more ps -ef WhatEverPID If you have something else running on the port, then that's your issue. You have to stop and start Spark to use a different port for Web UI. Please make sure that is available. It is unlikely that you have a firewall blocking port 4040, but that is another potential cause.
... View more
12-24-2016
08:56 PM
@Ashnee Sharma Set authentication.ldap.pagination.enabled property to false in the /etc/ambari-server/conf/ambari-properties file to disable result paging controls. See my response on the other question that you asked about LDAP synching. This step was necessary and missed in the other thread response you applied.
... View more