Member since
04-03-2019
962
Posts
1743
Kudos Received
146
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
11539 | 03-08-2019 06:33 PM | |
4914 | 02-15-2019 08:47 PM | |
4172 | 09-26-2018 06:02 PM | |
10604 | 09-07-2018 10:33 PM | |
5678 | 04-25-2018 01:55 AM |
05-31-2016
05:07 AM
@shyam gurram - Good question. I will try this and keep you updated.
... View more
05-30-2016
06:43 PM
@Manish Bhandari - Yes thats correct. Please have a look at http://hortonworks.com/wp-content/uploads/2016/02/Import_on_Vbox_3_1_2016.pdf for minimum requirements.
... View more
05-30-2016
06:27 PM
2 Kudos
@Subramanian Santhanam Please check why you have 6 disks failures. For a workaround you can do what Rahul has suggested in his answer or you can increase value of below property to allow datanode to tolerate X number of disks failures. dfs.datanode.failed.volumes.tolerated - By default this is set to 0 in hdfs-site.xml
... View more
05-30-2016
06:24 PM
2 Kudos
@omkar pathallapalli Can you please click on magnifier icon at the end of your console url (middle window in your screenshot), that will take you to resource manager UI --> Then click on Mapper --> logs --> check stderr logs This looks like classnotfound exception.
... View more
05-30-2016
10:25 AM
3 Kudos
@nejm hadjmbarek Set below property in oozie-site.xml to * to resolve this issue hadoop.proxyuser.oozie.host
... View more
05-28-2016
09:20 PM
3 Kudos
@Tajinderpal Singh Below are the valid examples for running hive queries
Example of running a query from the command line $HIVE_HOME/bin/hive -e 'select a.col from tab1 a' Example of setting Hive configuration variables $HIVE_HOME/bin/hive -e 'select a.col from tab1 a' --hiveconf hive.exec.scratchdir=/home/my/hive_scratch --hiveconf mapred.reduce.tasks=32
Example of dumping data out from a query into a file using silent mode $HIVE_HOME/bin/hive -S -e 'select a.col from tab1 a' > a.txt
Example of running a script non-interactively from local disk $HIVE_HOME/bin/hive -f /home/my/hive-script.sql
Example of running a script non-interactively from a Hadoop supported filesystem (starting in Hive 0.14) $HIVE_HOME/bin/hive -f hdfs://<namenode>:<port>/hive-script.sql
$HIVE_HOME/bin/hive -f s3://mys3bucket/s3-script.sql
Example of running an initialization script before entering interactive mode $HIVE_HOME/bin/hive -i /home/my/hive-init.sql
... View more
05-28-2016
09:17 PM
5 Kudos
@Manish Bhandari Please try below steps: 1. You are logged in as root user so you can easily change permission of any file/directory using below command chown root:root -R /var/log/ambari-server 2. Try to check logs again by less/cat command 3. Please check if your ambari-server is running service ambari-server status 4. If its not running then please try to start it using below command service ambari-server start 5. If ambari-server is running, can you please check if it is listening on port 8080? netstat -tulpn|grep 8080 6. If above command shows that your ambari-server is running however you are still unable to access it from your local machine then please check if your home/corporate firewall is blocking connection to 8080. Please try to telnet to 8080 from your local machine, if you are using windows then try to run telnet command from cmd telnet <ambari-server-ip-address> 8080 7. If you find that your ambari-server is running and listening on 8080 then you can check your virtualbox port frowarding settings, please refer below link to verify your VirtualBox network settings https://community.hortonworks.com/questions/17168/lab-0-setup-start-the-sandbox-vm-and-open-ambari.html 8. If above step doesn't work then you can create SSH tunnel and can access ambari UI via http://localhost:8080 from your browser Run below command from your terminal if you are using Mac/Linux ssh -L 8080:<ambari-server-ip-address>:8080 root@<ambari-server-ip-address> Hope this information helps! Happy Hadooping 🙂
... View more
05-26-2016
03:31 PM
@omkar pathallapalli - Can you please provide your workflow.xml ?
... View more
05-24-2016
06:23 PM
3 Kudos
@hari kiran This looks like a performance issue: 1. Are you using physical servers or virtual machines? 2. Have you disabled THP(Transparent Huge Pages)? 3. What is MTU set to? 4. How many disks have been configured on each Datanode? 5. Are you using shared disks for datanode storage? 6. Did you check disk I/O using iostat command? If yes then have you noticed high read/writes? 7. If you are using Virtual machines then can you please check if network is working fine? You can check /var/log/messages and output of dmesg command to see if network is okay. 8. Please see what are the values configured for datanode and namenode handler count. Please also have a look at suggestions given by @Sagar Shimpi
... View more
05-24-2016
04:56 PM
1 Kudo
@nejm hadjmbarek - You already have 6 containers running and 100% memory is utilized (2GB out of 2GB) hence Oozie launcher is unable to get resources. Can you please click on 1 unhealthy node (click on 1) and see what is the issue, if you get that node back then you will have more capacity. Also, Please check running applications, you can kill them if they are stuck or not important! ( Please kill them at your own risk, if those jobs are important then please do not kill 🙂 )
... View more