Support Questions

Find answers, ask questions, and share your expertise

Hi, I have created one file called "abc.txt".and i have copied this to hdfs using hdfs dfs -setrep -w 5 -put abc.txt /user/xyz here the replicas will be 5.but after some time i want to delete only 2 replicas of abc.txt. how can i do it?Please help me

avatar
Contributor
 
1 ACCEPTED SOLUTION

avatar
@pavan p

You need to run the -setrep again to set to 3, so that other 2 replicas are removed.

[hive@x ~]$ hdfs dfs -ls /tmp/hive/sgipbal_np2.avsc
-rw-r--r-- 5 hive hdfs55592 2017-01-16 17:41 /tmp/hive/sgipbal_np2.avsc
[hive@x ~]$hdfs dfs -setrep 3 /tmp/hive/sgipbal_np2.avsc
Replication 3 set: /tmp/hive/sgipbal_np2.avsc
[hive@x ~]$ hdfs dfs -ls /tmp/hive/sgipbal_np2.avsc
-rw-r--r-- 3 hive hdfs55592 2017-01-16 17:41 /tmp/hive/sgipbal_np2.avsc

View solution in original post

2 REPLIES 2

avatar
@pavan p

You need to run the -setrep again to set to 3, so that other 2 replicas are removed.

[hive@x ~]$ hdfs dfs -ls /tmp/hive/sgipbal_np2.avsc
-rw-r--r-- 5 hive hdfs55592 2017-01-16 17:41 /tmp/hive/sgipbal_np2.avsc
[hive@x ~]$hdfs dfs -setrep 3 /tmp/hive/sgipbal_np2.avsc
Replication 3 set: /tmp/hive/sgipbal_np2.avsc
[hive@x ~]$ hdfs dfs -ls /tmp/hive/sgipbal_np2.avsc
-rw-r--r-- 3 hive hdfs55592 2017-01-16 17:41 /tmp/hive/sgipbal_np2.avsc

avatar
Contributor

How does yarn or mapreduce gets to know how much resources is given by particular job?

I have a dev team and test team.and i have allocated 20% resources to test team and 40 % resources to dev team.

when test team launch 1 job and dev team launch 1 job.

How does yarn or mapreduce gets to know test team having 20% resources. dev team having 40% resources?.

and how to see which team has launched which job?