https://community.cloudera.com/t5/Support-Questions/Distcp-with-wildcard/m-p/307203#M223159 <P>I haven't been able to try this with distcp, but a similar thing happens with hdfs dfs commands. What I found is if you have your target folder created (e.g. hdfs dfs -mkdir /e/f/), then copying into that folder will give you all of your CSVs as separate files. If you don't have /e/f/ created ahead of time, then Hadoop will create it for you and rename your source csv to be called "f". Hope that makes sense and helps.</P> Tue, 08 Dec 2020 21:23:48 GMT aakulov 2020-12-08T21:23:48Z https://community.cloudera.com/t5/Support-Questions/Distcp-with-wildcard/m-p/307129#M223105 <P>I want to copy only csv files from on directory into another, I use the command:</P><P>hadoop distcp /a/b/*.csv /e/f/</P><P>&nbsp;</P><P>The issue here is, if there's multiple csv files under /a/b/, this command would work, it will copy all csv files into the directory /e/f/, however, if there's only one csv file, it will be copied into /e/f where f is a file not a directory, is there a way to resolve this? Thanks in advance!</P><P>&nbsp;</P> Mon, 07 Dec 2020 23:18:01 GMT https://community.cloudera.com/t5/Support-Questions/Distcp-with-wildcard/m-p/307129#M223105 R0tary 2020-12-07T23:18:01Z https://community.cloudera.com/t5/Support-Questions/Distcp-with-wildcard/m-p/307203#M223159 <P>I haven't been able to try this with distcp, but a similar thing happens with hdfs dfs commands. What I found is if you have your target folder created (e.g. hdfs dfs -mkdir /e/f/), then copying into that folder will give you all of your CSVs as separate files. If you don't have /e/f/ created ahead of time, then Hadoop will create it for you and rename your source csv to be called "f". Hope that makes sense and helps.</P> Tue, 08 Dec 2020 21:23:48 GMT https://community.cloudera.com/t5/Support-Questions/Distcp-with-wildcard/m-p/307203#M223159 aakulov 2020-12-08T21:23:48Z