Hi All, I am trying my hands on Apache flume and trying to move my files from Spool Directory to the Specified HDFS path. Once the file gets moved to HDFS,its name changes from original_filename to FlumeData.somenumbers. Is there any way by which we can retain the original file name even after it is moved to HDFS? ... View more

Hi, I've just started to learn and work with Hadoop ecosystem and I am working with Sqoop to import data from Mysql to HDFS. Now in SQOOP reference guide it was mentioned that --direct does not work if we try to import the view from Mysql to HDFS. I tried this to import emp_view into HDFS using following command: sqoop import --connect jdbc:mysql://localhost:3306/vaibhav --username root -P --table emp_view --direct --target-dir /sqoop/view13/ --split-by 'employee_id' -m 1 According to the sqoop reference guide and as per my understanding this command should have failed throwing some exception,but to my surprise it does not throws any exception: I am kind of confused with the output and as I was not expecting the job to get processed successfully. Can somebody please help me here to understand this behaviour. Below follows the logs generated after running the command. <code>Running job: job_201706121442_0003 17/06/12 16:05:47 INFO mapred.JobClient: map 0% reduce 0% 17/06/12 16:06:05 INFO mapred.JobClient: map 100% reduce 0% 17/06/12 16:06:09 INFO mapred.JobClient: Job complete: job_201706121442_0003 17/06/12 16:06:09 INFO mapred.JobClient: Counters: 17 17/06/12 16:06:09 INFO mapred.JobClient: Job Counters 17/06/12 16:06:09 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=18197 17/06/12 16:06:09 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0 17/06/12 16:06:09 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0 17/06/12 16:06:09 INFO mapred.JobClient: Launched map tasks=1 17/06/12 16:06:09 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0 17/06/12 16:06:09 INFO mapred.JobClient: File Output Format Counters 17/06/12 16:06:09 INFO mapred.JobClient: Bytes Written=0 17/06/12 16:06:09 INFO mapred.JobClient: FileSystemCounters 17/06/12 16:06:09 INFO mapred.JobClient: HDFS_BYTES_READ=87 17/06/12 16:06:09 INFO mapred.JobClient: FILE_BYTES_WRITTEN=70349 17/06/12 16:06:09 INFO mapred.JobClient: File Input Format Counters 17/06/12 16:06:09 INFO mapred.JobClient: Bytes Read=0 17/06/12 16:06:09 INFO mapred.JobClient: Map-Reduce Framework 17/06/12 16:06:09 INFO mapred.JobClient: Map input records=1 17/06/12 16:06:09 INFO mapred.JobClient: Physical memory (bytes) snapshot=66703360 17/06/12 16:06:09 INFO mapred.JobClient: Spilled Records=0 17/06/12 16:06:09 INFO mapred.JobClient: CPU time spent (ms)=780 17/06/12 16:06:09 INFO mapred.JobClient: Total committed heap usage (bytes)=15794176 17/06/12 16:06:09 INFO mapred.JobClient: Virtual memory (bytes) snapshot=1068662784 17/06/12 16:06:09 INFO mapred.JobClient: Map output records=0 17/06/12 16:06:09 INFO mapred.JobClient: SPLIT_RAW_BYTES=87 17/06/12 16:06:09 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 26.3005 seconds (0 bytes/sec) 17/06/12 16:06:09 INFO mapreduce.ImportJobBase: Retrieved 0 records. ... View more