Created on
03-23-2020
02:14 PM
- last edited on
03-23-2020
03:30 PM
by
ask_bill_brooks
i have a dir /automation_test/oozie/output/Bigdata_Counts/.i have multiple files in this dir.I want to read only latest file from this directory
Created 03-23-2020 02:40 PM
Please elaborate your question else the simplest way to get the latest file in Linux
$ ls -lrt /automation_test/oozie/output/Bigdata_Counts/
But I guess you want to do that programmatically?
Created 03-23-2020 02:51 PM
I want latest file from hdfs dir.I am using below programm,but it get me all files into dataframe.I want to filter latest file and read only latest file.I am using scala
val fname=spark.read.csv("hdfs://ndwns001.ndw.leidos.com/automation_test/oozie/output/Bigdata_Counts/")