Thanks ! @Arpit Agarwal ... View more

Thanks! @Tom N ... View more

Great! will take note of that, how about in Spark, should I set a buffer on SSDs for DISK persist? ... View more

@Predrag Minovic meaning my config should look like this: Master 1 (NameNode) Raid Configuration: 2 x 300GB – Raid 1 (OS) 2 x 400GB SSD Raid 1(Caching) - HOT (for HDFS) 3 x 2TB Raid 5 (hadoop) - one mount point WARM,COLD,ARCHIVE Worker 2 (DataNode1) Raid Configuration: 2 x 300GB – Raid 1 (OS) 2 x 400GB SSD Raid 1 (Caching) HOT (for HDFS) 3 x 2TB Raid 0 (hadoop) - 3 mount points WARM,COLD,ARCHIVE Worker 3 (DataNode2) Raid Configuration: 2 x 300GB – Raid 1 (OS) 2 x 400GB SSD Raid 1 (Caching) HOT (for HDFS) 3 x 2TB Raid 0 (hadoop) - 3 mount points WARM,COLD,ARCHIVE Should we also remove RAID 1 to SSD? ... View more

In my configuration, setting RAID 1 on OS and in Caching is okay? or should I change it to RAID 0? ... View more

@Matt Clarke done. https://issues.apache.org/jira/browse/NIFI-3588 ... View more

@Matt Clarke upon testing using simple pojo (see code below), I got the same error. public static void main(String[] args) throws SocketException, IOException { FTPClient client = new FTPClient(); client.connect(IP_ADDRESS); client.login(USERNAME, PASSWORD); FTPFile[] files = client. listFiles(DIRECTORY); for (FTPFile file : files) { System.out.println(file.getName()); } } Exception in thread "main" java.io.IOException: Unable to determine system type - response: 500 'SYST': command not understood. at org.apache.commons.net.ftp.FTPClient.getSystemType(FTPClient.java:2801) at org.apache.commons.net.ftp.FTPClient.__createParser(FTPClient.java:3369) at org.apache.commons.net.ftp.FTPClient.initiateListParsing(FTPClient.java:3338) at org.apache.commons.net.ftp.FTPClient.listFiles(FTPClient.java:3016) at me.mamendoza.java.tuts.ftp.BasicFTP.main(BasicFTP.java:35) Then I added this line of code below, // add FTPClientconfig.SYST_UNIX to connect to SunOS v4.1 FTPClientConfig config = new FTPClientConfig(FTPClientConfig.SYST_UNIX); client.configure(config); it returns the list of files. I think ListFTP doesn't support SYST_UNIX. ... View more