Thanks. Implemented Flume to fetch the weblogs that was transferred to the Hadoop edge server upto HDFS. Also, due to firewall challenges and security implementations and lack of test environment, used an alternative solution of using Zena job scheduler to transfer the log files from ATM machines and mobile web app logs to hadoop edge server. Kafka came as a big challenge since we are using LDAP thus security and authentication issues quickly cropped up. Kudus to your suggestion!
... View more
