@Allen Niu This might be a tad bit late; however if you want your team to be more experienced developers I would certainly shoot for Spark and Hive. Both components have libraries and jars that support one another and the Spark API makes learning how to develop in Java, Scala, and Python super easy. I personally started to learn how to code in C# and translated those skills into Python and Scala for Spark ML Lib, Spark Core, and Spark SQL. Might be a little biased as I am a BIG SPARK junkie 😉 But the ability to clean data with SPARK at scale is ABSOLUTELY brilliant. I know hortonworks has some great development courses for Spark and Hive as well. Here is the link: https://hortonworks.com/services/training/certification/hdp-certified-spark-developer/ What was your final decision?
... View more
