@Mahendiran Palani Samy Any updates if the answer resolved your issue please click "Accept" so that the thread is marked as close and can get referenced by other members for similar errors.
... View more
This issue got fixed by doing using single quote like below. val productsRDD=products.map(rec=>{ var r = rec.split('|') (r(0).toInt, r(1).toInt, r(2), r(3), r(4).toFloat, r(5)) })
... View more
After trying multiple options finally fixed this issue to passing per node and rack min sizes. I passed the values are parms to Sqoop like below. sqoop export \
-Dmapreduce.input.fileinputformat.split.minsize.per.rack=749983 \
-Dmapreduce.input.fileinputformat.split.minsize.per.node=749983 \
--connect jdbc:mysql://01-mysql-test232855.envnxs.net:3306/retail_export \
--username autoenv_root \
--export-dir /user/hive/warehouse/retail_db.db/orders \
-table orders\
-P
... View more
This problem got solved after adding "Auto commit" to true. Below is the updated code. val driverClass = "com.microsoft.sqlserver.jdbc.SQLServerDriver"
val connectionProperties = new java.util.Properties()
connectionProperties.setProperty("Driver", driverClass)
connectionProperties.setProperty("AutoCommit", "true")
... View more
