I am trying to insert rows into Hive using DataStage. Just selecting rows from the source is very fast, and writing to HDFS isvery fast. Performance is really bad when inserting to Hive. The performance starts at almost acceptable levels, somwhere between 5 000 and 20 000 rows pr. second. After some 600 000-700 000 rows performance starts dropping severely. After a couple of million rows it drops to somewhere between 30 and 300 rows pr. second. That is totally unacceptable. Please help.
... View more