Qlikview ODBC connection to Hive

[#1]

Need your input.......Is there a quick way to move data from Hive?

1. Calling ‘Select * from <table>’ to qlick view dashboard

1.4 million records in Hive, they need to load all these records in to Qlikview dash board .Extracting data from Hive to Qlikview takes around 3 hours. Any solution to reduce this time?

My initial thought was to increase the replication factor, pre-warm containers, or put data in memory but curious if folks may know of other things that can be done to increase performance. Maybe there is something that can be done from ODBC side, or even Clikview?

[#2 · Accepted solution]

Hey Dan,

You can speed up the loads, using the “QVD Layer”. QVD (QlikView Data), is a file sitting in file system, it has 1 table in it, and it is already compressed.

You would query Hortonworks in chunks, and create bunch of QVD files in parallel. You can have daily QVDs, or monthly QVDs or yearly QVDs depending on the use case,

Then you can load these QVDs to a QlikView app very quickly (seconds).

Take a look at this article, and the attached white paper.

http://www.quickintelligence.co.uk/qlikview-qvd-files/

also, try increasing the buffer size on the DSN.

Martin