Hi,  I have a brand new installation of CDH 5.15, where all services (MNG,Impala) are in green. I executed ~10 queries on Impala, and was checking the queries in Cloudera Manager -> Impala Queries. I noticed two issues: - Some of the queries were in the list when there were in "running" state - After the statements were finished, no query were reported in Impala Queries.   The obvious reason could be time filter: I checked 30m, 1h, 2h, 1d, still NO results.  Also another obvious reason can be a search filter. The filter is empty, NO results.   I checked the Service Monitor of CM, it is in green, so I suppose it collects data. I checked the Impala storage ( firehose_impala_storage_bytes) it is 1GB. The only "warning" is about the memory of Service Monitor what is much less, but this is a new cluster, no workload running, and the CM reports that the heap usage is under 1G The recommended non-Java memory size is 12.0 GiB, 10.5 GiB more than is configure   What could be the problem of the empty list? Why Cloudera Manager is not collecting the Impala queries? Or maybe it is, but then why it is not reporting, showing me them?   Thanks  ... View more

Hi,  we are trying to download a bulk of data from CDH cluster via Windows ODBC Driver for Impala version 2.5.22 to a Windows server.  The ODBC driver works well, but the performance of rows dispatching is really bad - roughly 3M rows/minute.  We checked the possible bottlenecks for this kind of download, but the cluster and also the receiving Windows server were not under load at all, the cpu around 5%, the network cards running on 10Gbit, there are plenty of RAM memory, the target disk where the data is written is RAID-0 SSD with 1GB/s max throughput, so we dont know what component on the trasnfer slows down the records.    We tried to run in multiple parallel threads, what helped a little bit (50% perf increase) but the overall perf is still low.. Also tried to tweak the transfer batch size in ODBC driver, it looks that it doesnt affect the performance at all.   The setup is CDH5.3, and Microsoft SQL Server 2014, the Impala is linked via linked server in MS SQL.   Any ideas how to increase the transfer speed? Thanks   Tomas     ... View more

I have a simple pig program, with a simple LOAD and STORE/DUMP statement, but it refuse to load the test data file. The path in HDFS is in /user/dwh/ the file is called test.txt.   I assume the pig is not aware of the HA setting of my cluster, Any ideas?   Input path does not exist: hdfs://nameservice1/user/dwh/test.txt         ... View more

Hey guys,  does cloudera packs piggy UDF into the CDH? I tried to find in the distribution anything called piggybank, but was not succesfull. Can somebody advice me how to add the piggybank UDFs into the existing pig installation in CDH?   https://cwiki.apache.org/confluence/display/PIG/PiggyBank Thanks. Tomas   ... View more

Anybody has an experience how to process xml data (imported from MSSQL) and how to store and analyze them in Impala? Thanks Tomas   ... View more

Hi, running a simple query where in the WHERE condition is a column IN ( ) condition and the list contains 13 elements (numbers). The column is type of int. Every time I run a query I got a different result, sometimes 5 rows, sometimes 2 rows, sometimes 10 rows.    Of course I checked ID by ID that all elements are in the table...   is this a known bug or I am missing something?   select * from tmp_ext_item where item_id in ( 3040607, 5645020, 69772482, 2030547, 1753459, 9972822, 1846553, 6098104, 1874789, 1834370, 1829598, 1779239, 7932306 )   T.       ... View more

Hi guys,  have anybody tried to rename the output of the sqoop import command? It is always named as QueryResult.jar. When we run multiple sqoop import commands in parallel, in Cloudera Manager the Yarn applications does not distinct between them, every command is named as QueryResult.jar.   The sqoop import command looks like:   sqoop import --connect jdbc:sqlserver://OUR.SQL.SERVER.COM --username XXX --query 'select * from XXXXZZZ where Start_Time >= getdate()-7 and $CONDITIONS' -m 6 --split-by Start_Time --as-textfile --fields-terminated-by '\t' --delete-target-dir -z --target-dir /user/sql2hadoop/ext_xxxxzzzz   sqoop import --connect jdbc:sqlserver:// OUR.SQL.SERVER.COM  --username XXX --query 'select * from XXXXYYY  where Start_Time >= getdate()-7 and $CONDITIONS' -m 6 --split-by Start_Time --as-textfile --fields-terminated-by '\t' --delete-target-dir -z --target-dir /user/sql2hadoop/ext_ xxxxyyyyyy   I would like to see in YARN that for example there are two applications running: Import_XXXZZZ.jar and Import_XXXXYYY.jar   Is there any parameter for setting the application name? Thanks   ... View more

Hi guys,  we are trying to read(select count(*)..) the external tables imported via sqoop in impala, but the impala crashes every time. The impala deamon has to be restarted. CDH version 5.2. External table imported via sqoop and loaded to HDFS as textfile, compressed by Gzip. External table definition created in Hive.   If the external table is plain textfile, the Impala is ok with that, so I assume the problem is in decompression.   The query run by impala crashes, does not matter wheter it runs via Impala ODBC driver, or Impala shell.   Does anybody have the same issue? Any ideas what could be wrong?     Thanks Tomas   ... View more

After upgrading from 5.1.2.1 to 5.1.3.1. the cluster fails to start the Sqoop2 server. It fails to load ConnectionManagers. The only thing I changed in sqoop was that I added the Microsoft JDBC driver (jar file) to the lib directory. Even after removing the file the cluster fails to start the Sqoop2 server.   ... View more