You can use one of those query to reduce num of file in insert query, so it will increase the file size: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+SortBy#LanguageManualSortBy-SyntaxofClusterByandDistributeBy ... View more

To append data frames in R, use the rbind() function. The rbind() is a built-in R function that  can combine several vectors, matrices, and/or data frames by rows.   When it comes to appending data frames, the rbind() and cbind() function comes to mind because they can concatenate the data frames horizontally and vertically. In this example, we will see how to use the rbind() function to append data frames. ... View more

  Hi @Broche you can use this script.(for hue) For id column, 2 is default value. You don't have to define default value, its optional. ... View more

When you get below error message when doing kinit using a keytab file klist: Unsupported key table format version number while starting keytab scan Make sure that keytab file is not of zero byte  e.g This is Zero byte keytab file and you will get the above error when trying to do kinit with it -rw------- 1 cloudera-scm cloudera-scm 0 Aug 30 12:15 ./32-cloudera-mgmt-SERVICEMONITOR/cmon.keytab A good keytab file will have non-zero size e.g. 778 for the below file  -rw------- 1 cloudera-scm cloudera-scm 778 Oct 12 05:21 ./150-cloudera-mgmt-SERVICEMONITOR/cmon.keytab   ... View more

Do you resolve this problem ? ... View more

Could you share the error ?  Do you have sqoop client being installed on the node ?  whats you mysql cnf file looking  if you have this   skip-networking just comment it out and restart the mysql  i assume it your poc box.   ... View more

@saranvisa you're most welcome! ... View more

hi，man, did you fixed this  problem,i have the same too. ... View more

Not helpful yet, but promising... PIVOT keyword is reserved for future use! https://www.cloudera.com/documentation/enterprise/6/6.2/topics/impala_reserved_words.html ... View more

this helped thanks! ... View more

By default, in Hive, Parquet files are not written with compression enabled.   https://issues.apache.org/jira/browse/HIVE-11912   However, writing files with Impala into a Parquet table will create files with internal Snappy compression (by default). ... View more

can you provide solution for this in Spark2+? Following code working in Spark 1.6 but not in Spark 2.3.0   Class.forName(impalaJdbcDriver).newInstance UserGroupInformation.getLoginUser.doAs( new PrivilegedAction[Connection] { override def run(): Connection = DriverManager.getConnection(impalaJdbcUrl) We are getting following exception   User class threw exception: java.security.PrivilegedActionException: java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://XXx:21050/;principal=impala/XXXX: GSS initiate failed at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:360) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:694) Caused by: java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://XXX:21050/;principal=impala/XXXX@XXX.com: GSS initiate failed at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:231) at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:176) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:664) ..... Caused by: org.apache.thrift.transport.TTransportException: GSS initiate failed Thanks ... View more

Can you please post the code of how you are mentioning the default delimiters. There is an additional parameter you need to specify along witht the --hive-drop-import-delims. So post seeing the code we can provide a solution.  ... View more

I am facing the same issue and can anyone please suggest how to resolve this. On running two spark application , one remains at accepted state while other is running. What is the configuration that needs to be done for this to be working?   Following is the configuration for dynamic resource pool config: Please help!   ... View more

Late reply though. It is indeed possible to export the underlying parquet files of the table with the limitation -  1. Like other file formats support, BlobRef is not supported. 2. Files are read via Kite SDK. Currently Kite requires .metadata present.   https://issues.apache.org/jira/browse/SQOOP-1394 ... View more

Hi, I am also facing the same issue. Not able to load hive table into spark.   I tried to copy the xml files in spark conf folder. But its permission denied and I tries to change the permission for the folder also .That is also not working.   Using cloudera vm 5.12 ... View more

Hello, any update to this ? I see that issue is still open. So does it mean, that there is no way how to increase dashboard download limit at the moment? ... View more

I had the same situation @HMC. I created again the admin user with    hue createsuperuser --cm-managed Without the "--cm-managed" flag it didn't work ... View more

Setting quota will work. Queries will fail with quota errors.  ... View more