Hi, Full Hive documentation regarding table creation can be found here: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL I think that should be enough for you to start with. ... View more

It is CSV, so I assume that it is "," delimited? You will need to tell that to Hive: CREATE TABLE IF NOT EXISTS Auto_Insurance_Claims_US (Customer String,Country String,StateCode String,State String,ClaimAmount Float,Response String,Coverage String,Education String,EffectiveToDate String,EmploymentStatus String,Gender String,Income String,LocationCode String,MaritalStatus String,MonthlyPremiumAuto String,MonthsSinceLastClaim String,MonthsSincePolicyInception String,NumberOfOpenComplaints Int,NumberOfPolicies Int,PolicyType String,Policy String,ClaimReason String,SalesChannel String,TotalClaimAmount Float,VehicleClass String,VehicleSize String) ROW FORMAT DELIMITED FIELDS TERMINATED BY "," STORED AS TEXTFILE; Try and see if it works for you. ... View more

Hi, The first one "Hive Metastore Connection Timeout" is the one you should try. If you look closely, "hive.metastore.client.socket.timeout" is just underneath it. Regarding the JIRA ID, it is an internal JIRA, so you do not have access to it. Another way is to setup a quick script to drop partition in batches and and then drop the table after number of partitions have reduced to a reasonable level. ... View more

Hi, This is a known issue and we have an internal JIRA to track it. Current there is no better way to improve the performance. You can, however, to increase the timeout limit via "hive.metastore.client.socket.timeout", and set it to long time value (in seconds) to allow the query to finish. It should finish eventually, but might take sometime. Our engineers are still discussing internally to see the best fix for the issue, however, it is on going and we do not have solution yet at this stage. ... View more

Impala won't be able to create gzip compression format for text file. Please refer to below documentation: https://www.cloudera.com/documentation/enterprise/latest/topics/impala_file_formats.html It mentioned below: For text format, if LZO compression is used, you must create the table and load data in Hive. If other kinds of compression are used, you must load data through LOAD DATA, Hive, or manually in HDFS. So the short answer is that you can't do it in Impala. ... View more

Currently Hue is the only tool I know that provides full list of access to the Hadoop ecosystem for end users. Regarding tools for Data Scientists, have you tried to explore Cloudera Data Science Workbench (CDSW)? ... View more