Member since
11-01-2018
14
Posts
6
Kudos Received
0
Solutions
01-02-2019
08:34 AM
The delta file can be compressed according to this configuration, but if it is a file like base, it will not be compressed. How can I set it up?
... View more
01-02-2019
01:07 AM
What parameters control the threshold triggering these compressions?
... View more
12-28-2018
01:19 AM
Labels:
- Labels:
-
Apache Hive
12-27-2018
02:36 AM
After configuring those parameters, I made an error report. The error message is as follows: Error: Error while compiling statement: FAILED: SemanticException [Error 10265]: This command is not allowed on an ACID table default.ddd with a non-ACID transaction manager. Failed command: create table ddd (id int) (state=42000,code=10265)
... View more
12-27-2018
01:20 AM
1 Kudo
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
12-26-2018
07:42 AM
1 Kudo
I use hive 3.0,which is the information I provided
... View more
12-26-2018
07:04 AM
1 Kudo
My table is a normal table. When insert overwrite, I found that I would put the old data under the HDFS directory into a folder such as base_0000003. Why not put the old data into the HDFS recycling station, which I can not understand.
... View more
12-26-2018
02:45 AM
1 Kudo
Labels:
- Labels:
-
Apache Hadoop
-
Apache Hive
11-15-2018
01:43 AM
18/11/15 08:47:40 INFO mapreduce.ImportJobBase: Transferred 76 bytes in 32.7027 seconds (2.324 bytes/sec)
18/11/15 08:47:40 INFO mapreduce.ImportJobBase: Retrieved 19 records.
18/11/15 08:47:40 INFO mapreduce.ImportJobBase: Publishing Hive/Hcat import job data to Listeners for table FAFAFA
18/11/15 08:47:40 DEBUG hive.HiveImport: Hive.inputTable: FAFAFA
18/11/15 08:47:40 DEBUG hive.HiveImport: Hive.outputTable: default.fafafa
18/11/15 08:47:40 DEBUG manager.OracleManager: Using column names query: SELECT t.* FROM FAFAFA t WHERE 1=0
18/11/15 08:47:40 DEBUG manager.SqlManager: Execute getColumnInfoRawQuery : SELECT t.* FROM FAFAFA t WHERE 1=0
18/11/15 08:47:40 DEBUG manager.OracleManager$ConnCache: Got cached connection for jdbc:oracle:thin:@192.168.1.93:1521:orcl/sqoop
18/11/15 08:47:40 INFO manager.OracleManager: Time zone has been set to GMT
18/11/15 08:47:40 DEBUG manager.SqlManager: Using fetchSize for next query: 1000
18/11/15 08:47:40 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM FAFAFA t WHERE 1=0
18/11/15 08:47:40 DEBUG manager.SqlManager: Found column NAME of type [12, 500, 0]
18/11/15 08:47:40 DEBUG manager.OracleManager$ConnCache: Caching released connection for jdbc:oracle:thin:@192.168.1.93:1521:orcl/sqoop
18/11/15 08:47:40 DEBUG hive.TableDefWriter: Create statement: CREATE TABLE IF NOT EXISTS `default.fafafa` ( `NAME` STRING) COMMENT 'Imported by sqoop on 2018/11/15 00:47:40' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\001' LINES TERMINATED BY '\012' STORED AS TEXTFILE
18/11/15 08:47:40 DEBUG hive.TableDefWriter: Load statement: LOAD DATA INPATH 'hdfs://hunan001:8020/user/hive/FAFAFA' OVERWRITE INTO TABLE `default.fafafa`
18/11/15 08:47:40 INFO hive.HiveImport: Loading uploaded data into Hive
18/11/15 08:47:43 INFO hive.HiveImport: SLF4J: Class path contains multiple SLF4J bindings.
18/11/15 08:47:43 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
18/11/15 08:47:43 INFO hive.HiveImport: SLF4J: Found binding in [jar:file:/usr/hdp/3.0.0.0-1634/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
18/11/15 08:47:43 INFO hive.HiveImport: SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
18/11/15 08:47:43 INFO hive.HiveImport: SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
18/11/15 08:47:46 INFO hive.HiveImport: Connecting to jdbc:hive2://hunan001:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
... View more
Labels:
- Labels:
-
Apache Sqoop