Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 11-23-2016 05:29 AM
I get the following error. Any suggestions?
Hive Version: 1.5.0
hive> select md5(name) from account limit 1;
FAILED: SemanticException [Error 10011]: Line 1:7 Invalid function 'md5'
https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-Misc.Functions
Created 11-23-2016 07:41 AM
I am not aware of Hive Version 1.5.0 (do you mean Hive View?)
Anyhow, it works on Hive 1.2.1 (as of HDP 2.5)
$ beeline -u "jdbc:hive2://192.168.124.145:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2" -n hive Connecting to jdbc:hive2://192.168.124.145:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2 Connected to: Apache Hive (version 1.2.1000.2.5.0.0-1245) Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive 0: jdbc:hive2://192.168.124.145:2181/> select dept_name, md5(dept_name) from departments limit 1; +-------------------+-----------------------------------+--+ | dept_name | _c1 | +-------------------+-----------------------------------+--+ | Customer Service | d5552e0564007d93ff5937a9cb3bc491 | +-------------------+-----------------------------------+--+ 1 row selected (0.337 seconds)
and on Hive 2.1 (TP in HDP 2.5)
$ beeline -u "jdbc:hive2://192.168.124.145:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2" -n hive Connecting to jdbc:hive2://192.168.124.145:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2 Connected to: Apache Hive (version 2.1.0.2.5.0.0-1245) Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive 0: jdbc:hive2://192.168.124.145:2181/> select dept_name, md5(dept_name) from departments limit 1; +-------------------+-----------------------------------+--+ | dept_name | c1 | +-------------------+-----------------------------------+--+ | Customer Service | d5552e0564007d93ff5937a9cb3bc491 | +-------------------+-----------------------------------+--+ 1 row selected (6.083 seconds)
Created 11-23-2016 07:41 AM
I am not aware of Hive Version 1.5.0 (do you mean Hive View?)
Anyhow, it works on Hive 1.2.1 (as of HDP 2.5)
$ beeline -u "jdbc:hive2://192.168.124.145:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2" -n hive Connecting to jdbc:hive2://192.168.124.145:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2 Connected to: Apache Hive (version 1.2.1000.2.5.0.0-1245) Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive 0: jdbc:hive2://192.168.124.145:2181/> select dept_name, md5(dept_name) from departments limit 1; +-------------------+-----------------------------------+--+ | dept_name | _c1 | +-------------------+-----------------------------------+--+ | Customer Service | d5552e0564007d93ff5937a9cb3bc491 | +-------------------+-----------------------------------+--+ 1 row selected (0.337 seconds)
and on Hive 2.1 (TP in HDP 2.5)
$ beeline -u "jdbc:hive2://192.168.124.145:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2" -n hive Connecting to jdbc:hive2://192.168.124.145:2181/;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2-hive2 Connected to: Apache Hive (version 2.1.0.2.5.0.0-1245) Driver: Hive JDBC (version 1.2.1000.2.5.0.0-1245) Transaction isolation: TRANSACTION_REPEATABLE_READ Beeline version 1.2.1000.2.5.0.0-1245 by Apache Hive 0: jdbc:hive2://192.168.124.145:2181/> select dept_name, md5(dept_name) from departments limit 1; +-------------------+-----------------------------------+--+ | dept_name | c1 | +-------------------+-----------------------------------+--+ | Customer Service | d5552e0564007d93ff5937a9cb3bc491 | +-------------------+-----------------------------------+--+ 1 row selected (6.083 seconds)
Created 11-23-2016 03:41 PM
You were right, it was Hive view version, my bad The Hive version is 1.2.1000.2.4.3.0-227 and we are still on HDP 2.4 stack. It explains why the MD5 won't work.