hdp 2.5 tech preview: source the same query file a second time and beeline exits with an error

[#1]

I am using beeline with the HDP 2.5 tech preview.

The first time I use the source command to execute a query in beeline, the query succeeds.

The second time I run the same exact source command, beeline exits. Below is the error shown when beeline is started with the --verbose command.

I tried the source with both a newline at the end of the sql file and with no newline but I still see the error.

0: jdbc:hive2://localhost:10500/tpcds_bin_par> source query55.sql;

16/08/15 23:09:49 [main]: WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns does not exist

16/08/15 23:09:49 [main]: WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value

java.lang.ArrayIndexOutOfBoundsException: 1

at org.apache.hive.beeline.Commands.addConf(Commands.java:826)

at org.apache.hive.beeline.Commands.getHiveConfHelper(Commands.java:772)

at org.apache.hive.beeline.Commands.getHiveConf(Commands.java:764)

at org.apache.hive.beeline.Commands.sourceFile(Commands.java:852)

at org.apache.hive.beeline.Commands.executeInternal(Commands.java:932)

at org.apache.hive.beeline.Commands.execute(Commands.java:1150)

at org.apache.hive.beeline.Commands.sql(Commands.java:1065)

at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1144)

at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:975)

at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:885)

at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:501)

at org.apache.hive.beeline.BeeLine.main(BeeLine.java:484)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:606)

at org.apache.hadoop.util.RunJar.run(RunJar.java:233)

at org.apache.hadoop.util.RunJar.main(RunJar.java:148)

Closing: 0: jdbc:hive2://localhost:10500/tpcds_bin_partitioned_orc_10

[#2]

The 2.5 TechPreview is a Tech Preview and you may experience a few bugs. An updated HDP 2.5 will be out soon. Can you post some configuration and hardware details. Is this a VM?

[#3]

I used cloud break with the ETL-ANALYTICS template on AWS.

[#4]

Maybe related to those warnings:

16/08/15 23:09:49 [main]: WARN conf.HiveConf: HiveConf of name hive.llap.daemon.allow.permanent.fns does not exist

16/08/15 23:09:49 [main]: WARN conf.HiveConf: HiveConf hive.llap.daemon.vcpus.per.instance expects INT type value

That one may have changed to:

hive.llap.daemon.allow.permanent.fns tohive.llap.daemon.download.permanent.fns.

can you fix those two values, then restart hive services and ambari-server.

[#5]

@Timothy Spann How do I change the property names in Ambari? I see how to add a new custom property but I need to remove the one that is incorrect.

[#6]

is it under custom? where does it show up?

[#7]

I think the main thing for you to do is to set an INT value for hive.llap.daemon.vcpus.per.instance the wrong name one may just be a warning

[#8 · Accepted solution]

@Timothy Spann I was able to work around the problem by using the !run beeline command:

!run query55.sql

Another alternative is to use the -f option to beeline and avoid the interactive shell altogether:

beeline -i my.settings -u jdbc:hive2://host:10500/my_table -f query.sql