I have the same issue and in my case it is a Kerberos-enabled cluster. I modified the beeline command as follows:   ${HIVE_HOME}/bin/beeline -u "jdbc:hive2://<server_name>:10015/default ssl=true;principal=<principal_name>/<hostname>@<REALM>;auth=kerberos; '' ''" "$@"   I get two errors: - Unknown HS2 problem when communicating with Thrift server. - Error: Could not open client transport with JDBC Uri: jdbc:hive2://<node_name>:10015/default: Invalid status 21 (state=08S01,code=0)   I would appreciate any help. ... View more

Our installation had the password hash in another table.   update ambari.user_authentication set authentication_key='538916f8943ec225d97a9a86a2c6ec0818c1cd400e09e03b660fdaaec4af29ddbb6f2b1033b81b00' where user_id='1'     Note: user_id=1 was the admin in my case.   ... View more

Yes this is possible.    You need to kinit with the username that has been granted access to the SQL server DB and tables.  integrated security passes your credentials to the SQL server using kerberos   "jdbc:sqlserver://sername.domain.co.za:1433;integratedSecurity=true;databaseName=SCHEMA;authenticationScheme=JavaKerberos;"   This worked for me.  ... View more

you should install ambari-server and ambari-agent on the first node wich you want to install hdfs service for example . the other nodes install ambari-agent only . dont forget to change (ambari-agent.ini ) hostname and the hosts file with (ip and hostname of all machines. ... View more

Sigh. I've looked at literally dozens of forum posts, and every single one has a different connection string. 'this works for me'. 'that works for me'. 'you have to have thrift.py version whatever. ' 'this set of modules with these specific versions work for me.'   It's hopeless. there is simply NO generalized version of an ODBC or OLEDB connection string that will work to connect to a kerberized hive 2 server. For SQL server it's so eeeasy and siiimple, and it ALWAYS works if you have the right drivers setup:   TheConnectionString = "DRIVER={SQL Server};" & _ "SERVER=servername;" & _ "Database=databasename;" & _ "UID=windowsuserid;" & _ "PWD=windowspassword"   So apparently for python connecting to hiveserver 2 you have to experiment and experiment and experiment for a long, long time trying dozens of different strings, and then one of them will FINALLY work. ... View more

with newer versions of spark, the sqlContext is not load by default, you have to specify it explicitly :   scala> val sqlContext = new org.apache.spark.sql.SQLContext(sc) warning: there was one deprecation warning; re-run with -deprecation for details sqlContext: org.apache.spark.sql.SQLContext = org.apache.spark.sql.SQLContext@6179af64 scala> import sqlContext.implicits._ import sqlContext.implicits._ scala> sqlContext.sql("describe mytable") res2: org.apache.spark.sql.DataFrame = [col_name: string, data_type: string ... 1 more field]  I'm working with spark 2.3.2 ... View more

Awesome.It worked for me. ... View more

Okay so I wrote an example nifi process to do it   https://www.datainmotion.dev/2020/01/flank-stack-nifi-processor-for-kafka.html ... View more

How did you resolve the issue ? ... View more

https://github.com/apache/oozie/blob/9c288fe5cea6f2fbbae76f720b9e215acdd07709/webapp/src/main/webapp/oozie-console.js#L384  ... View more

@Augustine ,   Thanks for the feedback. I have corrected the answer and thank you for reporting this.   Cheers, Li ... View more

Hi all!!   Im noob but i can execute a oracle procedure into a package using PutSql Processor. So enjoy it.. PutSql Processor configuration Oracle Sentence   declare codigo NUMBER; mensaje VARCHAR2(500); begin pkg_name.prc_name(${block},${txseq},${item},codigo,mensaje); end;   Package create or replace PACKAGE pkg_name is PROCEDURE prc_name ( p_block IN NUMBER, p_txseq IN NUMBER, p_item IN NUMBER, p_cod_error OUT NUMBER, p_msj_error OUT VARCHAR2 ); end pkg_name; Body create or replace PACKAGE BODY pkg_name IS PROCEDURE prc_name ( p_block IN NUMBER, p_txseq IN NUMBER, p_item IN NUMBER, p_cod_error OUT NUMBER, p_msj_error OUT VARCHAR2 ) IS v_id VARCHAR2(20); v_tag VARCHAR2(20); v_item_id VARCHAR2(20); e_error EXCEPTION; e_no_procesado EXCEPTION; BEGIN UPDATE paf_tablename paf SET paf.status = 'P', paf.cod_err = 0, paf.msg_err = 'Procesado' WHERE paf.block = p_block AND paf.item = p_item AND paf.txseq = p_txseq; p_cod_error := 0; p_msj_error := 'correcto'; EXCEPTION WHEN OTHERS THEN p_cod_error := 9000; p_msj_error := 'Error al procesar bloque ' || p_block || ' Transaccion ' || p_txseq || ' item ' || p_item || ' ' || substr(sqlerrm, 1, 100); END prc_name; END pkg_name; Sorry my english. ... View more

In order to run a balancer on only one data node hdfs balancer -include -f <#datanode name can be specified> this would balance the data load on that particular DN. ... View more

It really works after replacing ';' with '\073' ! I met this problem when using split and ';' in crontab hql, it returns " ParseException line 3:121 cannot recognize input near '<EOF>' '<EOF>' '<EOF>' in select expression". ... View more

Hi,   Can you share the error message from spark history server logs when the spark history UI is crashing?   Thanks AKR ... View more

@adelgacem can you share sample for how you invoked Oozie using InvokHttp processor? I'm trying to run Oozie workflow from NIFI it will be a great help if you can share NIFI processor configuration details. ... View more

@Venu Shanmukappa how did u add the proxy.. can u pls explain ... View more