Member since
05-03-2018
8
Posts
0
Kudos Received
0
Solutions
09-20-2018
09:11 AM
Hello, finally, I found a way to make it work. jdbc/hive or odbchive had the same problem: no ticket kerberos. I tried to connect hive from windows environment (AD) and I get the message: GSS initiate failed The solution was to execute the kinit.exe from java binary (not the one from windows nor MIT).
... View more
09-07-2018
01:13 PM
Hello, that's possible, there is may be something wrong with my kerberos setting on the windows server. when I try kinit, I got this: c:\Program Files\MIT\Kerberos\bin>set KRB5_CONFIG="C:\Program Files\MIT\Kerberos\"
c:\Program Files\MIT\Kerberos\bin>set KRB5CCNAME=%USERPROFILE%\krb5cache
c:\Program Files\MIT\Kerberos\bin>"c:\Program Files\MIT\Kerberos\bin\kinit.exe"
kinit.exe: Configuration file does not specify default realm when parsing name vyea however, in c:\Program Files\MIT\kerberos\krb5.conf, I have this: [libdefaults]
renew_lifetime = 7d
forwardable = true
default_realm = toto.org
ticket_lifetime = 24h
dns_lookup_realm = false
dns_lookup_kdc = false
default_ccache_name = c:\temp\krb5cache\krb5cc_%{uid}
#default_tgs_enctypes = aes des3-cbc-sha1 rc4 des-cbc-md5
#default_tkt_enctypes = aes des3-cbc-sha1 rc4 des-cbc-md5
[domain_realm]
interpol.int = TOTO.ORG
.interpol.int = TOTO.ORG
[logging]
default = FILE:c:\temp\krb5\krb5kdc.log
admin_server = FILE:c:\temp\krb5\kadmind.log
kdc = FILE:c:\temp\krb5\krb5kdc.log
[realms]
TOTO.ORG = {
admin_server = dcibs11
kdc = TOTO.ORG
} (I changed my company name of course)
... View more
09-06-2018
01:39 PM
Hello, I tried to connect hive from a windows server via odbc but without success. My cluster hadoop is kerberized, hive port is 10000
and is open between windows and all the cluster (I did a telnet
serverhive2 10000 and it works) I download HortonworksHiveODBC64.msi and install it. I tried a lot of combination of parameters on "hortons Hive ODBC Driver DSN setup", none of them works, for sample this setting: give me this error: [Hortonworks][Hardy] (34) Error from server:
SASL(-1): generic failure: GSSAPI Error: Unspecified GSS failure. Minor
code may provide more information (Permission denied). [Hortonworks][Hardy] (34) Error from server: SASL(0): successful result: . what have I to do to set correctly my odbc driver
... View more
Labels:
- Labels:
-
Apache Hive
08-27-2018
01:35 PM
Ok, thanks
... View more
08-24-2018
07:29 AM
Hello,
I would like to create an hive table which take as input something like this: ...
-----------------------------------------------------------------------------------------------------
USER INFO: mickey.zak.nl,mickey Zak,NL,ADMIN
TIME : 15/08/2018 14:26:54
OPERATION : WOA APRROVED ,DATABASE psyche
DATA RECEIVED :
-----------------------------------------------------------------------------------------------------
USER INFO: mickey.zak.nl,mickey Zak,NL,ADMIN
TIME : 15/08/2018 14:26:54
OPERATION : WOA APRROVED ,DATABASE psyche
DATA RECEIVED :
-----------------------------------------------------------------------------------------------------
... and have 3 fields "USER INFO","TIME","OPERATION". So my regex have to process a string beginnig with a line of "-" and ending with a line of "-" I try lot of regex which work fine with java regex, python regex or ruby regex but none of them works with hive, for sample I tried this: CREATE EXTERNAL TABLE `auditpsyche_regex`( `userinfo` string COMMENT '', `time` string COMMENT '', `operation` string COMMENT '')ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.RegexSerDe'WITH SERDEPROPERTIES ("input.regex"="(?:.*\\n)?.*INFO: (.*)\\n.*TIME : (../../.... ..:..:..)\\n.*OPERATION : (.*)(?:.*\\s+)*?-----------------------------------------------------------------------------------------------------")LOCATION '/appli/psyche/log/auditpsyche'; But it doesn't work, I can find regex which works well line by line but not mutliline by multiline. I also tried a very simple regex like 'USER INFO : (.*)\n(.*)' to create a table with two field just to see if it can take multi line but not. How can I manage to create my hive table?
... View more
Labels:
- Labels:
-
Apache Hive
05-04-2018
12:59 PM
thank you it solve my problem: cd /usr/hdf/3.1.1.0-35
chown -R nifi:nifi nifi
./bin/nifi.sh stop
... on all hosts and start via ambari (now I have /var/run/nifi/nifi.pid)
... View more
05-04-2018
08:13 AM
Hello, I tried to stop nifi as you said via command line /usr/hdf/3.1.1.0-35/nifi/bin/nifi.sh stop and I got "permission denied" so I find the problem of permission and chown nifi:nifi /usr/hdf/3.1.1.0-35/nifi/bin/nifi-env.sh and vi this file to put "export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk" but when I try to stop again, I have "Error: Could not find or load main class org.apache.nifi.bootstrap.RunNifi"
... View more
05-03-2018
01:51 PM
ambari show nifi service down but I can go in the nifi UI and I see
that everything is ok all services (6 services) of the clusters are up
(I see 6/6). I don't see any nifi.pid on servers, it is may be the reason. ls /var/run/nifi nifi.status ... but no nifi.pid, How configure nifi to create nifi.pid at startup ?
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache NiFi