Hello,
I would like to create an hive table which take as input something like this: ...
-----------------------------------------------------------------------------------------------------
USER INFO: mickey.zak.nl,mickey Zak,NL,ADMIN
TIME : 15/08/2018 14:26:54
OPERATION : WOA APRROVED ,DATABASE psyche
DATA RECEIVED :
-----------------------------------------------------------------------------------------------------
USER INFO: mickey.zak.nl,mickey Zak,NL,ADMIN
TIME : 15/08/2018 14:26:54
OPERATION : WOA APRROVED ,DATABASE psyche
DATA RECEIVED :
-----------------------------------------------------------------------------------------------------
... and have 3 fields "USER INFO","TIME","OPERATION". So my regex have to process a string beginnig with a line of "-" and ending with a line of "-" I try lot of regex which work fine with java regex, python regex or ruby regex but none of them works with hive, for sample I tried this: CREATE EXTERNAL TABLE `auditpsyche_regex`( `userinfo` string COMMENT '', `time` string COMMENT '', `operation` string COMMENT '')ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.RegexSerDe'WITH SERDEPROPERTIES ("input.regex"="(?:.*\\n)?.*INFO: (.*)\\n.*TIME : (../../.... ..:..:..)\\n.*OPERATION : (.*)(?:.*\\s+)*?-----------------------------------------------------------------------------------------------------")LOCATION '/appli/psyche/log/auditpsyche'; But it doesn't work, I can find regex which works well line by line but not mutliline by multiline. I also tried a very simple regex like 'USER INFO : (.*)\n(.*)' to create a table with two field just to see if it can take multi line but not. How can I manage to create my hive table?
... View more
