PIG UDFs Python - Gurantee that String have the format 'yyyy-MM-dd hh:ss:mm'

m2014227 — Fri, 16 Sep 2022 10:32:43 GMT

Hi experts,

I've the following part of script in Apache Pig:

....

A = foreach Source_Data generate (int) ID,

ToString( ToDate((long) Time), 'yyyy-MM-dd hh:ss:mm') as date,

(int) Code;

Store A into '.../newfile'; ...

Now I want to create a new Script using Python UDF to guarantee that in my newfile on column Date (#1) I only have String in the format 'yyyy-MM-dd hh:ss:mm'.

Is possible to do that?

Many thanks!

Re: PIG UDFs Python - Gurantee that String have the format 'yyyy-MM-dd hh:ss:mm'

aervits — Thu, 04 Aug 2016 01:28:06 GMT

you can write a new script using regex to test this column and throw away bad fields or do it all in one step where you pass the date field to UDF and check for formatting

question PIG UDFs Python - Gurantee that String have the format 'yyyy-MM-dd hh:ss:mm' in Archives of Support Questions (Read Only)

PIG UDFs Python - Gurantee that String have the format 'yyyy-MM-dd hh:ss:mm'

Re: PIG UDFs Python - Gurantee that String have the format 'yyyy-MM-dd hh:ss:mm'