Support Questions
Find answers, ask questions, and share your expertise

can we create custom serde in hive using python

can we create custom serde in hive using python

Rising Star

Hi All,

Can we create custom serde in hive using python .I don't have a good knowledge on java . Is it possible?

3 REPLIES 3

Re: can we create custom serde in hive using python

Rising Star

You can use Python within a Hive transform function to apply a schema to rows in Hive. It doesn't have to be Python, incidentally. You can use any language that can read from stdin and write to stdout on your cluster nodes.

This is not a true serDe, but might be good enough to interpret your data without writing a custom serDe in Java.

Ethan Rowe wrote a nice blog post detailing the use of Hive transform functions.

Re: can we create custom serde in hive using python

Rising Star

@Alex Woolford

Can we use shell script also in transform like we use python here?

Re: can we create custom serde in hive using python

Rising Star

@Vaibhav Kumar: Yes, you can certainly use a shell script in a Hive transform function.