question Re: Is there a way to have pig default to python 3.4 in Archives of Support Questions (Read Only)

Is there a way to have pig default to python 3.4

chrsvarma — Thu, 17 Dec 2015 00:57:27 GMT

we got python 3.4 installed and is there a way to have pig use 3.4 as default python instead of 2.6?

Re: Is there a way to have pig default to python 3.4

rich1 — Thu, 17 Dec 2015 01:19:16 GMT

Are you talking about running a Pig UDF written in Python? You need to make sure you are using streaming_python instead of jython. What does your REGISTER command look like?

Re: Is there a way to have pig default to python 3.4

jniemiec — Tue, 22 Dec 2015 22:41:50 GMT

You need to update the pig.properties value to be like the below to force it to use a different python alias when using the new Pig 13+ Python Streaming functions:

pig.streaming.udf.python.command=python3

Re: Is there a way to have pig default to python 3.4

fernando_castel — Wed, 17 Jan 2018 05:59:51 GMT

Adding that setting is not really working for me, I'm doing something like this

register 's3://fernandos-tests/python-udfs/python-version.py' using streaming_python as pyudfs;
...
results = FOREACH limited GENERATE pyudfs.version();

DUMP results;

My python code looking like...

from pig_util import outputSchema

import sys

@outputSchema('word:chararray')
def version():
    return sys.version

And still getting python version 2.7

Any hints?