https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169419#M131733 <P>If I create a schema on load everything works fine. However I did not want to create whole schema for a few fields out of 100's. This script fails with </P><P>Unable to open iterator for alias A. Backend error : java.lang.ClassCastException: org.apache.pig.data.DataByteArray cannot be cast to java.math.BigInteger</P><PRE>H = LOAD '/user/horton/hands.txt' USING PigStorage(','); FilteredHands = FILTER H BY (int)$10==6 AND (int)$5==6; Hands = FOREACH H GENERATE $0 AS (HandID:biginteger), $5 AS (BigBet:double), $10 AS (PlayersInHand:int); HP = LOAD '/user/horton/playerhands.txt' USING PigStorage(','); HandPlayers = FOREACH HP GENERATE $1 AS (HandID:biginteger), $0 AS (PlayerName:chararray), $12 AS (AmtWon:double); PlayersAndHands = JOIN Hands by HandID, HandPlayers by HandID; A = FOREACH PlayersAndHands GENERATE Hands.HandID; DUMP A;</PRE><P>What am I doing wrong?</P> Mon, 26 Sep 2016 15:34:46 GMT andyblum 2016-09-26T15:34:46Z https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169419#M131733 <P>If I create a schema on load everything works fine. However I did not want to create whole schema for a few fields out of 100's. This script fails with </P><P>Unable to open iterator for alias A. Backend error : java.lang.ClassCastException: org.apache.pig.data.DataByteArray cannot be cast to java.math.BigInteger</P><PRE>H = LOAD '/user/horton/hands.txt' USING PigStorage(','); FilteredHands = FILTER H BY (int)$10==6 AND (int)$5==6; Hands = FOREACH H GENERATE $0 AS (HandID:biginteger), $5 AS (BigBet:double), $10 AS (PlayersInHand:int); HP = LOAD '/user/horton/playerhands.txt' USING PigStorage(','); HandPlayers = FOREACH HP GENERATE $1 AS (HandID:biginteger), $0 AS (PlayerName:chararray), $12 AS (AmtWon:double); PlayersAndHands = JOIN Hands by HandID, HandPlayers by HandID; A = FOREACH PlayersAndHands GENERATE Hands.HandID; DUMP A;</PRE><P>What am I doing wrong?</P> Mon, 26 Sep 2016 15:34:46 GMT https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169419#M131733 andyblum 2016-09-26T15:34:46Z https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169420#M131734 <P>I cannot dump PlaeyersAndHands either. Both HandPlayers and Hands dump fine. </P> Mon, 26 Sep 2016 16:29:18 GMT https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169420#M131734 andyblum 2016-09-26T16:29:18Z https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169421#M131735 <P>Replace biginteger datatype with bytearray.</P> Mon, 26 Sep 2016 16:43:00 GMT https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169421#M131735 aervits 2016-09-26T16:43:00Z https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169422#M131736 <P>Thank you so much. That worked. Is biginteger uncastable? When would I use bytearray vs. specific type? Interesting thing is if I LOAD with schema joins on biginteger works fine. Would you consider this a bug?</P> Mon, 26 Sep 2016 16:51:43 GMT https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169422#M131736 andyblum 2016-09-26T16:51:43Z https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169423#M131737 <P>can't tell without seeing your data. Can you try with schema join as well and confirm bytearray works in either condition.</P> Mon, 26 Sep 2016 19:36:59 GMT https://community.cloudera.com/t5/Support-Questions/Generating-schema-in-FOREACH-and-then-join-java-lang/m-p/169423#M131737 aervits 2016-09-26T19:36:59Z