Member since
03-16-2017
17
Posts
1
Kudos Received
0
Solutions
08-03-2018
10:46 AM
Thank you Sindhu for your reply. How can you be sure they are using Hive 2.x.. There are 2 hive servers installed both using the same metastore. But all using Hive 1.2.1 as part of the HDP 2.5.0 installation
... View more
08-01-2018
03:29 PM
Running HDP 2.5.0.0 #Hive 1.2.1.2.5 YARN2.7.1.2.5 Tez0.7.0.2.5 [Dispatcher thread {Central}] |history.HistoryEventHandler|: [HISTORY][DAG:dag_1532611349318_0728_2][Event:TASK_ATTEMPT_FINISHED]: vertexName=Reducer 2, taskAttemptId=attempt_1532611349318_0728_2_01_000269_1, creationTime=1532945972705, allocationTime=1532945972711, startTime=1532945972779, finishTime=1532945973414, timeTaken=635, status=FAILED, errorEnum=FRAMEWORK_ERROR, diagnostics=Error: Failure while running task:java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"_col0":"state","_col1":2017,"_col2":9,"_col3":29},"value":{"_col0":{"columntype":"String","maxlength":36,"sumlength":4175748,"count":115993,"countnulls":0,"bitvector":"{0}{0}{0}{0}{1}{1}{5}{1}{1}{2}{0}{0}{1}{2}{1}{1}","numbitvectors":16},"_col1":{"columntype":"Long","min":1532689330,"max":1532689330,"countnulls":0,"bitvector":"{0}{1}{0}{0}{1}{0}{0}{0}{0}{2}{1}{0}{0}{4}{0}{0}","numbitvectors":16},"_col2":{"columntype":"Long","min":229908,"max":345900,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16, 17, 19}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 19}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 22}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 17, 18, 22}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 19}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}","numbitvectors":16},"_col3":{"columntype":"Long","min":1532945758,"max":1532945758,"countnulls":0,"bitvector":"{0}{4}{0}{0}{3}{2}{2}{0}{0}{1}{3}{2}{0}{1}{ {2}","numbitvectors":16},"_col4":{"columntype":"Date","min":"2017-09-30","max":"2017-09-30","countnulls":0,"bitvector":"{0}{0}{1}{0}{1}{3}{3}{0}{0}{0}{0}{0}{4}{1}{0}{2}","numbitvectors":16},"_col5":{"columntype":"String","maxlength":4,"sumlength":463972,"count":115993,"countnulls":0,"bitvector":"{6}{0}{3}{0}{0}{2}{1}{0}{0}{3}{0}{0}{0}{0}{2}{2}","numbitvectors":16},"_col6":{"columntype":"String","maxlength":12,"sumlength":1391916,"count":115993,"countnulls":0,"bitvector":"{0}{1}{0}{3}{1}{0}{1}{1}{0}{0}{0}{0}{0}{0}{1}{0}","numbitvectors":16},"_col7":{"columntype":"String","maxlength":46,"sumlength":5335678,"count":115993,"countnulls":0,"bitvector":"{0}{3}{0}{0}{5}{0}{1}{1}{1}{0}{3}{0}{1}{0}{0}{1}","numbitvectors":16},"_col8":{"columntype":"String","maxlength":20,"sumlength":2319860,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 10}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 8}{0, 1, 2, 3, 4, 5, 7, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6, 10}","numbitvectors":16},"_col9":{"columntype":"String","maxlength":116,"sumlength":2313536,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}","numbitvectors":16},"_col10":{"columntype":"String","maxlength":1,"sumlength":115892,"count":115993,"countnulls":0,"bitvector":"{0, 2}{0, 3}{0}{0, 1}{0, 1}{0, 1, 2}{0}{0, 2}{0, 2, 5}{1}{1, 2}{1, 2}{0, 4}{1, 5}{0, 3}{0}","numbitvectors":16},"_col11":{"columntype":"String","maxlength":52,"sumlength":4549988,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 18, 21}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 26}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 19, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 19}","numbitvectors":16},"_col12":{"columntype":"String","maxlength":2,"sumlength":231986,"count":115993,"countnulls":0,"bitvector":"{0, 2}{1, 3}{1}{0}{0, 1}{0, 4}{0}{0, 1}{0, 1}{0, 1}{0, 4}{0, 2}{0}{0, 1}{0, 1}{0}","numbitvectors":16},"_col13":{"columntype":"String","maxlength":2,"sumlength":230654,"count":115327,"countnulls":666,"bitvector":"{0, 2}{0, 1, 2}{0, 1, 3}{0, 1, 2}{0}{0, 1}{0, 3}{0, 1}{0, 1}{0, 1, 2}{0, 5}{0}{0}{0, 1}{0, 1, 2}{0}","numbitvectors":16},"_col14":{"columntype":"String","maxlength":1,"sumlength":115993,"count":115993,"countnulls":0,"bitvector":"{0}{3}{1}{0}{4}{1}{0}{0}{0}{1}{1}{2}{3}{3}{0}{1}","numbitvectors":16},"_col15":{"columntype":"Decimal","min":0,"max":1136000000000,"countnulls":42,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 19}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}","numbitvectors":16},"_col16":{"columntype":"Decimal","min":0,"max":1136000000000,"countnulls":26968,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}","numbitvectors":16},"_col17":{"columntype":"Decimal","min":-0.9175,"max":17277126,"countnulls":62753,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13}","numbitvectors":16},"_col18":{"columntype":"Decimal","min":-0.7175,"max":9999999999,"countnulls":61055,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 17}","numbitvectors":16},"_col19":{"columntype":"Decimal","min":-3870000000,"max":null,"countnulls":16,"bitvector":"","numbitvectors":0},"_col20":{"columntype":"Decimal","min":-199191000,"max":5000000000,"countnulls":109001,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}","numbitvectors":16},"_col21":{"columntype":"Decimal","min":0.01,"max":100,"countnulls":114,"bitvector":"{0, 1, 2}{0, 1, 2}{0, 5}{0, 1, 5}{0, 1, 2}{1, 2, 4}{0, 1, 9}{0, 1, 2}{0, 1, 4}{1}{0, 2}{0, 2, 3}{0, 6}{0, 1}{0, 1}{0, 1, 2}","numbitvectors":16},"_col22":{"columntype":"Decimal","min":-299994000,"max":175623713,"countnulls":73,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 10, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7, 12}{0, 1, 2, 3, 4, 5, 6, 8}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}","numbitvectors":16},"_col23":{"columntype":"Decimal","min":-0.0101,"max":9999999999,"countnulls":111456,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7, 8, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}","numbitvectors":16},"_col24":{"columntype":"Date","min":"2006-03-31","max":"2095-12-21","countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}","numbitvectors":16},"_col25":{"columntype":"Date","min":"1983-10-01","max":"2062-06-21","countnulls":1,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}","numbitvectors":16},"_col26":{"columntype":"Date","min":"2006-08-24","max":"2017-09-29","countnulls":115754,"bitvector":"{0, 1, 2, 3, 4, 6, 10, 13}{0, 1, 2, 3, 4, 5, 6, 8}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6, 9}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 6, 7}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 8}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4, 5, 6, 8}{0, 1, 2, 3, 4, 6, 9}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6, 7, 8}","numbitvectors":16},"_col27":{"columntype":"Date","min":"1999-05-26","max":"2067-06-30","countnulls":101172,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}","numbitvectors":16},"_col28":{"columntype":"Long","min":-62135769600,"max":1512553898,"countnulls":51,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 19}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 18, 19}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}","numbitvectors":16},"_col29":{"columntype":"String","maxlength":3,"sumlength":347871,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 7}{0, 1, 2, 3, 4, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 7}{0, 1, 2, 3}{0, 1, 2, 3, 7}{0, 1, 2, 3, 4}{0, 1, 2, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 11}","numbitvectors":16},"_col30":{"columntype":"Long","min":1390675699,"max":1506724434,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 19}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 18, 20}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}","numbitvectors":16},"_col31":{"columntype":"String","maxlength":4,"sumlength":463972,"count":115993,"countnulls":0,"bitvector":"{2}{0}{0}{1}{0}{0}{1}{0}{1}{0}{2}{0}{0}{0}{0}{1}","numbitvectors":16},"_col32":{"columntype":"String","maxlength":3,"sumlength":347979,"count":115993,"countnulls":0,"bitvector":"{1}{0}{2}{1}{1}{6}{0}{0}{0}{0}{1}{2}{2}{1}{1}{2}","numbitvectors":16},"_col33":{"columntype":"String","maxlength":1,"sumlength":4169,"count":115993,"countnulls":0,"bitvector":"{0, 1}{0}{0, 1}{0, 1}{0, 1}{0, 4, 7}{0}{0, 1}{0, 1}{1}{0, 1, 2}{0, 1}{0, 1, 3}{0, 1}{0, 2}{0, 3}","numbitvectors":16},"_col34":{"columntype":"String","maxlength":12,"sumlength":1391916,"count":115993,"countnulls":0,"bitvector":"{0}{0}{3}{2}{0}{0}{5}{0}{0}{0}{0}{0}{2}{2}{1}{0}","numbitvectors":16},"_col35":{"columntype":"String","maxlength":2,"sumlength":231986,"count":115993,"countnulls":0,"bitvector":"{0, 2}{1, 3}{1}{0}{0, 1}{0, 4}{0}{0, 1}{0, 1}{0, 1}{0, 4}{0, 2}{0}{0, 1}{0, 1}{0}","numbitvectors":16},"_col36":{"columntype":"String","maxlength":2,"sumlength":230654,"count":115327,"countnulls":666,"bitvector":"{0, 2}{0, 1, 2}{0, 1, 3}{0, 1, 2}{0}{0, 1}{0, 3}{0, 1}{0, 1}{0, 1, 2}{0, 5}{0}{0}{0, 1}{0, 1, 2}{0}","numbitvectors":16},"_col37":{"columntype":"String","maxlength":3,"sumlength":267552,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 7}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 5}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 7}{0, 1, 2, 3}{0, 1, 2, 3, 7}{0, 1, 2, 3, 4}{0, 1, 2, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 11}","numbitvectors":16},"_col38":{"columntype":"String","maxlength":20,"sumlength":2300980,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 10}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 8}{0, 1, 2, 3, 4, 5, 7, 9, 10}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6, 10}","numbitvectors":16},"_col39":{"columntype":"String","maxlength":20,"sumlength":944540,"count":47227,"countnulls":68766,"bitvector":"{0, 1, 2, 3}{0, 1, 2, 3}{0, 1, 2, 6}{0, 2, 4, 5, 8}{0, 1, 2, 3, 4}{0, 1, 3, 4}{0, 1, 4}{0, 1, 2, 6}{0, 1, 2}{0, 2, 3}{0, 1, 10}{0, 1, 2}{0, 1, 2, 7}{0, 1}{0, 1, 4, 5}{0, 1, 2, 3}","numbitvectors":16},"_col40":{"columntype":"String","maxlength":1,"sumlength":115993,"count":115993,"countnulls":0,"bitvector":"{2, 4}{0, 3}{0, 1}{2}{0, 2}{1, 2}{0, 2}{0, 3}{0}{1}{0, 1}{0}{1}{0, 1}{0, 7}{0}","numbitvectors":16},"_col41":{"columntype":"String","maxlength":20,"sumlength":88456,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3}{0, 1, 2, 3, 4, 5, 10}{0, 1, 2, 3, 4}{0, 1, 2, 3, 5}{0, 1, 2, 3, 5}{0, 1, 2, 4, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3, 5, 7}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 9}","numbitvectors":16},"_col42":{"columntype":"String","maxlength":1,"sumlength":36107,"count":115993,"countnulls":0,"bitvector":"{0, 4}{0}{0}{0, 2}{1, 2}{0, 2}{0}{0, 3}{0}{1}{1, 2}{0, 1}{0, 1}{0, 1}{0, 7}{0}","numbitvectors":16},"_col43":{"columntype":"String","maxlength":19,"sumlength":529623,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 13}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10}","numbitvectors":16},"_col44":{"columntype":"String","maxlength":2,"sumlength":140672,"count":115993,"countnulls":0,"bitvector":"{0, 1}{0, 1, 2}{0}{0, 1, 3}{0, 1, 7}{0, 1}{0, 1, 2}{0, 1}{0, 1, 2}{0, 1}{0, 2}{0, 1}{0, 1, 2, 4}{0, 1}{0, 1, 2}{0, 1}","numbitvectors":16},"_col45":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col46":{"columntype":"String","maxlength":1,"sumlength":115993,"count":115993,"countnulls":0,"bitvector":"{2, 4}{0, 3}{0, 1}{2}{0, 2}{1, 2}{0, 2}{0, 3}{0}{1}{0, 1}{0}{1}{0, 1}{0, 7}{0}","numbitvectors":16},"_col47":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col48":{"columntype":"String","maxlength":3,"sumlength":313686,"count":104562,"countnulls":11431,"bitvector":"{0, 1, 2, 3, 4}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 5}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 7}{0, 1, 2, 3}{0, 1, 2, 3, 7}{0, 1, 2, 3}{0, 1, 2, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4}","numbitvectors":16},"_col49":{"columntype":"String","maxlength":3,"sumlength":252639,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 7}{0, 1, 2, 3, 4, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 7}{0, 1, 2, 3}{0, 1, 2, 3, 7}{0, 1, 2, 3, 4}{0, 1, 2, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 11}","numbitvectors":16},"_col50":{"columntype":"String","maxlength":3,"sumlength":246327,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 7}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 5}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 7}{0, 1, 2, 3}{0, 1, 2, 3, 7}{0, 1, 2, 3}{0, 1, 2, 4, 5, 6}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4}","numbitvectors":16},"_col51":{"columntype":"String","maxlength":1,"sumlength":59123,"count":115993,"countnulls":0,"bitvector":"{0, 2, 4}{0, 3}{0, 1}{0, 2}{0, 1, 2}{0, 1, 2}{0, 2}{0, 3}{0}{1}{0, 1, 2}{0, 1}{0, 1}{0, 1}{0, 7}{0}","numbitvectors":16},"_col52":{"columntype":"Decimal","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col53":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col54":{"columntype":"Decimal","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col55":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col56":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col57":{"columntype":"String","maxlength":4,"sumlength":104511,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5}{0, 1, 2, 4, 11}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 5}{0, 1, 2, 3, 5}{0, 1, 2, 3, 5}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4}{0, 1, 2, 3, 5}{0, 1, 2, 4}{0, 1, 2}{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4, 5, 9}{0, 1, 2, 3}{0, 1, 2, 3, 4}","numbitvectors":16},"_col58":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col59":{"columntype":"String","maxlength":13,"sumlength":477336,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 12}{0, 1, 2, 3, 4}{0, 1, 2, 4}{0, 1, 2, 3}{0, 1, 2, 3, 8, 10}{0, 1, 2, 3, 4}{0, 1, 2, 5}{0, 1, 2, 4}{0, 1, 2, 3}{0, 1, 4, 5}{0, 1, 2, 3, 4}{0, 1, 2, 3}{0, 1, 2, 3, 7}{0, 1, 2, 3, 9}{0, 1, 2, 7}{0, 1, 2, 4}","numbitvectors":16},"_col60":{"columntype":"Long","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col61":{"columntype":"Long","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col62":{"columntype":"String","maxlength":56,"sumlength":948740,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6, 10}{0, 1, 2, 3, 4, 5, 6, 7, 8, 10}{0, 1, 2, 3, 4, 5, 6, 7, 10, 13}{0, 1, 2, 3, 4, 5, 7}{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 12, 17}{0, 1, 2, 3, 4, 5, 6, 8, 13}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 7, 9, 10}{0, 1, 2, 3, 4, 5, 6, 8}","numbitvectors":16},"_col63":{"columntype":"String","maxlength":56,"sumlength":739169,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7, 8, 10}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6, 10}{0, 1, 2, 3, 4, 5, 6, 8, 10}{0, 1, 2, 3, 4, 5, 6, 7, 13}{0, 1, 2, 3, 4, 5, 6, 9}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 7, 8}{0, 1, 2, 3, 4, 5, 6, 7, 9}{0, 1, 2, 3, 4, 5, 8, 9, 10, 11}{0, 1, 2, 3, 4, 5, 6, 7, 12, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 13}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 7, 14}{0, 1, 2, 3, 4, 5, 6, 7, 8, 10}","numbitvectors":16},"_col64":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col65":{"columntype":"String","maxlength":3,"sumlength":72573,"count":35804,"countnulls":80189,"bitvector":"{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 11}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 5}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 8}{0, 1, 2, 3, 4, 5, 7}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 6}{0, 1, 2}{0, 1, 2, 3, 4, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 9}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 6}","numbitvectors":16},"_col66":{"columntype":"Long","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col67":{"columntype":"Long","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col68":{"columntype":"Decimal","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col69":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col70":{"columntype":"Decimal","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col71":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col72":{"columntype":"String","maxlength":1,"sumlength":115993,"count":115993,"countnulls":0,"bitvector":"{2, 4}{0, 3}{0, 1}{2}{0, 2}{1, 2}{0, 2}{0, 3}{0}{1}{0, 1}{0}{1}{0, 1}{0, 7}{0}","numbitvectors":16},"_col73":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col74":{"columntype":"Decimal","min":0,"max":18670970726.27,"countnulls":10562,"bitvector":"{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 19}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 18}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17}{0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15}","numbitvectors":16},"_col75":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col76":{"columntype":"String","maxlength":15,"sumlength":926685,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4}{0, 1, 2, 3, 4, 8}{0, 1, 2, 4, 5, 6}{0, 1, 2, 3}{0, 1, 2, 3, 4, 5, 8}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 4, 6}{0, 1, 2, 3, 5, 9}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 5}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4}{0, 1, 2, 3, 5, 8}{0, 1, 2, 3, 5, 6, 7}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4, 5}","numbitvectors":16},"_col77":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col78":{"columntype":"String","maxlength":20,"sumlength":1715564,"count":115993,"countnulls":0,"bitvector":"{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6, 7, 8, 10}{0, 1, 2, 3, 4, 5}{0, 1, 2, 3, 4, 5, 7}{0, 1, 2, 3, 4, 5, 9, 10}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 6}{0, 1, 2, 3, 4, 5, 7}{0, 1, 2, 3, 4, 5, 6, 7}{0, 1, 2, 3, 4, 6}{0, 1, 2, 3, 4, 5, 8}","numbitvectors":16},"_col79":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col80":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col81":{"columntype":"String","maxlength":1,"sumlength":115390,"count":115993,"countnulls":0,"bitvector":"{0, 1, 5}{0, 1}{0, 1}{0, 1}{0, 1, 2}{0, 4}{0, 1}{0, 1, 3}{0, 1}{1}{1, 2}{1}{0, 3}{0, 1}{0, 2, 5}{0, 1, 3}","numbitvectors":16},"_col82":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col83":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col84":{"columntype":"Date","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col85":{"columntype":"Long","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col86":{"columntype":"String","maxlength":1,"sumlength":103605,"count":115993,"countnulls":0,"bitvector":"{0, 3}{0, 1}{0, 1}{0}{1, 3}{0, 2}{0}{0, 6}{0, 1}{1}{0, 2, 3}{0, 1}{0}{0, 1, 5}{0, 1, 4}{0, 1, 2}","numbitvectors":16},"_col87":{"columntype":"Decimal","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col88":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col89":{"columntype":"Decimal","min":null,"max":null,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col90":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16},"_col91":{"columntype":"String","maxlength":12,"sumlength":1391916,"count":115993,"countnulls":0,"bitvector":"{0}{0}{1}{2}{0}{0}{1}{3}{1}{2}{0}{0}{0}{0}{3}{3}","numbitvectors":16},"_col92":{"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":115993,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16}}}
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:347)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:194)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:185)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:185)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:181)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"_col0":"state","_col1":2017,"_col2":9,"_col3":29},"value":{"_col0": olumntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":114597,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16}}}
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:173)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:139)
at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:347)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:194)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:185)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:185)
at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.callInternal(TezTaskRunner.java:181)
at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row (tag=0) {"key":{"_col0":"state","_col1":2017,"_col2":9,"_col3":29},"value":{"_col0":
"columntype":"String","maxlength":0,"sumlength":0,"count":0,"countnulls":114597,"bitvector":"{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}{}","numbitvectors":16}}}
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource$GroupIterator.next(ReduceRecordSource.java:352)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource.pushRecord(ReduceRecordSource.java:237)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:252)
at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:150)
... 14 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:766)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordSource$GroupIterator.next(ReduceRecordSource.java:343)
... 17 more
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryHiveDecimal.init(LazyBinaryHiveDecimal.java:47)
at org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryStruct.uncheckedGetField(LazyBinaryStruct.java:267)
at org.apache.hadoop.hive.serde2.lazybinary.LazyBinaryStruct.getField(LazyBinaryStruct.java:204)
at org.apache.hadoop.hive.serde2.lazybinary.objectinspector.LazyBinaryStructObjectInspector.getStructFieldData(LazyBinaryStructObjectInspector.java:64)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFComputeStats$GenericUDAFNumericStatsEvaluator.merge(GenericUDAFComputeStats.java:549)
at org.apache.hadoop.hive.ql.udf.generic.GenericUDAFEvaluator.aggregate(GenericUDAFEvaluator.java:188)
at org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:612)
at org.apache.hadoop.hive.ql.exec.GroupByOperator.processAggr(GroupByOperator.java:851)
at org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:695)
at org.apache.hadoop.hive.ql.exec.GroupByOperator.process(GroupByOperator.java:761)
... 18 more
... View more
04-24-2018
04:03 PM
With just the default queue..we could run 4 jobs in parallel. Adding an extra queue did not allow us to run any more than 4 jobs.. we still were unable to run extra jobs in parallel. we can use the new queue but cannot get above 4 jobs running and the rest sit in ACCEPTED mode waiting on a job to stop.
... View more
Labels:
04-24-2018
01:14 PM
i have a customer with ~ 10billon rows and 400 Columns and want to continue to add to this table. They are having performance issues with queries. is there any recommendations regarding the size of a hive table etc..
... View more
04-19-2018
07:45 AM
We have a customer who is running HDP HDP-2.5.0.0 with HIve 1.2.1.2.5 they have a hive table with 400 Columns and 10 billion rows. when they run a query through Rstudio testQuery1 = "select * from XXXXXXXXX limit 10" testResult1 <- dbGetQuery(conn, testQuery1) It takes a long time or errors out with Java heap space exception. Is there any limitations to the size of a table at various HIVE versions?? What type of memory modifications would we need to make to get this query to run successfully.?
... View more
Labels:
04-16-2018
04:15 PM
HBASE service is not added to the cluster. We are unable to see any Metrics unser Summary in Ambari Metrics. The Metrics screens just keep loading. Ran the procedure outlined in https://community.hortonworks.com/articles/11805/how-to-solve-ambari-metrics I do not see any errors in the logs.
... View more
Labels:
02-06-2018
01:04 AM
Sorry i dont understand your answer. My question is: Will i still be able to install Cloudera 6.0 using parcels. ?
... View more
02-05-2018
01:05 AM
Will install using parcels be available for Cloudera 6.0. I thought i read an article this option may be going away. We need to know as we have installation automated using parcels.
... View more
Labels:
10-31-2017
01:26 PM
Many thanks for your help. It is working now. Can I please ask if what I am doing is ok. I am restoring ambari server to a less used node in the cluster and pointing the /etc/ambari-agent/conf/ambari-agent.ini on the other nodes to the new ambari manager.. restarting the ambari-agent
... View more
10-31-2017
10:43 AM
I choose [1] - PostgreSQL (Embedded) Thank you
... View more
10-31-2017
10:20 AM
What I am trying to do is restore the ambari onto another vm in the cluster. If the ambari server goes down. Can I install ambari on another node in the same cluster and restore the database and configuration files to it?
... View more
10-31-2017
10:18 AM
From the original mgmt. server. head -15 /bkup/ambari.sql -- -- PostgreSQL database dump -- SET statement_timeout = 0; SET client_encoding = 'UTF8'; SET standard_conforming_strings = off; SET check_function_bodies = false; SET client_min_messages = warning; SET escape_string_warning = off; -- -- Name: ambari; Type: SCHEMA; Schema: -; Owner: ambari grep 'jdbc' /etc/ambari-server/conf/ambari.properties server.jdbc.connection-pool=internal server.jdbc.database=postgres server.jdbc.database_name=ambari server.jdbc.postgres.schema=ambari server.jdbc.user.name=ambari server.jdbc.user.passwd=/etc/ambari-server/conf/password.dat ================================================ From the server ambari.sql was restored to. head -15 /bkup/hwx/hwx/ambari.sql -- -- PostgreSQL database dump -- SET statement_timeout = 0; SET client_encoding = 'UTF8'; SET standard_conforming_strings = off; SET check_function_bodies = false; SET client_min_messages = warning; SET escape_string_warning = off; -- -- Name: ambari; Type: SCHEMA; Schema: -; Owner: ambari -- -- grep 'jdbc' /etc/ambari-server/conf/ambari.properties server.jdbc.connection-pool=internal server.jdbc.database=postgres server.jdbc.database_name=ambari server.jdbc.postgres.schema=ambari server.jdbc.user.name=ambari server.jdbc.user.passwd=/etc/ambari-server/conf/password.dat
... View more
10-27-2017
02:00 PM
On the ambari server . Centos 6.8 ambari-server backup Using python /usr/bin/python Backing up Ambari File System state... *this will not backup the server database* Backup requested. No path specified. Will use /var/lib/ambari-server/Ambari_State_Backup.zip Backup process initiated. Creating zip file... Zip file created at /var/lib/ambari-server/Ambari_State_Backup.zip Backup complete. Ambari Server 'backup' completed successfully. [root@bob234hwxmgmt0 ~]# cp /var/lib/ambari-server/Ambari_State_Backup.zip /bkup [root@bob234hwxmgmt0 ~]# ambari-server stop Using python /usr/bin/python Stopping ambari-server Ambari Server stopped [root@bob234hwxmgmt0 ~]# /usr/bin/pg_dump -U ambari ambari > /bkup/ambari.sql Password: [root@bob234hwxmgmt0 ~]# ls -l /bkup total 1395896 -rw-r--r-- 1 root root 11794132 Oct 27 14:38 ambari.sql -rw-r--r-- 1 root root 1417591774 Oct 27 14:36 Ambari_State_Backup.zip On the new server I restore the ambari db and the ambari server tails to start ambari-server stop Using python /usr/bin/python Stopping ambari-server Ambari Server stopped [root@bob234hwxworker5 ~]# su - postgres [postgres@bob234hwxworker5 ~]$ psql psql (8.4.20) Type "help" for help. postgres=# psql postgres-# \l List of databases Name | Owner | Encoding | Collation | Ctype | Access privileges -----------+----------+----------+-------------+-------------+----------------------- ambari | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =Tc/postgres : postgres=CTc/postgres : ambari=CTc/postgres postgres | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | template0 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres : postgres=CTc/postgres template1 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres : postgres=CTc/postgres (4 rows) postgres=# drop database ambari; DROP DATABASE postgres=# \l List of databases Name | Owner | Encoding | Collation | Ctype | Access privileges -----------+----------+----------+-------------+-------------+----------------------- postgres | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | template0 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres : postgres=CTc/postgres template1 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres : postgres=CTc/postgres (3 rows) postgres=# create database ambari; CREATE DATABASE postgres=# psql -d ambari -f /bkup/hwx/ambari.sql postgres-# \l List of databases Name | Owner | Encoding | Collation | Ctype | Access privileges -----------+----------+----------+-------------+-------------+----------------------- ambari | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | postgres | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | template0 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres : postgres=CTc/postgres template1 | postgres | UTF8 | en_US.UTF-8 | en_US.UTF-8 | =c/postgres : postgres=CTc/postgres (4 rows) postgres-# \q [postgres@bob234hwxworker5 ~]$ exit logout [root@bob234hwxworker5 ~]# ambari-server start Using python /usr/bin/python Starting ambari-server Ambari Server running with administrator privileges. Organizing resource files at /var/lib/ambari-server/resources... Ambari database consistency check started... No errors were found. ERROR: Exiting with exit code 1. REASON: Database check failed to complete. Please check /var/log/ambari-server/ambari-server.log and /var/log/ambari-server/ambari-server-check-database.log for more information. 2017-10-27 13:54:33,419 INFO - ******************************* Check database started ******************************* 2017-10-27 13:54:37,112 INFO - Checking for configs not mapped to any cluster 2017-10-27 13:54:37,132 INFO - Checking for configs selected more than once 2017-10-27 13:54:37,133 INFO - Checking for hosts without state 2017-10-27 13:54:37,134 INFO - Checking host component states count equals host component desired states count 2017-10-27 13:54:37,135 INFO - Checking services and their configs 2017-10-27 13:54:38,728 INFO - ******************************* Check database completed ******************************* 2017-10-27 13:54:45,971 INFO - Checking DB store version 2017-10-27 13:54:46,543 INFO - DB store version is compatible 2017-10-27 14:03:11,066 INFO - ******************************* Check database started ******************************* 2017-10-27 14:03:16,100 INFO - Checking for configs not mapped to any cluster 2017-10-27 14:03:16,111 ERROR - Exception occurred during check for not mapped configs to cluster procedure: org.postgresql.util.PSQLException: ERROR: relation "clusterconfig" does not exist Position: 23 at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2161) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1890) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:559) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:403) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:283) at org.apache.ambari.server.checks.DatabaseConsistencyCheckHelper.checkForNotMappedConfigsToCluster(DatabaseConsistencyCheckHelper.java:164) at org.apache.ambari.server.checks.DatabaseConsistencyChecker.main(DatabaseConsistencyChecker.java:107) 2017-10-27 14:03:16,112 INFO - Checking for configs selected more than once 2017-10-27 14:03:16,113 ERROR - Exception occurred during check for config selected more than ones procedure: org.postgresql.util.PSQLException: ERROR: relation "clusterconfigmapping" does not exist Position: 43 at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2161) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1890) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:559) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:403) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:283) at org.apache.ambari.server.checks.DatabaseConsistencyCheckHelper.checkForConfigsSelectedMoreThanOnce(DatabaseConsistencyCheckHelper.java:221) at org.apache.ambari.server.checks.DatabaseConsistencyChecker.main(DatabaseConsistencyChecker.java:109) 2017-10-27 14:03:16,113 INFO - Checking for hosts without state 2017-10-27 14:03:16,114 ERROR - Exception occurred during check for host without state procedure: org.postgresql.util.PSQLException: ERROR: relation "hosts" does not exist Position: 23 at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2161) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1890) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:559) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:403) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(AbstractJdbc2Statement.java:283) at org.apache.ambari.server.checks.DatabaseConsistencyCheckHelper.checkForHostsWithoutState(DatabaseConsistencyCheckHelper.java:277) at org.apache.ambari.server.checks.DatabaseConsistencyChecker.main(DatabaseConsistencyChecker.java:111) "/var/log/ambari-server/ambari-server-check-database.log" 1235L, 113374C
... View more
Labels:
10-20-2017
10:14 AM
1 Kudo
I did see this article.. But there is a disclaimer for production use Disclaimer: 1. This article is solely my personal take on disaster recovery in a Hadoop cluster 2. Disaster Recovery is specialized subject in itself. Do not Implement something based on this article in production until you have a good understanding on what you are implementing Has Hortonworks a formal document on backup and recovery of their Hadoop environments?? If so where can I find it. Many thanks
... View more
10-19-2017
03:25 PM
HDP-2.5.0.0 Hadoop deployment has the following services HDFS .................name/datanodes sit on an isilon. ( nas storage) YARN MapReduce2 Tez Hive HAWQ PXF Pig Sqoop Oozie ZooKeeper Ambari Metrics Spark
... View more
- Tags:
- Backup
09-19-2017
12:27 PM
We did not tune the following parameters. However they are not at the default value as per the log dfs.datanode.du.reserved = 1073741824 log - Value is less than the recommended default of 6813825536 (Reserved space in bytes per volume. Always leave this much space free for non dfs use) dfs.datanode.max.transfer.threads = 1024 ... HAWQ
requires this property to be set to the recommended value of 40960 (Specifies
the maximum number of threads to use for transferring data in and out of the
datanode) mapreduce.map.java.opts = "=-Xmx410m" .. Value is less than the recommended default of -Xmx3276m (Larger heap-size for child jvms of maps.) mapreduce.map.memory.mb mapreduce.reduce.java.opts mapreduce.reduce.memory.mb mapreduce.task.io.sort.mb yarn.app.mapreduce.am.resource.mb tez.am.resource.memory.mb tez.runtime.io.sort.mb tez.runtime.unordered.output.buffer.size-mb tez.task.resource.memory.mb hive.auto.convert.join.noconditionaltask.size hive.tez.container.size output.replace-datanode-on-failure Value is less than the recommended default of 6813825536 (Reserved space in bytes per volume. Always leave this much space free for non dfs use) . Why was the setting not set to the default on install.
... View more
- Tags:
- parameters
03-16-2017
07:50 AM
I want to disable implala shell as we are unable to secure it completely. I want however to leave the impalad running. Here is how we did it… but i want a cleaner way. Is there a better way to do this?? Connect to a vm with impala running [root@cdhs9cdhworker4 alternatives]# mv /usr/bin/impala-shell /usr/bin/impala-shell_old [root@cdhs9cdhworker4 alternatives]# mv /opt/cloudera/parcels/CDH-5.9.0-1.cdh5.9.0.p0.23/bin/impala-shell /opt/cloudera/parcels/CDH-5.9.0-1.cdh5.9.0.p0.23/bin/impala-shell_old Reboot vm impala-shell … no impala shell running -bash: impala-shell: command not found Check impalad beeline 17/03/01 12:15:58 WARN mapreduce.TableMapReduceUtil: The hbase-prefix-tree module jar containing PrefixTreeCodec is not present. Continuing without it. Beeline version 1.1.0-cdh5.9.0 by Apache Hive beeline> !connect jdbc:hive2://xxxxxx:21052/default;auth=noSasl scan complete in 2ms Connecting to jdbc:hive2://xxxx:21052/default;auth=noSasl Enter username for jdbc:hive2://xxx:21052/default;auth=noSasl: impala Enter password for jdbc:hive2://xxxxxx:21052/default;auth=noSasl: ****** Connected to: Impala (version 2.7.0-cdh5.9.0) Driver: Hive JDBC (version 1.1.0-cdh5.9.0) Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://xxxxxxx:21052/default> show tables; +-------+--+ | name | +-------+--+ +-------+--+ No rows selected (0.289 seconds) 0: jdbc:hive2://xxxxx:21052/default>
... View more
- Tags:
- impala
Labels:
