Do you have rack configuration ?  if so the then it will follow  either your placement stratagy if not the default block placement policy The block size will remain same for all data nodes Since the  block size is defined for whole cluster  not for individual node. ... View more

what is the status of the impala server  ? is it runining . Could you check it  ... View more

Jersey is basically a RESTful Web Services framework . Jersey json  jar usess another piece of code to convert to /  from Object from Json .   JSONObject  on the other hand is a class used to decode the Json object .  Each jar have their own set of implentation for class , interface , abstard method etc it  should be lossely coupled . Thats the reason we are not able to find JsonObject class in those jars . Different implementation and purpose.  ... View more

Hi    I assume you are usinig Hive 0.14 and higer . Could you please check these configuration this will enable logs for Beeline Clients.    hive.server2.logging.operation.enabled hive.server2.logging.operation.log.location hive.server2.logging.operation.verbose (Hive 0.14 to 1.1) hive.server2.logging.operation.level hive.server2.logging.operation.enabled Default Value: true When true, HiveServer2 will save operation logs and make them available for clients. hive.server2.logging.operation.log.location Default Value: ${java.io.tmpdir}/${user.name}/operation_logs Top level directory where operation logs are stored if logging functionality is enabled. hive.server2.logging.operation.verbose Default Value: false When true, HiveServer2 operation logs available for clients will be verbose. hive.server2.logging.operation.level Default Value: EXECUTION HiveServer2 operation logging mode available to clients to be set at session level. For this to work, hive.server2.logging.operation.enabled should be set to true. The allowed values are: NONE: Ignore any logging. EXECUTION: Log completion of tasks. PERFORMANCE: Execution + Performance logs. VERBOSE: All logs. Fruther you can refer the below links    https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.server2.logging.operation.level ... View more

The application is trying to invoke  an array with a negative size.  for example -1 -2 etc   Could you please let me know your Hive ORC related configuration.    hive.exec.orc.skip.corrupt.data hive.exec.orc.default.row.index.stride   ... View more

1. Check on the user perimission of the jar file.  2.when you add driver manully do this  --driver = org.postgresql.Driver  3. Please try the below jdbc driver version.    Optionally you can extract the jar file see the if there is    org.postgresql.Driver.class    curl -L 'http://jdbc.postgresql.org/download/postgresql-9.2-1002.jdbc4.jar' -o postgresql-9.2-1002.jdbc4.jar $ sudo cp postgresql-9.2-1002.jdbc4.jar /var/lib/sqoop/   ... View more

if you are having  trouble passing the special characte, trying using  --map-column-java and you should be able to suprass those errors . type cast to your needs. or You can use --map-column-hive     sqoop import ... --map-column-java id=String,value=Integer    ... View more

There is no direct way of enforcing a strict mode to Impala  However you can cotrol the run time behaviour of the queries by issuing SET statement  for example controling the memory limit , max_scan_range_lenth   Please refer this link  SET STATEMENT ... View more

As far I am concerned I dont think there is no way to dectect them kill automatically .  One way to slove the long runining query is to inspect your query flow , streaming also enable  strict mode - In this mode some risky query will not be performed like cartesian product , ordering without limit clause.  ... View more

is it authorizedkey or authorized_key should file be in user:hdfs group ? could you please clarify ... View more