i have tested manually by telnet, the below is the Error logs, so i think these errors actually are happend cause TCP check, how to filter these logs? 2019-07-18 02:34:44,783 ERROR org.apache.thrift.server.TThreadPoolServer: [HiveServer2-Handler-Pool: Thread-86]: Error occurred during processing of message. java.lang.RuntimeException: org.apache.thrift.transport.TTransportException: Invalid status -1 at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:219) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:652) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory$1.run(HadoopThriftAuthBridge.java:649) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_181] at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_181] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1855) ~[hadoop-common-3.0.0-cdh6.2.0.jar:?] at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge$Server$TUGIAssumingTransportFactory.getTransport(HadoopThriftAuthBridge.java:649) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:269) [hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181] Caused by: org.apache.thrift.transport.TTransportException: Invalid status -1 at org.apache.thrift.transport.TSaslTransport.sendAndThrowMessage(TSaslTransport.java:232) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:184) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:271) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216) ~[hive-exec-2.1.1-cdh6.2.0.jar:2.1.1-cdh6.2.0] ... View more

it happends in my env, it's very frequency, near one time/sec(it seems more faster). but hive service is normal. i have find some articles in google, some peoples mean if there is a load banlance in front, the LB will test the connection by tcp check, then the errors happend. is this true ? ... View more

after sent the last comment on hue little bugs, i was going to test more, and want to share you more details about hue 4.3 bugs.   Hue has provided 3 methos to use sqoop, 1) hue + add table, this is a temp oozie job as i think 2) sqoop1 notebook in hue editor, put sqoop command and execute just like sqoop Cli, i also think this is a temp  oozie job ,why i think so, cause these error is the same, i will show you the error logs and graph.  3)oozie sqoop document   one thing i can confirm the 3) is a bug, the link is：https://review.cloudera.org/r/13630/diff/2#0   and get a patch to change some code in  desktop/libs/liboozie/src/liboozie/submission2.py   now, it works fine, but it just works fine of using HIVESERVER2, what i mean is i need to add --HS2-URL , if i lost this parameter, it will show me errors meaning GSS init failed(i am using kerberos)   ok. let's start to test all these 3 method to sqoop table from mysql to hive.   1) hue + add table function   after set mysql jdbc, and choose table or choose all tables, the errors is 'command' , perviously, the errors is not 'command', after i fix the 3 (oozie sqoop document bug), befort that, the errors as i dsecribed in the top of this message.   2) sqoop notebook in hue editor, i used sqoop command what i have tested in sqoop Cli, and oozie sqoop document, the errors also is 'command'   3) sqoop document in oozie, yes, i have changed some code following patch, and its successful. but pay more attention what i have described , i MUST add --HS2-URL parameter, and even thought the job success, it still has some erros like below: 07:53:11.834 [main] INFO org.apache.hadoop.mapreduce.Job - Counters: 33 File System Counters FILE: Number of bytes read=0 FILE: Number of bytes written=546636 FILE: Number of read operations=0 FILE: Number of large read operations=0 FILE: Number of write operations=0 HDFS: Number of bytes read=85 HDFS: Number of bytes written=7864 HDFS: Number of read operations=6 HDFS: Number of large read operations=0 HDFS: Number of write operations=2 HDFS: Number of bytes read erasure-coded=0 Job Counters Launched map tasks=1 Other local map tasks=1 Total time spent by all maps in occupied slots (ms)=6597 Total time spent by all reduces in occupied slots (ms)=0 Total time spent by all map tasks (ms)=6597 Total vcore-milliseconds taken by all map tasks=6597 Total megabyte-milliseconds taken by all map tasks=6755328 Map-Reduce Framework Map input records=92 Map output records=92 Input split bytes=85 Spilled Records=0 Failed Shuffles=0 Merged Map outputs=0 GC time elapsed (ms)=72 CPU time spent (ms)=2810 Physical memory (bytes) snapshot=390754304 Virtual memory (bytes) snapshot=2658488320 Total committed heap usage (bytes)=530055168 Peak Map Physical memory (bytes)=390754304 Peak Map Virtual memory (bytes)=2658488320 File Input Format Counters Bytes Read=0 File Output Format Counters Bytes Written=7864 07:53:11.841 [main] INFO org.apache.sqoop.mapreduce.ImportJobBase - Transferred 7.6797 KB in 20.8706 seconds (376.7984 bytes/sec) 07:53:11.845 [main] INFO org.apache.sqoop.mapreduce.ImportJobBase - Retrieved 92 records. 07:53:11.845 [main] INFO org.apache.sqoop.mapreduce.ImportJobBase - Publishing Hive/Hcat import job data to Listeners for table tbls 07:53:11.849 [main] INFO org.apache.sqoop.hive.HiveServer2Client - Loading uploaded data into Hive. 07:53:11.881 [main] INFO org.apache.sqoop.manager.SqlManager - Executing SQL statement: SELECT t.* FROM `tbls` AS t LIMIT 1 07:53:11.889 [main] INFO org.apache.sqoop.hive.HiveServer2ConnectionFactory - Creating connection to HiveServer2 as: hdfs (auth:SIMPLE) 07:53:11.900 [main] INFO org.apache.hive.jdbc.Utils - Supplied authorities: 192.168.71.236:10000 07:53:11.901 [main] INFO org.apache.hive.jdbc.Utils - Resolved authority: 192.168.71.236:10000 07:53:12.667 [main] INFO org.apache.sqoop.hive.HiveClientCommon - Export directory is contains the _SUCCESS file only, removing the directory. 07:53:12.673 [main] INFO org.apache.sqoop.hive.HiveServer2Client - Hive import complete. <<< Invocation of Sqoop command completed <<< Hadoop Job IDs executed by Sqoop: job_1561790724479_0195 java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.oozie.action.hadoop.LauncherAM.runActionMain(LauncherAM.java:410) at org.apache.oozie.action.hadoop.LauncherAM.access$300(LauncherAM.java:55) at org.apache.oozie.action.hadoop.LauncherAM$2.run(LauncherAM.java:223) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875) at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:217) at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1875) at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141) Caused by: java.lang.SecurityException: Intercepted System.exit(0) at org.apache.oozie.action.hadoop.security.LauncherSecurityManager.checkExit(LauncherSecurityManager.java:57) at java.lang.Runtime.exit(Runtime.java:107) at java.lang.System.exit(System.java:971) at org.apache.sqoop.Sqoop.main(Sqoop.java:252) at org.apache.oozie.action.hadoop.SqoopMain.runSqoopJob(SqoopMain.java:214) at org.apache.oozie.action.hadoop.SqoopMain.run(SqoopMain.java:199) at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:104) at org.apache.oozie.action.hadoop.SqoopMain.main(SqoopMain.java:51) ... 16 more Intercepting System.exit(0) if i don't add --HS2-URL, it will tell me GSS failed.   sqoop Cli always success, no any problems.   ok, that's all. all these bugs or not bugs how to fix it ? could you give some advises to me ? thanks very much.   ... View more

https://issues.cloudera.org/browse/HUE-8717E-8717   i have search from google and find out this bug fixed, but thiis is just fix hue 4.4, does cloudera have provided path for hue 4.3 ?   thanks. ... View more

i have thought these issues, at last i can sure these function is all connect to sqoop, Hue add table is oozie/sqoop temp job, hue editor to execute sqoop also is oozie/sqoop temp job, and oozie/sqoop action is still sqoop job.   these all failed, what's the root cause about these issues?  ... View more

Hi, Cloudera support:   i am going to give you a summary of CDH 6.2.0 of EL7 HUE issue what it's happened in my env.   1. Hue editor can not execute sqoop1 2. Hue/oozie can not submit sqoop1 workflow 3. hue can not add table or database as above example. 4. hue can not add external database like mysql by using JDBC or rdbms.    if the errors could tell me i lost something or anyelse, but the painful is the error log can tell me nothing why it happended.   anything i have lost while i installed the CDH?  cloud you give me advises to slove these problems ?       ... View more

any soulution for this issue ?   CDH 6.2.0 hue so many little bugs, why ?   sqoop action in editor or oozie could not execute correctly.    even i can't sumit sqoop job in oozie . pls have  a detail like below:   [06/Jul/2019 19:51:44 +0800] resource DEBUG GET /admin/configuration Got response in 16ms: {"oozie.email.smtp.auth":"false","oozie.service.ELService.functions.coord-job-submit-data":"\n coord:dataIn=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataIn_echo,\n coord:dataOut=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dataOut_echo,\n coord:nominalTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_nominalTime_echo_wrap,\n coord:actualTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actualTime_echo_wrap,\n coord:dateOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateOffset_echo,\n coord:dateTzOffset=org.apache.oozie.coord.CoordELFunctions#ph1_coord_dateTzOffset_echo,\n coord:formatTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_formatTime_echo,\n coord:epochTime=org.apache.oozie.coord.CoordELFunctions#ph1_coord_epochTime_echo,\n coord:actionId=org.apache.oozie.coord.CoordELFunctions#ph1_coord_actionId_echo,\n coord:name=org.apache.oozie.coord.CoordELFunctions#ph1_coord_name_echo,\n coord:conf=org.apache.oozie.coord.CoordELFunctions#coord_conf,\n coord:user=org.apache.oozie.coord.CoordELFunctions#coord_user,\n coord:databaseIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseIn_echo,\n coord:databaseOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_databaseOut_echo,\n coord:tableIn=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableIn_echo,\n coord:tableOut=org.apache.oozie.coord.HCatELFunctions#ph1_coord_tableOut_echo,\n coord:dataInPartitionFilter=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionFilter_echo,\n coord:dataInPartitionMin=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMin_echo,\n coord:dataInPartitionMax=org.apache.oozie.coord.HCatELFunctions#ph1_coord_dataInPartitionMax_echo,\n coord:dataInPartitions=org.apache.oozie.coord.HCatELFunctions#ph1_coor... [06/Jul/2019 19:51:44 +0800] exceptions_renderable ERROR Potential detail: 'statement' [06/Jul/2019 19:51:44 +0800] exceptions_renderable ERROR Potential trace: [('/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/apps/oozie/src/oozie/views/editor2.py', 413, '_submit_workflow_helper', 'job_id = _submit_workflow(request.user, request.fs, request.jt, workflow, mapping)'), ('/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/apps/oozie/src/oozie/views/editor2.py', 453, '_submit_workflow', 'job_id = submission.run()'), ('/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/desktop/libs/liboozie/src/liboozie/submission2.py', 58, 'decorate', 'deployment_dir = self.deploy()'), ('/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/desktop/libs/liboozie/src/liboozie/submission2.py', 370, 'deploy', "action.data['type'] in ('sqoop', 'sqoop-document') and action.data['properties']['statement'] in '--hive-import'):")] [06/Jul/2019 19:51:44 +0800] middleware INFO Processing exception: Workflow 提交失败: Traceback (most recent call last): File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/handlers/base.py", line 185, in _get_response response = wrapped_callback(request, *callback_args, **callback_kwargs) File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/utils/decorators.py", line 185, in inner return func(*args, **kwargs) File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/apps/oozie/src/oozie/decorators.py", line 115, in decorate return view_func(request, *args, **kwargs) File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/apps/oozie/src/oozie/decorators.py", line 77, in decorate return view_func(request, *args, **kwargs) File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/apps/oozie/src/oozie/views/editor2.py", line 369, in submit_workflow return _submit_workflow_helper(request, workflow, submit_action=reverse('oozie:editor_submit_workflow', kwargs={'doc_id': workflow.id})) File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/apps/oozie/src/oozie/views/editor2.py", line 415, in _submit_workflow_helper raise PopupException(_('Workflow submission failed'), detail=smart_str(e), error_code=200)   if i use sqoop in hue editor:    ... 83 more 22:23:44.775 [4430f9a6-d62d-47db-add0-b8c79715be8f main] WARN hive.metastore - Failed to connect to the MetaStore Server... 22:23:44.776 [4430f9a6-d62d-47db-add0-b8c79715be8f main] INFO hive.metastore - Waiting 1 seconds before next connection attempt. 22:23:45.776 [4430f9a6-d62d-47db-add0-b8c79715be8f main] INFO hive.metastore - Trying to connect to metastore with URI thrift://oyoshbddnprd2.ahotels.tech:9083 22:23:45.779 [4430f9a6-d62d-47db-add0-b8c79715be8f main] ERROR org.apache.thrift.transport.TSaslTransport - SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed could you give me some advises?     it's really impact too much, cause many bi user and etl user can't use this function./ ... View more

resolved. this is because i have added some jar of tez framework in hive server2. if i just added these jars in hive gateway, it's no problem. thanks. ... View more

apache atlas depents on HBASE, KAFKA, SOLR, so no matter HDP or CDH, open source HADOOP can use atlas. ... View more

it's really happend in CDH 5.10.2, i think there is no another process to delete the file before catalogd . ... View more

it seems got resolved. just add hbase-site.xml file 2017-06-20 01:43:02,739 INFO [main] org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5dcbb60 connecting to ZooKeeper ensemble=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.9.0--1, built on 10/21/2016 08:08 GMT 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:host.name=datanode01.isesol.com 2017-06-20 01:43:02,746 INFO [main] org.apache.zookeeper.ZooKeeper: Client environment:java.version=1.8.0_60 ... View more

another clue,  while i execute sqoop in command mode, it's ok.  checking the below logs ,we can see the ZK configuration is correct, why the issue happend while i deploy this job in oozie by Hue?   17/06/19 21:40:11 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181 sessionTimeout=60000 watcher=hconnection-0x6b5f87070x0, quorum=datanode03.isesol.com:2181,datanode04.isesol.com:2181,datanode02.isesol.com:2181,cmserver.isesol.com:2181,datanode01.isesol.com:2181, baseZNode=/hbase 17/06/19 21:40:11 INFO zookeeper.ClientCnxn: Opening socket connection to server datanode04.isesol.com/10.215.4.167:2181. Will not attempt to authenticate using SASL (unknown error) ... View more

thanks.   my pain point is when i finished a spark , java, hive, sqoop job, i tested it on Linux System , mostly it's normal.   then i deploy the job in oozie by Hue, it always throw some errors like Class not found . i know it because some jars missed, then i am going to search which jars is missed, if found , i add this jar file.   so i mean i don't know which jar files is needed while i deploy these job in oozie, i need the try and try to found missed jars.  this is my pain point.   these jobs executed on Linux System model is normal  i think it's because the job load all the classpath jar files, so it's no this kind issue. ... View more

if Lily hbase index replication can be similar with MySQL replication, it will be better. save the replication in ZK, if there are some failure , we can change replication position,then re-replicated again. currently, as you suggested, drop hbase index and re-create, it's more complex and not convenient . ... View more

spark on yarn.  or oozie ... View more