Member since
04-11-2018
6
Posts
0
Kudos Received
0
Solutions
04-13-2020
11:55 PM
Hi @jsensharma I have all correct shell and outputs of all commands look exactly same as you have mentioned.
... View more
03-19-2020
10:46 AM
I have setup Ambari 2.7.0 on Centos 7 server with Mysql 5.7.29 as backend. All services are running fine, but when I try to login using `admin:admin` credential it seems to hang and shows following logs in `ambari-server.log` file: ``` 2020-03-18 06:55:28,031 INFO [MessageBroker-1] WebSocketMessageBrokerStats:113 - WebSocketSession[0 current WS(0)-HttpStream(0)-HttpPoll(0), 0 total, 0 closed abnormally (0 connect failure, 0 send limit, 0 transport error)], stompSubProtocol[processed CONNECT(0)-CONNECTED(0)-DISCONNECT(0)], stompBrokerRelay[null], inboundChannel[pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], outboundChannelpool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], sockJsScheduler[pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 0]
2020-03-18 06:55:28,678 INFO [MessageBroker-1] WebSocketMessageBrokerStats:113 - WebSocketSession[0 current WS(0)-HttpStream(0)-HttpPoll(0), 0 total, 0 closed abnormally (0 connect failure, 0 send limit, 0 transport error)], stompSubProtocol[processed CONNECT(0)-CONNECTED(0)-DISCONNECT(0)], stompBrokerRelay[null], inboundChannel[pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], outboundChannelpool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], sockJsScheduler[pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 0] ```
Interesting thing is, moment I enter invalid user or wrong password for `admin` user, it throws correct error `Invalid credentials` but on entering correct credentials, its hanging and logs above mentioned logs in `ambari-server.log` file.
Previously I used to see following logs in MySQL Log file: ``` [Note] Aborted connection 4 to db: '' user: '' host: '' (Got an error reading communication packets) ```
As suggested on some questions, I increased `max_connections` to 400 and `max_allowed_packet` close to 2% of RAM available on server to `656MB`.
After increasing above mentioned configs, I dont see any `Error reading communication packets` in MySQL log file but I dont seem to get Ambari login working.
When I turn logging level for Ambari-Server to `debug` and enter random user it gives logs : ``` 2020-03-18 11:24:16,116 DEBUG [ambari-client-thread-47] FilterChainProxy:325 - /api/v1/users/esrdf?fields=*,privileges/PrivilegeInfo/cluster_name,privileges/PrivilegeInfo/permission_name&_=1599955834198 at position 1 of 13 in additional filter chain; firing Filter: 'WebAsyncManagerIntegrationFilter' ``` But when I enter correct credentials `admin:admin`, I dont see any API even being called within Logs. What could be the reason for this?
Can someone point me, where I could be going wrong?
Help Appreciated!
... View more
Labels:
03-19-2020
10:44 AM
hi @psbhat_badaja @manish1 Were you able to resolve this? I am facing exactly the same issue.
... View more
03-19-2020
12:56 AM
@jsensharma Thank you for your answer. I am facing similar issue with Ambari 2.7.0, Mysql 5.7.29. I am unable to get into admin account even once and on click of Login it just hangs and says ' Unable to connect to Ambari Server. Confirm Ambari Server is running and you can reach Ambari Server from this machine.' after some seconds.' I even posted details here: https://stackoverflow.com/q/60743259/7051479 Could you please help me out on this.
... View more
08-16-2018
08:43 PM
I have created a Custom processor to use AWS Encryption SDK as a separate processor in NiFi version 1.7.1
I have implemented Abstract class with required Properties and createClient functions and processor main class with getSupportedPropertyDescriptors, onTrigger funtions.
But when I am trying to run the processor it gives below error:- 2018-08-15 23:15:39,732 ERROR [Timer-Driven Process Thread-5] o.a.n.p.a.encryption.EncryptorProcessor EncryptorProcessor[id=3eaf70a8-0165-1000-a4d1-6cfa42125382] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.reflect.InvocationTargetException: java.lang.reflect.InvocationTargetException
java.lang.reflect.InvocationTargetException: null
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:142)
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:130)
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:75)
at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:52)
at org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$4(StandardProcessorNode.java:1499)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NullPointerException: null
at org.apache.nifi.processors.aws.AbstractAWSProcessor.createConfiguration(AbstractAWSProcessor.java:221)
at org.apache.nifi.processors.aws.AbstractAWSProcessor.onScheduled(AbstractAWSProcessor.java:268)
at org.apache.nifi.processors.aws.AbstractAWSCredentialsProviderProcessor.onScheduled(AbstractAWSCredentialsProviderProcessor.java:65)
... 15 common frames omitted
... View more
Labels:
04-11-2018
07:11 AM
Hi @Frank Maritato I am working on a similar use case. Trying to write content of Flowfiles coming in PutParquet directly on S3 bucket. I have mentioned the directory as bucket's path(including folder subdirectory) and have core-site.xml similar to yours(fs.defaultFS has only bucket name). Also, I am using s3a URI scheme instead of s3 (all paths have appropriate URI). Also, I have added jars in 'Additional Resources ' attribute according to this link http://apache-nifi-users-list.2361937.n4.nabble.com/PutParquet-with-S3-td3632.html But on execution I am facing error: 'ERROR PutParquet[Id=...] failed to invoke @OnScheduled method due to java.lang.RunTimeException: Failed while executing one of processor's onScheduled task.; processor will not be scheduled to run for 30 seconds: java.lang.RunTimeException: Failed while executing one of processor's OnScheduled task' On inspection of logs i can see the Error as : 'AmazonS3Exception: Status Code: 400, AWS Service: Amazon S3, AWS Request ID: , AWS Error Code: null, AWS Error Message: Bad Request' I have also mentioned s3a endpoint as s3.ap-south-1.amazonaws.com because I have Nifi server and bucket in the same region, Mumbai Can you help me out with your configuration's or any additional jars?
... View more