About lvic4594_

lvic4594_ · ‎12-11-2019

resolved: port 21050 was blocked by vpn. after creating ssh tunnel connection worked

lvic4594_ · ‎12-10-2019

Hello, I install impala/kudu on HDP 2.6.2.2: impalad version 2.7.0-cdh5-IMPALA_KUDU-cdh5 RELEASE (build 48f1ad385382cd90dbaed53b174965251d91d088) With impala-shell i created database "imp_kudu" with single table "test_table" When I try to open JDBC connection for "I mpalaJDBC4.jar" driver using url: jdbc:impala://myserver.com:21050/imp_kudu;AuthMech=0 I have the following error Cloudera][ImpalaJDBCDriver](500164) Error initialized or created transport for authentication: Operation timed out (Connection timed out). What kind of problem does this indicate and how can I resolve it?

lvic4594_ · ‎08-22-2019

Thanks, i didn't realized i am not actually logged at the moment

lvic4594_ · ‎08-21-2019

it will be great to mark this thread as Solved Would be happy to, but don't see this available in "options" - i can only see "mark as read"

lvic4594_ · ‎08-19-2019

--producer-config did the trick for kafka-console-producer.sh...Or changing " max.request.size" directly in producer code. I didn't have to modify consumer settings

lvic4594_ · ‎08-13-2019

I am using HDP-2.6.5.0 with kafka 1.0.0; I have to process large (16M) messages so i set message.max.bytes=18874368replica.fetch.max.bytes = 18874368socket.request.max.bytes =18874368 From Ambary/Kafka configs screen and restarted Kafka services When I try to send 16M messages: /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list <broker-ip>:6667 --topic test < ./big.txt I still have the same error: ERROR Error when sending message to topic test with key: null, value: 16777239 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback) org.apache.kafka.common.errors.RecordTooLargeException: The message is 16777327 bytes when serialized which is larger than the maximum request size you have configured with the max.request.size configuration. I tried to set max.request.size in producer.properties file but still have the same error. What am I missing? Thank you,

lvic4594_ · ‎05-06-2019

Hello, I see "permission denied" problem in PutHDFS with writing of file "531fb09e-5599-48e2-b627-e558d1b6ba70-list" org.apache.nifi.processor.exception.ProcessException: IOException thrown from PutHDFS[id=016a1008-69b2-1e66-6220-26211a37e1a5]: org.apache.hadoop.security.AccessControlException: Permission denied: user=root, access=WRITE, inode="/data/clustering/temp/.531fb09e-5599-48e2-b627-e558d1b6ba70-list":hdfs:hdfs:drwxr-xr-x at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:353) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.check(FSPermissionChecker.java:325) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:246) at org.apache.hadoop.hdfs.server.namenode.FSPermissionChecker.checkPermission(FSPermissionChecker.java:190) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1950) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkPermission(FSDirectory.java:1934) at org.apache.hadoop.hdfs.server.namenode.FSDirectory.checkAncestorAccess(FSDirectory.java:1917) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInternal(FSNamesystem.java:2763) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFileInt(FSNamesystem.java:2698) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startFile(FSNamesystem.java:2582) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.create(NameNodeRpcServer.java:736) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.create(ClientNamenodeProtocolServerSideTranslatorPB.java:409) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) It looks to me as "user=root" is the problem, how can I configure PutHDFS to execute as "user=hdfs"? Thank you,

lvic4594_ · ‎05-03-2019

Seems as value comes garbled: if my content is: [{“username”: “one”, “create_date":1550500579036, “role”: “tech lead”}, {“username”: “two”, “create_date":1550500579100, “role”: “user”}] than i have 3 attributes: body :1550500579036, “role”: “tech lead”}, {“username”: “two”, “create_date body.0 ":1550500579036, “role”: “tech lead”}, {“username”: “two”, “create_date" body.1 :1550500579036, “role”: “tech lead”}, {“username”: “two”, “create_date

lvic4594_ · ‎05-03-2019

how can i transform array of maps into array of values: ["one", "two", "three"] ?

lvic4594_ · ‎05-03-2019

found this article: https://community.hortonworks.com/questions/52055/how-to-create-a-new-attribute-with-value-as-the-co.html but it doesn't seem to work I added new property "message.body" to ReplaceText with value of "(.*)" and i see an error: "message.body is invalid when validated against (.*) because message.body is not supported property"

Online	Offline
Last Visited	‎12-26-2019 03:22 PM

Date Registered	‎08-08-2018 08:13 PM
Last Visited	‎12-26-2019 03:22 PM
Total Messages Posted	34

Re: impala kudu jdbc connection does not work?

Re: impala kudu jdbc connection does not work?

impala kudu jdbc connection does not work?

Re: RecordTooLargeException on large messages in K...

Re: RecordTooLargeException on large messages in K...

Re: RecordTooLargeException on large messages in K...

RecordTooLargeException on large messages in Kafka...

PutHDFS permission problem

Re: How to create a new attribute with value as th...

Re: NiFi Jolttransform to package json array into ...

How to create a new attribute with value as the co...