Member since
05-09-2017
107
Posts
7
Kudos Received
6
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1817 | 03-19-2020 01:30 PM | |
9861 | 11-27-2019 08:22 AM | |
6206 | 07-05-2019 08:21 AM | |
11499 | 09-25-2018 12:09 PM | |
4067 | 08-10-2018 07:46 AM |
03-24-2020
01:38 PM
@SheltonI am still getting the same error . How can i verify that the SERVER_JVMFLAGS have taken effect ? I dont see it in running config. (ps -ef | grep -i zookeeper) . I also dont see it in zoo.cfg [zk: xxx.unx.sas.com(CONNECTED) 0] addauth digest super:password [zk: xxx.unx.sas.com(CONNECTED) 1] ls /kafka kafka-acl kafka-acl-changes kafka-acl-extended kafka kafka-acl-extended-changes [zk: xxx.unx.sas.com(CONNECTED) 1] ls /kafka-acl [Group, Cluster, Topic, TransactionalId, DelegationToken] [zk: xxx.unx.sas.com(CONNECTED) 2] deleteall /kafka-acl/Topic Authentication is not valid : /kafka-acl/Topic
... View more
03-24-2020
09:46 AM
Can you explain at a high level if possible what these steps are doing and why we are doing these ? Technically there is an acl under my name and when i get a token as myself i should be able to delete the acls.
... View more
03-24-2020
06:56 AM
How can i delete an acl in zookeeper. I seen a blog which has outlines steps in hortonworks. I am not using Horton. zookeeper.set.acl - false. [desind@zookeeper1~]$ zookeeper-shell localhost:2181 rmr /kafka-acl/Topic Connecting to localhost:2181 WATCHER:: WatchedEvent state:SyncConnected type:None path:null Authentication is not valid : /kafka-acl/Topic desind@zookeeper-1~]$ zookeeper-shell localhost:2181 getAcl /kafka-acl/Topic Connecting to localhost:2181 WATCHER:: WatchedEvent state:SyncConnected type:None path:null 'world,'anyone : r 'sasl,'desind : cdrwa I need to delete the sasl,desind:cdrwa
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache Zookeeper
03-19-2020
01:30 PM
I was able to resolve this issue after a lot of work. Records in kafka had null values and S3 sink connector cannot write null values to S3 bucket and failed with this error, We were able to dig deeper when we changed the flush.size =1 and then we saw a different error and that made us check for null values. We developed a patch that fixed the issue. now the S3 connector ignores null values . I dont know why confluent SMT did not work.
... View more
03-19-2020
01:21 PM
@lhebert after reading your post i have a few additional questions. before i ask i will mention what i did 1. sudo navencrypt-prepare --use-uuid /dev/sda1 /hadoop/encrypted/sda 2. after that lsblk looks like this desind@adfb001~]$ lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 1.5T 0 disk └─sda1 8:1 0 1.5T 0 part └─sda 253:13 0 1.5T 0 crypt /hadoop/encrypted/sda 3. This was a new install and was empty. I put it in permissive mode and then moved files from my home directory to /hadoop/encrypted/sda/ 4. Then changed to enforcing 5. Added acls that were needed for an app to read those files. Do you see anything wrong in step 3) ? Regarding this statement "Y ou should not perform writes directly to encrypted volumes but rather you should be using the originally linked paths. You should not prepare and mount disk to the original data directories you intend to use for your applications" Looks like from above i am performing writes directly to encrypted volumes. If i use the navencrypt-move command then its creating a symlink from my home directory to /hadoop/encrypted/sda, which did not look right .
... View more
02-23-2020
11:03 AM
When i run the command a sudo i dont know why does it say this "Dropped privileges to www-data" Nost sure why its dropping privileges
... View more
02-23-2020
10:56 AM
We recently upgraded Kafka to 2.3.0 after that one of our connector is failing with the below error. org.apache.kafka.connect.errors.ConnectException: org.apache.kafka.connect.errors.SchemaProjectorException: Switch between schema-based and schema-less data is not Any ideas anyone ? I have already looked and implemented this https://issues.redhat.com/browse/DBZ-235 but no luck. Nothing has changed in the schema. We dont think its a tombstone issue. I was able to check where the connector stopped and looked at the events and its not a tombstone.
... View more
Labels:
- Labels:
-
Apache Kafka
02-23-2020
10:42 AM
Everything is exactly what you described. Permissions are correct. FYI - I am running this command on the primary KTS . [desind@PrimaryktsServe ~]$ sudo ls -l /var/lib/keytrustee/.keytrustee/keytrustee.conf -rw------- 1 keytrustee keytrustee 451 Feb 19 12:53 /var/lib/keytrustee/.keytrustee/keytrustee.conf [desind@PrimaryktsServer~]$ sudo namei -l /var/lib/keytrustee/.keytrustee/keytrustee.conf f: /var/lib/keytrustee/.keytrustee/keytrustee.conf dr-xr-xr-x root root / drwxr-xr-x root root var drwxr-xr-x root root lib drwxr-xr-x keytrustee keytrustee keytrustee drwx------ keytrustee keytrustee .keytrustee -rw------- keytrustee keytrustee keytrustee.conf [desind@PrimaryktsServer~]$ sudo ls -ln /var/lib/keytrustee/.keytrustee/keytrustee.conf -rw------- 1 985 970 451 Feb 19 12:53 /var/lib/keytrustee/.keytrustee/keytrustee.conf [desind@PrimaryktsServer ~]$ id keytrustee uid=985(keytrustee) gid=970(keytrustee) groups=970(keytrustee) I also restarted the active KTS server. Cluster is kerberized so i ensured i have a active ticket. My CDH version is 6.3.2 - I am not sure if there are known issues here
... View more
02-22-2020
05:48 AM
sudo keytrustee-orgtool list (sudo) Password on xxxx: Dropped privileges to www-data Traceback (most recent call last): File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/bin/../bin/keytrustee-orgtool", line 7, in <module> __import__('pkg_resources').run_script('keytrustee==6.1.0', 'keytrustee-orgtool') File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/pkg_resources/__init__.py", line 748, in run_script self.require(requires)[0].run_script(script_name, ns) File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1517, in run_script exec(code, namespace, namespace) File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/EGG-INFO/scripts/keytrustee-orgtool", line 59, in <module> main() File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/EGG-INFO/scripts/keytrustee-orgtool", line 34, in main org = orgtool.OrgTool(options.CONFDIR) File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/keytrustee/server/orgtool.py", line 40, in __init__ BaseServer.__init__(self, confdir) File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/keytrustee/server/flaskapp.py", line 30, in __init__ Context.__init__(self, confdir) File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/keytrustee/context.py", line 115, in __init__ config = self.new_config(confdir, **config_kwargs) File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/keytrustee/server/flaskapp.py", line 42, in new_config return ServerConfig(*args, **kwargs) File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/keytrustee/config.py", line 40, in __init__ self.load_config(initial_config, create) File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/keytrustee/config.py", line 129, in load_config self.save_config() File "/it/sfw/cloudera/parcels/KEYTRUSTEE_SERVER-6.1.0-1.keytrustee6.1.0.p0.592761/lib/python2.7/site-packages/keytrustee-6.1.0-py2.7.egg/keytrustee/config.py", line 151, in save_config with closing(open(self.conffile, "w")) as f: IOError: [Errno 13] Permission denied: '/var/lib/keytrustee/.keytrustee/keytrustee.conf' $ Connection reset by 10.120.xxx.xxx
... View more
Labels: