Member since
07-08-2013
60
Posts
8
Kudos Received
15
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2803 | 09-11-2018 09:29 AM | |
1066 | 02-15-2018 09:03 AM | |
3829 | 08-28-2017 09:15 AM | |
3076 | 07-21-2017 08:40 AM | |
9109 | 06-23-2017 08:51 AM |
09-11-2018
09:29 AM
1 Kudo
Hi, This was missed in the docs, I opened an internal ticket to have it added to that page. We did the 6.0 certification on RHEL-compatible 7.5 OSes back in June. Sorry about this! J-D
... View more
04-19-2018
04:17 PM
It's hard to tell from just this log snippet if anything really bad is happening, but for sure you have a tablet server that seems to be gone (192.168.1.XX:7050: connect: Connection refused) during that time. Is ksck returning all ok? Do you have a range partition that covers the time range you are writing into?
... View more
03-16-2018
12:34 PM
Hi, This looks like a different flavor of something we encountered while testing Sentry in 5.13 (that we didn't resolve). I pinged a few folks internally. FWIW I tried just spinning up a secure CM5.14.1 + CDH5.12.2 cluster with all the services and my HMS came up just fine without that config. Can you describe more how you upgraded CM, if any other configs were changed before/after the upgrade, and if you added any services before or after? As an aside, the Impala forum is probably not the best place to get help for this issue. Thanks, J-D
... View more
02-15-2018
09:03 AM
1 Kudo
Hi Rajesh, Yes that's what it means. J-D
... View more
08-28-2017
09:15 AM
" PARTITIONS 1" means that you are trying to create a table with 1 hash bucket, you need at least 2 (like the error you're getting says). This is a way to force you to think about how you want to distribute your data. Only 2 tservers won't work with the default replication factor of 3, as per http://kudu.apache.org/docs/known_issues.html#_tables
... View more
08-28-2017
09:03 AM
@hindog wrote: " Nor the browser column" -- What if the "browser" column WAS the primary key? Would increment be possible in similar fashion to upsert, the difference being that internally Kudu would read the existing value and add it to the increment value before saving? The other Kudu limitation that this runs into is that row key columns cannot be modified. It would be somewhat easier to implement atomic increments on non-key columns, but then that means doing a lot of updates and it's not something Kudu excels at e.g. it supports modifying data but the higher the rate the slower the reads are.
... View more
07-31-2017
09:21 AM
Kudu doesn't do anything special to resolve hostnames, so it should use the hosts file by way of doing the resolving. You can also see a 5s delay when trying to resolve the address, I would recommend googling "dns 5 seconds delay" and debug your network situation from there.
... View more
07-21-2017
09:36 AM
Deletes like this should be fine, even more ideal when you need to delete huge batches of rows is to hopefully have range partitions setup so that you can just drop them (see this doc), but for millions of rows it shouldn't timeout unless there's something misconfigured.
... View more
07-21-2017
09:16 AM
Dropping the table and recreating it would be a lot more efficient than deleting every row one by one after reading them (which is what "delete from" does). All the logs that pertain to tablet 871c8123905c4e529a233c18751f8154 for that tablet server could be useful. The full INFO file would be perfect if you can zip it and host it on a server somewhere.
... View more
07-21-2017
08:40 AM
1 Kudo
You need to run ksck as the Kudu superuser in order to get the full functionality, this is defined by "--superuser_acl" and it defaults to the user that runs Kudu which is normally "kudu".
... View more
07-21-2017
08:26 AM
In Kudu, doing a delete like this is basically like inserting as many rows as you are deleting, so this might not be what you want to do. In any case, we'd need a lot more logs from nod7.exp to understand what's going on. My guess is that Kudu doesn't have enough memory, sometimes CM can configure it to use 1GB which is below the safe minimum.
... View more
06-30-2017
08:39 AM
Any chance some of you are running on Azure? It has known issues with ntp: https://social.msdn.microsoft.com/Forums/azure/en-US/8c0a1026-0b02-405a-848e-628e68229eaf/i-have-a-lot-of-time-has-been-changed-in-the-journal-of-my-linux-boxes?forum=WAVirtualMachinesforWindows
... View more
06-23-2017
09:42 AM
Ok so it seems the things you previously pasted were resolved when your Kudu cluster finished booting up. When you say "same error", you mean on the client side you're still getting timeouts? I'm asking because what you're showing after that are warnings, not errors, and it's perfectly normal to get memory pushback when servers are too busy. Now this can either mean two things: you're trying to insert faster than Kudu can ingest it based on the resources (disks/ram/cpu) it's given, or there's something wrong with flushing and it's too slow. Having a much bigger log snippet from wewcw0hd3dn01 or wewcw0hd3dn04 would help.
... View more
06-23-2017
09:22 AM
Ok, with 1 disk you wouldn't want more than 1 maintenance manager threads. The log lines you showed can mean that the tablet server is still starting up. Depending on the amount of data and the number of tablets, it can take minutes. You can also run "kudu cluster ksck <master_addresses" to see what's up the all the tablets.
... View more
06-23-2017
08:51 AM
Hi, 2GB is still on the small side, especially if you have a lot of tablets. Here's the recommendation: http://kudu.apache.org/docs/known_issues.html#_server_management Also, which version of Kudu? How many data dirs? How many maintenance manager threads? Thanks, J-D
... View more
06-17-2017
10:26 AM
This question has been posted in many different places and it seems to be related to the fact that this is run from a Windows host which has never been tested. It's not clear it's really a TLS issue. @mbigelow wrote: I would try loading the CA cert that signed the certs for the Kudu master and worker nodes into the JSSE truststore. Do this on the host you are running the Kudu app on. Then any Java applications will use it when negotiating TLS handshakes. You could also create a truststore and use that when launching the Kudu app. https://www.cloudera.com/documentation/enterprise/5-8-x/topics/cm_sg_create_key_trust.html That's not how it works in Kudu though, the CA cert is stored in the Kudu master, no messing with JSSE, see http://kudu.apache.org/docs/security.html
... View more
05-08-2017
08:16 AM
Hi, This is likely to be slow, as described in this section of the documentation: http://kudu.apache.org/docs/kudu_impala_integration.html#kudu_impala_insert_bulk There isn't much you can do about this, except going the " Batch Insert" route as described in the link above. J-D
... View more
04-27-2017
07:50 AM
Hi, Kudu currently doesn't support atomic increments or any kind of operation that reads a value and makes a decision based on that value with the guarantee that it won't change. Thx, J-D
... View more
03-21-2017
08:15 AM
1 Kudo
Hi, This is a current limitation in Kudu (see the second bullet point): http://kudu.apache.org/docs/known_issues.html#_schema_and_usage_limitations Putting ent_ts first in the schema will solve this. Arguably the error message could be better. Regards, J-D
... View more
01-30-2014
02:06 PM
* Is this available in CDH4.5.0 running with hbase 0.94.6? It is available in 0.94.6-cdh4.5.0 yes. * Do i set this in the safety valvle for the regionserver settings? Yes. * Can I verify this is the current policy running on major compactions? Major compactions compact all the files, so there isn't a policy in use here. Best I can tell you can't really see if the policy is in effect when file selection is done for minor compactions. One thing you can do is look at the list of configurations on a running region server, go to one of your region server's web UI and put /conf after the port then look for hbase.hstore.useExploringCompation. It won't be listed in 4.0.0 but in 4.5.0 it should be there and set to true if you set useExploringCompation correctly.
... View more