Solved

When I turn off the computer and start HBase again.The following problems arise.How can I do? 2021-05-20 17:19:00,425 WARN [master/rhel145-2-fgos:16000:becomeActiveMaster] regionserver.HRegion: Failed initialize of region= master:store,,1.1595e783b53d99cd5eef43b6debb2682., starting to roll back memstorejava.io.EOFException: Cannot seek after EOF at org.apache.hadoop.hdfs.DFSInputStream.seek(DFSInputStream.java:1648) at org.apache.hadoop.fs.FSDataInputStream.seek(FSDataInputStream.java:66) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initInternal(ProtobufLogReader.java:211) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.initReader(ProtobufLogReader.java:173) at org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:64) at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.init(ProtobufLogReader.java:168) at org.apache.hadoop.hbase.wal.WALFactory.createReader(WALFactory.java:323) at org.apache.hadoop.hbase.wal.WALFactory.cre

I have a situation where my namespace system table is not online and because of that I’m seeing these messages in HBase master log: 2021-03-17 20:29:54,614 WARN  [Thread-18] master.HMaster: hbase:namespace,,1575575842296.0c72d4be7e562a2ec8a86c3ec830bdc5. is NOT online; state={0c72d4be7e562a2ec8a86c3ec830bdc5 state=OPEN, ts=1616010947554, server=itk-phx-prod-compute-6.datalake.phx,16020,1615483461273}; ServerCrashProcedures=false. Master startup cannot progress, in holding-pattern until region onlined. I came across this article for fixing this problem: https://docs.cloudera.com/runtime/7.2.7/troubleshooting-hbase/topics/hbase_running_hbck2.html But while following the article and running suggested command, running into following problem: getting “Failed to specify server's Kerberos principal name” error. I need clarification on following two points: Do we need any specific format to run hbck2 utility if the cluster is kerberized? I.e if the principal needs

We are trying to pull metrics into Promtheus andfor the life of me I spent most of lastnight trying to get CDH 6.2 to work with a javaagent.  I read a previous post where someone was have a heck of a time with jmx exporter and Ambari, so I'm assuming this is also an issue in CDH? If I goto:HBase Service Environment Advanced Configuration Snippet (Safety Valve)and add this:HBASE_MASTER_OPTS=-Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.local.only=false -Dcom.sun.management.jmxremote.port=10110 -javaagent:/run/cloudera-scm-agent/jmx_prometheus_javaagent-0.14.0.jar=9214:/run/cloudera-scm-agent/hbasemaster.yml"HBASE_REGIONSERVER_OPTS=-Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.local.only=false -Dcom.sun.management.jmxremote.port=10111 -javaagent:/run/cloudera-scm-agent/jmx_prometheus_javaagent-0.14.0.jar=9215:/run/cloudera-scm-a

Dear Experts,I am interested in accessing all the data in a hbase table once, so it will be cached.I am using an application that reads from hbase and I notice it is a lot faster when the data was read before, so I would like to "preheat" the data by warming it up: accessing it all once, so it is stored in the cache.I am quite familiar with the cluster configuration necessary to enable caching but wonder what is the easiest way to do this.Is there a command that accesses all the data in all regions 1x? 

Under Nifi UI,  component toolbar is inactive . I have given all the permission under ranger for process groups . I don't have login issues but cant select any processers once I login .

 I am trying to learn flume and for this I am creating some rows to ingest. I have a row like"ted";"27";"hi, i am good; you?";"ok"With the delimiter as ; it separates me also the hi, i am good you? I want only to change field when the ; has a " next to it. Is this possible?

Hello,I am trying to use nifi toolkit cli to list the bucket in Nifi registry using below command -/usr/hdf/3.4.1.1-4/nifi-toolkit/bin/cli.sh registry list-buckets -u http://<ip>:<port>But getting below error :/usr/hdf/3.4.1.1-4/nifi-toolkit$ /usr/hdf/3.4.1.1-4/nifi-toolkit/bin/cli.sh registry list-buckets -u http://<ip>:<port>cli.sh: JAVA_HOME not set; results may varyException in thread "main" java.lang.NoClassDefFoundError: javax/annotation/Priority        at org.glassfish.jersey.model.internal.ComponentBag.modelFor(ComponentBag.java:551)        at org.glassfish.jersey.model.internal.ComponentBag.lambda$registerModel$10(ComponentBag.java:477)        at org.glassfish.jersey.internal.Errors.process(Errors.java:316)        at org.glassfish.jersey.internal.Errors.process(Errors.java:298)        at org.glassfish.jersey.internal.Errors.process(Errors.java:229)&n

Hello,I struggle on a dependency issues in spark, now. Being new in spark, I hope there is a simple remedy.The question is, is there any mechanism how to separate dependencies of the spark engine and dependencies of a application. Example: The latest version of spark-core_2.12 (3.1.1, March 2021) depends onhadoop-client (3.3.0, March 2020) which itself depends on hadoop-common (3.3.0, July 2020)which finally depends on an antient version of gson (2.2.4, May 2013).You can easily find many other examples, e.g. commons-codec, protobuf-java ... So, what if your application, basically a library developed outside spark, depends on the latest (no longer compatible) version of gson 2.8.6?My obviously naive approach to start a spark application ends in runtime incompatibility clashes (e.g. with gson) Best regardsJaro

Hi,I have SiteToSiteBulletinReportingTask setup to capture bulletin information for a standalone secure nifi instance. the reporting task is pointing to an input port as expected but when I start the task it doesnt work and it keeps giving this warning:SiteToSiteBulletinReportingTask[id=e99b03f1-0173-1000-c7ef-4e475ed2416d] org.apache.nifi.remote.client.PeerSelector@24677b11 Unable to refresh Remote Group's peers due to response code 403:Forbidden with explanation: null"The reporting task is setup as follows:         The SSL context service is setup with the same values for the keystore and truststore as in the nifi.properties file which is working to secure my instance. I have added the policy "receive data via site-to-site" to the input port "S2S_Bulletins_rec" . The user created by securing the instance has the policy "retrieve site-to-site details". The error doesn't give much details. Can you please help? Thank you. 

Good afternoon, I am using the "RouteOnAttribute" processor to do a loop validating a condition that is as follows = ${cont:lt(${CONTADOR})} But I am not able to make the processor understand the property "CONTADOR" Could you help me please?      

NIFI 1.13.2 has nodes randomly restarting with connections refused.cluster information12 nodes 8 cores 32 gb rambootstrap.confjava=javarun.as=lib.dir=./libconf.dir=./confgraceful.shutdown.seconds=20java.arg.1=-Dorg.apache.jasper.compiler.disablejsr199=truejava.arg.2=-Xms28gjava.arg.3=-Xmx28gjava.arg.4=-Djava.net.preferIPv4Stack=truejava.arg.5=-Dsun.net.http.allowRestrictedHeaders=truejava.arg.6=-Djava.protocol.handler.pkgs=sun.net.www.protocoljava.arg.7=-XX:ReservedCodeCacheSize=256mjava.arg.8=-XX:CodeCacheMinimumFreeSpace=10mjava.arg.9=-XX:+UseCodeCacheFlushingjava.arg.14=-Djava.awt.headless=truenifi.bootstrap.sensitive.key=java.arg.15=-Djava.security.egd=file:/dev/urandomjava.arg.16=-Djavax.security.auth.useSubjectCredsOnly=truejava.arg.17=-Dzookeeper.admin.enableServer=falsejava.arg.snappy=-Dorg.xerial.snappy.tempdir=/opt/nifi/tmpnotification.services.file=./conf/bootstrap-notification-services.xmlnotification.max.attempts=5# cluster node properties (only configure for cluster nodes

Is there any way to integrate ambari Grafana with ldap or Integrate Garafana with ranger for access control?Ambari version -2.75HDF -3.5

Good afternoon everyone, I have a problem with my flow in the processor "JoltTransformJSON" when I run the processor "ExecuteSQL" and no Oracle record returns to me.   I would like your help to know what to do in this case. Thank you so much.

Hello, We have a strange issue here. We are on CDH 6.3.0 and have sentry in place for authorizations. A user is trying to execute queries from Hue on Impala Editor and fails with Authorization errors. However, same query works fine via Hive and also via Impala shell. It fails only from Hue editor. We have:1. Refreshed metadata2. Invalidated metadata3. Verified permissions are in place in Sentry4. There are no logs generated (I checked in Hue, Sentry Server and Catalog server). Please suggest if any other place should also be checked. Example query:select * from DB.table limit 5; Kindly help to diagnose and resolve this issue. ThanksSnm1523

Hi experts,I was wondering if there is a place where it shows the enhancements between each hadoop component such as hadoop, yarn, hive, hbase, etc. So I am trying to find a reason to upgrade our hadoop clusters or wait for a newer version to come out. Any help is much appreciated. Thanks,

I am using Nifi 1.12.1 version and configuring Prometheus for monitoring. I have multiple nifi instances running on the same machine. But I am not able to get metrics for all on the same port 9092 and getting below error in nifi log. From 3 nifi instances, only one nifi is able to start Prometheus reporting task properly others are saying Address already in use as displayed in error below. Can't we change the Prometheus metrics endpoint from nifi? For example for each nifi instance, we should be able to use a different metric endpoint in below way. nifi-1 - 9092/metrics (default metric end point)nifi-2 >>> 9092/nifi_2_metricsnifi-3 >>> 9092/nifi_3_metrics 2021-05-10 09:55:39,957 ERROR [Timer-Driven Process Thread-4] o.a.n.c.s.StandardProcessScheduler Failed to invoke the On-Scheduled Lifecycle methods of [PrometheusReportingTask[id=47b5aa61-0179-1000-ce9d-d59160596cdb], java.lang.reflect.InvocationTargetException, 30 sec] due to {}; administra

Hi,when I try to upgrade from HDP 3.0.1.0 to HDP 3.1.0 I get the following error when using the Version Definition File http://public-repo-1.hortonworks.com/HDP/centos7/3.x/updates/3.1.0.0/HDP-3.1.0.0-78.xml. "Version Definition read errorAn internal system exception occurred: Stack data, Stack HDP 3.1 is not found in Ambari metainfo"What am I doing wrong ? What is the meaning behindern this internal system error ?Br,Dennis

I've been looking for information for a long time and I can't get it. I'm starting to think that it can't be done if the .parquet is in Azure DataLake Storage. I have a folder with subfolders in Azure DataLake Storage. In these subfolders there are many .parquet. I want to dump the data of these files in a table of a DB. If I am not mistaken when interpreting the code that generates them, the .parquet have several columns:Some whose names correspond exactly to the names of the columns in the table.Others whose names in the .parquet are in lowercase while in the table they are in uppercase.Others whose names are not in the table. I do not need these, I do not want to dump their data in the table. I manage to get the .parquet out of Azure DataLake Storage using ListAzureDataLakeStorage + FetchAzureDataLakeStorage combination. Then I try to pass them directly through a PutDatabaseRecord to dump them in the DB table. As the "Record Reader" property of the PutDatabaseRec

our files:path/sas/a.textpath/sas/b.textpath/sas//bas/a.textpath/sas/bas/b.text how use File Filter Regex and Path Filter Regex to find path/sas/a.text and path/sas/bas/b.text ?there are my filter, I always got four files.File Filter Regex:  a.text|b.textPath Filter Regex: path/sas|path/sas/bas

I am getting a server action failed error when ambari tries to create keytabs. I have no idea what is causing this error. I am using KDC admin to install the service. Please help. @Geoffrey Shelton Okot

When running ./nifi.sh status command occasionally the response is that nifi is running but not responding to ping requests.   Yet when I open cmd and ping the node I get a normal response and the response time is not out of line with the other nodes.   Why is that?

Good morning everybody, I have the following JSON return:{"RegistrosRecebidos" : 1,"RegistrosImportados" : 0,"Erros" : [ "Erro registro 0: The statement has been terminated.\r\nString or binary data would be truncated in table 'Ober_HML.dbo.DB_WS_IMP_CLIENTE', column 'NOME_FANTASIA'. Truncated value: 'ADLER PELZER PERNAMBUCO IND. E COMERCIO '." ]} By default from our supplier, it comes with some formatting. That in Nifi gives the following error: Follow my flow:  How can I do to solve this problem in Nifi? I am trying to use ReplaceText for this but I have not been successful. Thanks.

I have identified that some of my Ranger logs are coming in in gz format (but without the extension). Is there a way of extracting the log data within the Nifi flow?

I am trying to collect data with NiFi using ListSFTP+FetchSFTP. But in the configuration ListSFTP works correctly but I have problems with the configuration of FetchSFTP. I tried with ${path}/${filename} still the problem persists,I also used only the data path, but that doesn't work either . the problem also I have a folder of several files.