Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HCP 1.9.1 Installation and demo, No results found in Kibana

Highlighted

HCP 1.9.1 Installation and demo, No results found in Kibana

New Contributor

I have installed and working HCP 1.9.1

there are many things and addition adjustment should be made to make this installation and services started successfully, and the installation docs is not telling it all, Please take note this to all new comers who wants to start and explore this solution


After that, when I try the learning and training tutorial described at:

https://docs.hortonworks.com/HDPDocuments/HCP1/HCP-1.9.1/runbook-overview/index.html


I get to the point where I'm not able to see the Squid log in elasticsearch index,

I'm really stuck at here,

https://docs.hortonworks.com/HDPDocuments/HCP1/HCP-1.9.1/add-new-telemetry/content/verify_that_the_e...


default index was created, my work around was to use this: https://pastebin.com/9TPV5XQN

and I also use this: https://pastebin.com/9WSmhNAn


tcpdump -A -i ens192 src <nifi-ipaddress> from my single elasticsearch host shows this:

12:16:16.224880 IP HCP10-DataSource1.33810 > HCP9-MetronSearch1.ircu-3: Flags [P.], seq 1490977535:1490977718, ack 1135751061, win 31088, options [nop,nop,TS val 10936402 ecr 10787491], length 183
E....[@.@.'.

..

......X...C./...yp.......
...R...............y.
nifi-squid....u0......squid.......................v..6-.........h1557378975.223    232 127.0.0.1 TCP_MISS/302 280 GET http://www.atmape.ru/ - HIER_DIRECT/36.86.63.182 -

12:16:21.226164 ARP, Reply HCP10-DataSource1 is-at 00:50:56:99:6b:51 (oui Unknown), length 46
.........PV.kQ

...PV..4

....................


But no result found in Kibana,

108611-2019-05-09-121756.png


Any help thanks!

2 REPLIES 2

Re: HCP 1.9.1 Installation and demo, No results found in Kibana

New Contributor

the resolution was to resolve the always complaining:

ERROR [KafkaApi-1001] Number of alive brokers '2' does not meet the required replication factor '3' for the offsets topic (configured via 'offsets.topic.replication.factor'). This error can be ignored if the cluster is starting up and not all brokers are up yet. (kafka.server.KafkaApis)


I have this HCP setup as demo, and only have 2 kafka brokers,

just simply goto Ambari/Kafka/configs then change offsets.topic.replication.factor=2,

restart kafka and metron,

Re: HCP 1.9.1 Installation and demo, No results found in Kibana

New Contributor

@Donny Lie Sorry for the delay in following up on your comment. Can you tell me what information is missing from the installation documentation. Was this for the actual HCP installation or the configuration and set up? I would welcome any feedback you can provide so I can improve/correct the documentation.