Member since
07-22-2019
41
Posts
1
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2095 | 02-13-2019 11:55 AM | |
817 | 02-13-2019 11:25 AM | |
941 | 02-07-2019 10:22 AM |
01-07-2020
09:16 AM
How did you resolve the issue ?
... View more
01-06-2020
06:55 AM
Is there a way to setup a Kafka container without ambari and then add kafka broker to ambari ?
... View more
08-12-2019
10:43 AM
We can write custom functions that can be implemented in the window using which rank can be calculated. There is no native processor as such.
... View more
07-22-2019
01:41 PM
You can create a jar and deploy as User defined function.... https://github.com/hortonworks/streamline/blob/master/streams/sdk/src/main/java/com/hortonworks/streamline/streams/rule/UDAF.java
... View more
07-22-2019
01:30 PM
you could write your own User defined processor also.
... View more
03-06-2019
10:02 AM
which format does timestamp field accepted Streamining analtics manager ? I am assume milliseconds from epoch
... View more
02-18-2019
12:42 PM
Hello Were you able to resolve your issue ??
... View more
02-13-2019
11:56 AM
I changed the column type from bigint to integer for the topology_test_run_case_source.occurence and it was resolved and the test cases also started to run !!! @Timothy Spann @Geoffrey Shelton Okot thanks for the help !!!
... View more
02-13-2019
11:55 AM
I changed the column type from bigint to integer for the topology_test_run_case_source.occurence and it was resolved and the test cases also started to run !!!
... View more
02-13-2019
11:25 AM
I changed the column type from bigint to integer for the topology_test_run_case_source.occurence and it was resolved and the test cases also started to run !!!
... View more
02-07-2019
10:22 AM
Are your schema Name and topic name Same(literally)?
... View more
01-30-2019
09:32 AM
Just In case !! https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.1.1/bk_user-guide/content/Controller_Services_for_Dataflows.html
... View more
01-28-2019
11:09 AM
@Greg Keys I am having the same issue with hdf 3.3.1. I have checked the schema file and the input file as well. I have done what was mentioned by @Sriharsha Chintalapani Schema {
"namespace": "hdf.heaptrace.com",
"type": "record",
"name": "PatientField",
"fields": [
{"name": "Patient_name","type": "string"}
]
} JSON data {"Patient_name":"john"}
Please help !!! I have converted data from json to avro and then back again as well using avro tools.
... View more
01-28-2019
10:26 AM
Have you resolved your issue ?? How did you do it ??
... View more
01-26-2019
07:26 PM
how to detemine the artifacts we need ??
... View more
01-26-2019
06:14 PM
Is there something wrong with my DB configuration or application config ?? I have installed SAM and registry on Postgresql 9.5 !! I have simple kafka source and sink as my topology !! I think i have a problem with the kafka source !! ERROR [2019-01-2214:21:58.894][dw-288- DELETE /api/v1/catalog/topologies/2/testcases/7] c.h.s.s.s.TopologyTestRunResource-Got exception:[StorageException]/ message [com.hortonworks.registries.storage.exception.StorageException: java.lang.NoSuchMethodException: com.hortonworks.streamline.streams.catalog.TopologyTestRunCaseSource.setOccurrence(java.lang.Long)]/ related resource location:[com.hortonworks.streamline.streams.service.TopologyTestRunResource.removeTestRunCase](TopologyTestRunResource.java:548)com.hortonworks.registries.storage.exception.StorageException: com.hortonworks.registries.storage.exception.StorageException: java.lang.NoSuchMethodException: com.hortonworks.streamline.streams.catalog.TopologyTestRunCaseSource.setOccurrence(java.lang
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache Storm
01-26-2019
03:04 PM
@Geoffrey Shelton OkotHow many kafka brokers are required for a kafka source and sink in the dataflow that i created ??
... View more
01-24-2019
02:58 PM
Thanks @Geoffrey Shelton Okot for responding it was extremely kind of you I have setup the HDF cluster on a single machine, with all the services installed on the same host. No HDP installed. I created a single Kafka source and sink in SAM. This is my schema {
"namespace": "hdf.heap.com",
"type": "record",
"name": "PatientField",
"fields": [
{
"name": "Patient_name",
"type": "string"
}
]
} and this is my test data {
"Patient_name": "john"
} I get an exception when I try to run my application (NoSuchMethodException) When try to run my test case it gives me a storageException SAM is not allowing me to even delete the test cases whilst giving the same exception !! I am using a console producer to talk to the kafka source(consumer) inside SAM but that is also not showing any activity. Any help is much appreciated !!!
... View more
01-24-2019
01:56 PM
@Geoffrey Shelton Okot have you been able to reproduce the issue ??
... View more
01-24-2019
01:38 PM
Update !! The problem still seems to persist as I have installed HDP now as well !
... View more
01-24-2019
09:34 AM
I have installed HDF ambari and also made the database for SAM as streamline. i cross checked in the database streamline all the data of test application is being stored by SAM and it was !!! I am able to see the schemas that I have written in schema registry inside SAM when I am configuring Kafka Source and Sink. Oh SAM needs HDP !!!! Is it ??? I did not see in the HDF installation guide that it was necessary for SAM. I have not installed HDP or any of its components. Thanks for the quick reply its extremely kind of you !! I will start working for the same now !! They should atleast give a message during the installation that HDP is required for SAM working !!
... View more
01-24-2019
09:34 AM
1 Kudo
@Sriharsha Chintalapani @Arun Mahadevan @Timothy Spann @pshah@Shu@George Vetticaden @mqureshi @amarnath reddy pappu@sree charan @Suresh Bonam @Sagar Shimpi @Satish Duggana @Sandeep Nemuri @Satish Anjaneyappa @Rishit shah @Balakrishnan Ramasamy I am running a basic Kafka source and sink with one rule in between
both have different schemas and i am using a console consumer to read out the sink .
While I am adding the test data in the test case it throws the following exception :-
Caused by: com.hortonworks.registries.storage.exception.StorageException: java.lang.NoSuchMethodException: com.hortonworks.streamline.streams.catalog.TopologyTestRunCaseSource.setOccurrence(javalang.Long) at com.hortonworks.registries.storage.catalog.AbstractStorable.fromMap(AbstractStorable.java:93) atcom.hortonworks.registries.storage.impl.jdbc.provider.sql.factory.AbstractQueryExecutor$QueryExecution.getStorablesFromResultSet(AbstractQueryExecutor.java:480) at com.hortonworks.registries.storage.impl.jdbc.provider.sql.factory.AbstractQueryExecutor$QueryExecution.executeQuery(AbstractQueryExecutor.java:363) at com.hortonworks.registries.storage.impl.jdbc.provider.sql.factory.AbstractQueryExecutor.executeQuery(AbstractQueryExecutor.java:344) at com.hortonworks.registries.storage.impl.jdbc.provider.postgresql.factory.PostgresqlExecutor.select(PostgresqlExecutor.java:121) at com.hortonworks.registries.storage.impl.jdbc.JdbcStorageManager.find(JdbcStorageManager.java:128) ... 61 common frames omittedCaused by: java.lang.NoSuchMethodException: com.hortonworks.streamline.streams.catalog.TopologyTestRunCaseSource.setOccurrence(java.lang.Long)
Also why I am not being able to delete the test cases ???(it throws an exception in this case as well !!!!!)
ERROR [2019-01-22 14:21:58.894] [dw-288 - DELETE /api/v1/catalog/topologies/2/testcases/7] c.h.s.s.s.TopologyTestRunResource - Got exception: [StorageException] / message [com.hortonworks.registries.storage.exception.StorageException: java.lang.NoSuchMethodException: com.hortonworks.streamline.streams.catalog.TopologyTestRunCaseSource.setOccurrence(java.lang.Long)] / related resource location: [com.hortonworks.streamline.streams.service.TopologyTestRunResource.removeTestRunCase](TopologyTestRunResource.java:548)
com.hortonworks.registries.storage.exception.StorageException: com.hortonworks.registries.storage.exception.StorageException: java.lang.NoSuchMethodException: com.hortonworks.streamline.streams.catalog.TopologyTestRunCaseSource.setOccurrence(java.lang.Long)
Is there something wrong with my database configuration ???
I am using postgresql 9.5 which came with Ambari (I used the embedded DB option and created the registry and streamline DBs in the same)
Any help is much appreciated !!!!
... View more
Labels:
01-24-2019
07:21 AM
Thanks for the quick reply @Geoffrey Shelton Okot its extremely kind of you !! Please have a look at this issue I am having:- https://community.hortonworks.com/questions/233052/sam-cannot-store-and-run-any-test-case-gives-nosuc.html
... View more
01-23-2019
11:13 AM
@Suresh Kota @Sandeep Nemuri @pshah @Arun Mahadevan @ARUN @George Vetticade
... View more
Labels:
01-22-2019
08:57 AM
I think only postgresql 9.5 above is supported !!!
... View more
01-21-2019
10:00 AM
so the schema name and the topic name need to be same, thus it shows it in the drop down.
... View more
01-15-2019
12:53 PM
@dbains I have installed Kafka on HDF cluster and trying to create topics using kafka-topics.sh and also use the kafka-console-produce.sh but bash keeps telling me command not found !!!
... View more