EventHub Source processor properties not populating

[kphwx]

When configuring an Event Hub processor, the values of Schema Branch/Version show "results not found" despite entering valid values for all previous parameters (username, passwd, namespace, entitypath).

Expecting the Schema Branch to read from Schema Registry and show "MASTER" (default) as branch but it appears that the Processor isn't syncing these values properly from schema registry?

[arunmahadevan]

For eventhubs, SAM looks up schema based on the value entered in "Entity path" . In this case you need to define a schema with name "woolies" (not testeventhub).

[kphwx]

@arunmahadevan thanks for checking this out.

I did actually have a schema named "woolies" as well which i've tried again now.

I think it's validating that OK - doesn't give error "schema not found" when you enter woolies - but then no values are populated into SCHEMA BRANCH.

[arunmahadevan]

@kphwx, you might want to check if the streamline and registry versions are compatible. From the screenshot it appears so. You could also enable debug logs for streamline and schema registry and see the request/response being sent.

This works for me with the latest version of streamline/registry (master branch).

[kphwx]

@arunmahadevan the SAM I have with HDF 3.1.2 seems to be version 0.6.0. However, SR is 0.5.1 which is interesting as the component notes for HDF say SR is listed as 0.5.0.

Is yours 0.5.0?

Also, looking at output withe DEBUG on (thanks for that suggestion) it looks like it's calling a different GET api method than what is in swagger? See output below or file streamline.log-error.txt

Looking the swagger docs it should be calling: /api/v1/schemaregistry/schemas??

INFO [2018-07-20 01:21:26.639] [dw-27 - GET /api/v1/schemas/woolies/versions] c.h.s.s.s.SchemaResource - Get all versions for schema : woolies INFO [2018-07-20 01:21:45.370] [dw-40 - GET /api/v1/schemas/undefined/versions/1] c.h.s.s.s.SchemaResource - Get schema:version undefined:1 INFO [2018-07-20 01:21:45.372] [dw-40 - GET /api/v1/schemas/undefined/versions/1] c.h.r.s.c.SchemaVersionInfoCache - Loading entry for cache with key [Key {schemaVersionKey=SchemaVersionKey{schemaName='undefined', version=1}, schemaIdVersion=null}] from target service INFO [2018-07-20 01:21:45.372] [dw-40 - GET /api/v1/schemas/undefined/versions/1] c.h.r.s.c.SchemaRegistryClient - Getting schema version from target registry for [SchemaVersionKey{schemaName='undefined', version=1}] ERROR [2018-07-20 01:21:45.412] [dw-40 - GET /api/v1/schemas/undefined/versions/1] c.h.s.s.s.SchemaResource - Got exception: [RuntimeException] / message [java.lang.RuntimeException: com.google.common.util.concurrent.UncheckedExecutionException: javax.ws.rs.NotFoundException: HTTP 404 Not Found] / related resource location: com.hortonworks.streamline.streams.service.SchemaResource.getSchemaForVersion java.lang.RuntimeException: java.lang.RuntimeException: com.google.common.util.concurrent.UncheckedExecutionException: javax.ws.rs.NotFoundException: HTTP 404 Not Found

[arunmahadevan]

If you are using HDF 3.1.2 I am not sure how are you even getting the "Schema Branch" option in the UI because the changes for that have not gone into HDF-3.1-maint.

See - https://github.com/hortonworks/streamline/issues/1240

This has been fixed in master and should be available in the next release (HDF 3.2 or streamline 0.7).

[kphwx]

@arunmahadevan

Hmmm. OK, not sure what is happening there.

Should I use the prior HDF version (3.1.1) instead?