NiFi provenance events written to external systems?

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

NiFi provenance events written to external systems?

Erik Anderson
For NiFi provenance events, whats the best way to dual write those provenance events (Provenance Repository?) to external systems?

In particular openstracing API's

https://github.com/opentracing

Any 3rd party ad-ons? Lower level hooks to the Provenance Repository? Writing of all provenance events to a Kafka pipe? etc....

I see some old hits about

http://mail-archives.apache.org/mod_mbox/nifi-users/201606.mbox/%3CCALo_M1-cGhEKj+2SztdpB53pAPkeZv0BeKxx5T5cv7cKVsB12Q@...%3E

 SiteToSiteProvenanceReportingTask.java on the mailing lists but the hits are old.

Anyone have an example of doing this? There are zero hits on github.com for SiteToSiteProvenanceReporting.

Erik Anderson
Bloomberg
Reply | Threaded
Open this post in threaded view
|

Re: NiFi provenance events written to external systems?

Mark Payne
Hi Erik,

The Site To Site Provenance Reporting Task is the recommended approach. There's a post on how to get started with that [1].
I don't know of any other 3rd party additions to provide anything beyond this. Is there an issue that you're running into with this
approach?

Thanks
-Mark

[1] https://community.hortonworks.com/articles/72727/extracting-nifi-provenance-data-using-sitetositepr.html


On Dec 19, 2018, at 10:22 AM, Erik Anderson <[hidden email]<mailto:[hidden email]>> wrote:

For NiFi provenance events, whats the best way to dual write those provenance events (Provenance Repository?) to external systems?

In particular openstracing API's

https://github.com/opentracing

Any 3rd party ad-ons? Lower level hooks to the Provenance Repository? Writing of all provenance events to a Kafka pipe? etc....

I see some old hits about

http://mail-archives.apache.org/mod_mbox/nifi-users/201606.mbox/%3CCALo_M1-cGhEKj+2SztdpB53pAPkeZv0BeKxx5T5cv7cKVsB12Q@...%3E

SiteToSiteProvenanceReportingTask.java on the mailing lists but the hits are old.

Anyone have an example of doing this? There are zero hits on github.com for SiteToSiteProvenanceReporting.

Erik Anderson
Bloomberg