nifi-stateless-operator icon indicating copy to clipboard operation
nifi-stateless-operator copied to clipboard

Published 20 hours ago • verified publisher icon B23admin

Any documentation?

Open One946 opened this issue 4 years ago • 6 comments

Hi, I was looking at this project and I was wondering if there's some documentation available, even some unofficial documentation would be nice. I'm trying to understand how does serverless nifi works, so any help would be very much appreciated.

One946 avatar Jul 16 '19 11:07 One946

Thanks for taking an interest in this project. There's currently no official documentation for the Nifi-fn operator. I started working on this before the functionality was officially merged into NiFi (it has since been renamed to nifi-stateless). This thread on the mailing list has the discussion on the initial proposal.

Here are the docs for nifi-stateless

The nifi-fn-operator is just a thin wrapper around the original project which makes the same functionality available to kubernetes as an operator.

dbkegley avatar Jul 19 '19 13:07 dbkegley

Thank you. I really appreciate that you spend some of your time answering me, I'll try to wrap my head around those links!

One946 avatar Jul 19 '19 13:07 One946

Docs link is broken. Please provide a new link.

M9T avatar Nov 04 '19 19:11 M9T

Sorry about that, here's the correct link

https://github.com/apache/nifi/tree/rel/nifi-1.10.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-stateless

dbkegley avatar Nov 05 '19 13:11 dbkegley

@dbkegley I am trying to use nifi-stateless-operator as mentioned here https://github.com/B23admin/nifi-stateless-operator Its running successfully but while testing I am having some questions or may be issues:slightly_smiling_face:

  1. As per POC doc its saying flowfiles parameter is optional but its not allowing to run without flowflies --- https://github.com/apache/nifi/tree/rel/nifi-1.10.0/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-stateless While running with flowflies , the flow requires input port as mandatory
  2. And due to lack of documents I am not able to understand how nifi fn is running the flow . Its giving success on container logs but I am not getting any confirmation from nifi UI and not from nifi container.

supriyaK56 avatar Sep 03 '20 13:09 supriyaK56

@supriyaK56 Some of the background in this comment thread may be useful regarding [1] https://github.com/B23admin/nifi-stateless-operator/issues/8#issuecomment-534678530

For [2], there is no UI for nifi-stateless. If the nifi-fn container log is printing a success message then the flowfiles were able to finish processing without any errors. NiFi itself does not have any knowledge of the nifi-stateless flow so there will not be any useful info in the NiFi UI regarding the execution of nifi-stateless. Adding some LogMessage or DebugFlow processors to the stateless flow may help you trace the flowfiles as they move through the data flow

dbkegley avatar Sep 04 '20 14:09 dbkegley