IoT platforms and sensor batch processing
DO NOT MERGE YET!
This is a preview of my work on two architectures; both are a part of wider work, but are hopefully useful for this project. Significant portion of the work will be ready for the Spark Council meeting in early June; I am to complete the work by the end of June.
The aim is to show a reference architecture and then a reference implementation (a case study, if you like). I can merge the original LaTeX code and diagrams (from https://github.com/eigengo/spark-reference-architecture), if preferred over the PDFs.
My ultimate aim is to work with the Cake Solutions team to have another 5 or 6 reference architectures, and then a foreword that wraps our entire body of work. This could be a "collection of architectures" publication, which will give the readers good overview of modern ML & big data systems.
Developer's Certificate of Origin 1.1
By making a contribution to this project, I certify that:
(a) The contribution was created in whole or in part by me and I
have the right to submit it under the Apache License 2.0; or
(b) The contribution is based upon previous work that, to the best
of my knowledge, is covered under an appropriate open source
license and I have the right under that license to submit that
work with modifications, whether created in whole or in part
by me, under the same open source license (unless I am
permitted to submit under a different license), as indicated
in the file; or
(c) The contribution was provided directly to me by some other
person who certified (a), (b) or (c) and I have not modified
it.
(d) I understand and agree that this project and the contribution
are public and that a record of the contribution (including all
personal information I submit with it, including my sign-off) is
maintained indefinitely and may be redistributed consistent with
this project or the open source license(s) involved.
@janm399 Do you have any updates on these use cases ? Would you like to update this PR so it can get merged ?