spark-ref-architecture icon indicating copy to clipboard operation
spark-ref-architecture copied to clipboard

IoT platforms and sensor batch processing

Open janm399 opened this issue 9 years ago • 1 comments

DO NOT MERGE YET!

This is a preview of my work on two architectures; both are a part of wider work, but are hopefully useful for this project. Significant portion of the work will be ready for the Spark Council meeting in early June; I am to complete the work by the end of June.


The aim is to show a reference architecture and then a reference implementation (a case study, if you like). I can merge the original LaTeX code and diagrams (from https://github.com/eigengo/spark-reference-architecture), if preferred over the PDFs.

My ultimate aim is to work with the Cake Solutions team to have another 5 or 6 reference architectures, and then a foreword that wraps our entire body of work. This could be a "collection of architectures" publication, which will give the readers good overview of modern ML & big data systems.


Developer's Certificate of Origin 1.1

   By making a contribution to this project, I certify that:

   (a) The contribution was created in whole or in part by me and I
       have the right to submit it under the Apache License 2.0; or

   (b) The contribution is based upon previous work that, to the best
       of my knowledge, is covered under an appropriate open source
       license and I have the right under that license to submit that
       work with modifications, whether created in whole or in part
       by me, under the same open source license (unless I am
       permitted to submit under a different license), as indicated
       in the file; or

   (c) The contribution was provided directly to me by some other
       person who certified (a), (b) or (c) and I have not modified
       it.

   (d) I understand and agree that this project and the contribution
       are public and that a record of the contribution (including all
       personal information I submit with it, including my sign-off) is
       maintained indefinitely and may be redistributed consistent with
       this project or the open source license(s) involved.

janm399 avatar May 28 '16 15:05 janm399

@janm399 Do you have any updates on these use cases ? Would you like to update this PR so it can get merged ?

lresende avatar Oct 21 '16 23:10 lresende