gcp-serverless-twitter-pipeline

A full end-to-end serverless pipeline to read Tweets and send them to BigQuery and Firestore/Firebase

Note that the below image/architecture does not include Dataflow -> PubSub -> Cloud Function -> Firestore (for brevity's sake it only showed Dataflow to Firestore). Also, the ML component doesn't exist yet off the back of BigQuery, but this could be simply BigQueryML.

To deploy:

gcloud builds submit --config=cloudbuild.yaml .