ETL pipeline for text processing

This workflow allows you to collect tweets, store them in MongoDB, analyze their sentiment, insert them into a Postgres database, and post positive tweets in a Slack channel.

Cron node: Schedule the workflow to run every day

Twitter node : Collect tweets

MongoDB node: Insert the collected tweets in MongoDB

Google Cloud Natural Language node: Analyze the sentiment of the collected tweets

Set node: Extract the sentiment score and magnitude

Postgres node: Insert the tweets and their sentiment score and magnitude into a Posgres database

IF node: Filter tweets with positive and negative sentiment scores

Slack node: Post tweets with a positive sentiment score in a Slack channel

NoOp node: Ignore tweets with a negative sentiment score