Automate With Marc

Automate With Marc

Daily Website Data Extraction with Firecrawl and Telegram Alerts

πŸ”₯ Automated Daily Firecrawl Scraper with Telegram Alerts
Get structured insights scraped daily from the web using Firecrawl's AI extraction engine β€” then send them directly to your Telegram chat.

🧰 What this workflow does:
This workflow automatically scrapes specific structured data from any webpage every day at a scheduled time using the Firecrawl API, checks if results are returned, and then sends the formatted results to Telegram.

For step-by-step video tutorials of n8n builds, check out my channel:
https://www.youtube.com/@Automatewithmarc

🧭 How It Works:
πŸ• Schedule Trigger (Daily at 6PM)
Starts the workflow every day at a set time.

🌐 Firecrawl POST Request
Sends a custom extraction prompt and schema to Firecrawl, targeting any list of URLs you provide.

⏳ 30 Seconds Wait
Waits to give Firecrawl enough time to complete processing.

πŸ“₯ GET Firecrawl Result
Fetches the extraction results using the request ID.

πŸ” Loop with IF Node
Checks whether data is returned. If not, wait another 15 seconds and retry.

🧹 Format & Clean (Set Node)
Prepares and formats the extracted result into a readable message.

πŸ“² Telegram Message Node
Delivers the structured data directly to your Telegram channel or group.

πŸ”§ Requirements:
βœ… Firecrawl API Key (Header Auth)

βœ… Telegram Bot Token & Chat ID

πŸ’‘ Use Cases:
Extract structured data (like product info or events) from niche websites
Automate compliance monitoring or intelligence gathering
Create market alert bots with real-time info delivery

πŸ›  Customization Ideas:
Swap Telegram with Gmail, Discord, or Slack

Expand schema to include more complex nested fields

Add a Google Sheet node to log daily scraped data

Integrate with a summarizer or language model for intelligent summaries

Ready to automate your web intelligence gathering?
🧠 Let Firecrawl do the scraping β€” and let this workflow do the rest.

Do you want to automate your business?

Let's talk about your project