How to Connect Apify to n8n for Automated Web Scraping in 4 Simple Steps
Most businesses waste countless hours manually collecting data from websites, Google Maps and online stores. This step-by-step tutorial shows how to automate web scraping without coding - connecting Apify's powerful scrapers to n8n workflows that save 10+ hours weekly while generating fresh leads and competitive intelligence.
Why Automate Web Scraping?
Manual data collection is one of the biggest time-wasters in modern business operations. Marketing teams spend hours compiling competitor pricing. Sales teams painstakingly gather leads from directories. Operations staff monitor inventory across multiple sites - all repetitive tasks that could be automated.
Web scraping automation solves three critical business problems: First, it eliminates the drudgery of manual copy-pasting, saving 10-15 hours per employee weekly. Second, it ensures data consistency by removing human error from collection. Third, it enables real-time monitoring that manual processes can't match.
72% of businesses using automated web scraping report improved decision-making from having fresher, more comprehensive data compared to manual methods.
Apify + n8n: The Perfect Automation Pair
Apify specializes in web scraping with pre-built "actors" (scrapers) for platforms like Google Maps, LinkedIn, eCommerce sites and more. n8n provides workflow automation to process and route that data. Together they create an end-to-end solution without coding.
Apify handles the complex scraping operations - dealing with pagination, JavaScript rendering, and anti-bot measures. n8n manages the business logic - scheduling runs, transforming data, and sending it to CRMs, sheets or other destinations. The integration gives you scraping power without infrastructure headaches.
Step 1: Create Your Apify API Token
Every n8n workflow connecting to Apify needs authentication. In your Apify console (1:15 in the video), navigate to Settings → API and Integrations. Create a new API token with a descriptive name like "n8n Integration".
This token allows n8n to trigger Apify actors and retrieve results. Treat it like a password - never expose it in client-side code or share publicly. The token only needs "Run actor and read dataset" permissions for basic integrations.
Pro Tip: Create separate tokens for development and production environments. Revoke compromised tokens immediately in the Apify console.
Step 2: Choose and Configure an Apify Actor
Apify's Actor Store (3:40) offers hundreds of pre-built scrapers. For lead generation, the Google Maps Scraper is particularly powerful. Search for "Google Maps" in the store, then configure your target:
- Search terms: "yacht builder" (or your industry)
- Location: "Amsterdam" (or your target city)
- Max results: 100 (adjust based on needs)
The actor's configuration panel shows all available options. Most business use cases don't require advanced settings - the defaults work well for contact scraping, competitor monitoring and market research.
Step 3: Connect Apify to n8n
At 5:20 in the tutorial, we copy the Actor's API endpoint from Apify's "API" tab. In n8n, create a new HTTP Request node:
- Method: POST
- URL: Paste the "Run actor" endpoint
- Authentication: Basic Auth with your Apify token
- Body: JSON configuration from Apify
When executed, this node starts the Apify actor. Scraping jobs take time - we handle this in n8n either with a fixed delay (for predictable scrapes) or a loop checking completion status (for variable durations).
Note: The first execution may fail as n8n learns the JSON structure. Use the "Set manually" option to map fields correctly on subsequent runs.
Step 4: Process and Store Scraped Results
Once scraping completes (8:50), add another HTTP Request node to fetch results using Apify's "Get dataset items" endpoint. Configure it as:
- Method: GET
- URL: Dataset endpoint from Apify
- Authentication: Same token as before
The tutorial shows storing in Google Sheets, but n8n supports 300+ destinations. For lead generation, consider enriching data with email verification or social profiles before sending to your CRM. For market research, analyze trends over time by timestamping each scrape.
Watch the Full Tutorial
See the complete integration in action at 4:30 where we configure the Google Maps scraper, and at 7:15 where we set up the n8n HTTP requests. The video demonstrates troubleshooting common issues like authentication errors and JSON formatting.
Key Takeaways
Connecting Apify to n8n creates a powerful automation that eliminates manual data collection. The four-step process works for most scraping needs while respecting website terms of service.
In summary: 1) Get an Apify API token, 2) Choose your scraper, 3) Connect via n8n HTTP nodes, 4) Process results automatically. This saves hours weekly while providing fresher, more reliable business data.
Frequently Asked Questions
Common questions about this topic
The Apify-n8n integration solves three major business problems: First, it eliminates manual data collection from websites, Google Maps and online stores, saving 10+ hours weekly. Second, it enables automated lead generation by scraping contact details and business information. Third, it provides competitor monitoring by regularly collecting pricing, product listings and other public data.
These automations are particularly valuable for:
- Sales teams building prospect lists
- Marketing teams tracking competitor activity
- Operations teams monitoring inventory or service availability
No coding skills are required. The tutorial shows how to connect Apify scrapers to n8n workflows using pre-built actors (scrapers) and HTTP requests. The most technical step involves copying JSON configurations, which is demonstrated step-by-step.
The entire process can be completed through visual interfaces:
- Apify provides point-and-click scraper configuration
- n8n offers drag-and-drop workflow building
- Both platforms include templates for common use cases
Common data types collected include: Business contact details (emails, phone numbers, addresses), product listings with prices, Google Maps business information (reviews, categories, hours), social media profiles, job listings, and real estate data.
The specific data depends on which Apify actor (scraper) you use in your workflow. Popular actors include:
- Google Maps Scraper - for local business leads
- Amazon Scraper - for product and pricing data
- LinkedIn Scraper - for professional profiles
n8n workflows with Apify can run on any schedule: daily, weekly, monthly or triggered by events. The tutorial shows how to set up automatic runs using n8n's scheduler node.
For compliance and performance:
- Space out requests to avoid overloading target sites
- Respect websites' terms of service and robots.txt
- Most business use cases run weekly scrapes
The tutorial demonstrates storing data directly in Google Sheets, but n8n can send scraped data to 300+ destinations. Common storage options include:
For immediate use:
- Google Sheets or Excel for manual review
- CRM systems like HubSpot or Salesforce
- Databases like Airtable or MySQL
Web scraping is legal when collecting publicly available data for legitimate business purposes, provided you follow these guidelines:
Key compliance considerations:
- Respect robots.txt files and website terms
- Avoid overloading servers with excessive requests
- Don't bypass paywalls or access private data
Costs vary based on scraping frequency and data volume:
Typical monthly costs:
- Apify charges ~$1 per 1000 pages scraped
- n8n starts free, with paid plans from $20/month
- Google Maps scraper example: $5-20/month
GrowwStacks builds custom Apify-n8n integrations tailored to your specific data needs. Our automation experts handle the entire process:
Our implementation services include:
- Identifying optimal scraping targets for your goals
- Configuring compliance-safe workflows
- Setting up automated data storage and processing
Automate Your Data Collection in Days, Not Months
Manual web scraping wastes valuable time and produces inconsistent results. Our n8n automation experts will build you a custom Apify integration that runs on autopilot - delivering fresh, reliable data exactly where you need it.