Home
Softono
n8n-nodes-crawl-and-scrape

n8n-nodes-crawl-and-scrape

Open source TypeScript
60
Stars
20
Forks
2
Issues
1
Watchers
6 months
Last Commit

About n8n-nodes-crawl-and-scrape

n8n custom node to crawl and scrape website with crawlee

Platforms

Web Self-hosted

Languages

TypeScript

n8n-nodes-crawl-and-scrape

This is an n8n community node. It lets you use crawl and scrape websites in your n8n workflows.

I used crawlee for this project. Crawlee is a powerful web scraping and crawling library that helps you extract data from websites efficiently and reliably.

n8n is a fair-code licensed workflow automation platform.

Installation
Operations
Credentials
Compatibility
Resources
Version history

Installation

Follow the installation guide in the n8n community nodes documentation.

Operations

The node supports the following operations:

  • Extract Links: Crawls a website and extracts all links found on the page
  • Extract Text: Extracts all text content from a webpage
  • Extract HTML: Retrieves the raw HTML content of a webpage

Credentials

No credentials are required to use this node.

Compatibility

This node is compatible with n8n version 1.0.0 and above.

Resources

Version history

See CHANGELOG.md for details.