apiverve / linkscraper
Link Scraper is a website link extractor API that pulls internal and external links from any webpage URL in real time. It resolves relative paths to absolute URLs, strips empty fragments, and returns anchor text with internal and external counts.
Requires
- php: >=7.4
- guzzlehttp/guzzle: ^7.0
Requires (Dev)
- phpunit/phpunit: ^9.0
Suggests
None
Provides
None
Conflicts
None
Replaces
None
README
Link Scraper is a website link extractor API that pulls internal and external links from any webpage URL in real time. It resolves relative paths to absolute URLs, strips empty fragments, and returns anchor text with internal and external counts.
The Link Scraper API provides a simple, reliable way to integrate link scraper functionality into your applications. Built for developers who need production-ready link scraper capabilities without the complexity of building from scratch.
Quick Start
Using JavaScript
async function callLinkScraperAPI() { try { const requestBody = { "url": "https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/concepts.html", "maxlinks": 20, "includequery": false }; const response = await fetch('https://api.apiverve.com/v1/linkscraper', { method: 'POST', headers: { 'x-api-key': 'YOUR_API_KEY_HERE', 'Content-Type': 'application/json' }, body: JSON.stringify(requestBody) }); const data = await response.json(); console.log(data); } catch (error) { console.error('Error:', error); } } callLinkScraperAPI();
Using cURL
curl -X POST "https://api.apiverve.com/v1/linkscraper" \ -H "x-api-key: YOUR_API_KEY_HERE" \ -H "Content-Type: application/json" \ -d '{ "url": "https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/concepts.html", "maxlinks": 20, "includequery": false }'
Get your API key: https://apiverve.com
📁 For more examples, see the examples folder
Installation
Choose your preferred programming language:
📦 NPM (JavaScript/Node.js)
npm install @apiverve/linkscraper
View NPM Package → | Package Code →
🔷 NuGet (.NET/C#)
dotnet add package APIVerve.API.LinkScraper
View NuGet Package → | Package Code →
🐍 Python (PyPI)
pip install apiverve-linkscraper
View PyPI Package → | Package Code →
💎 Ruby (RubyGems)
gem install apiverve_linkscraper
View RubyGems Package → | Package Code →
🐘 PHP (Packagist)
composer require apiverve/linkscraper
View Packagist Package → | Package Code →
🎯 Dart (pub.dev)
dart pub add apiverve_linkscraper
View pub.dev Package → | Package Code →
🤖 Android (JitPack)
implementation 'com.github.apiverve:linkscraper-api:1.0.0'
🐹 Go
go get github.com/apiverve/linkscraper-api/go
Why Use This API?
| Feature | Benefit |
|---|---|
| Multi-language SDKs | Native packages for JavaScript, Python, C#, Go, and Android |
| Simple Integration | Single API key authentication, consistent response format |
| Production Ready | 99.9% uptime SLA, served from 24 global regions |
| Comprehensive Docs | Full examples, OpenAPI spec, and dedicated support |
Documentation
- 🏠 API Home: Link Scraper API
- 📚 API Reference: docs.apiverve.com/ref/linkscraper
- 📖 OpenAPI Spec: openapi.yaml
- 💡 Examples: examples/
What Can You Build?
The Link Scraper API is commonly used for:
- Web Applications - Add link scraper features to your frontend or backend
- Mobile Apps - Native SDKs for Android development
- Automation - Integrate with n8n, Zapier, or custom workflows
- SaaS Products - Enhance your product with link scraper capabilities
- Data Pipelines - Process and analyze data at scale
API Reference
Authentication
All requests require an API key in the header:
x-api-key: YOUR_API_KEY_HERE
Get your API key: https://apiverve.com
Response Format
Every APIVerve endpoint returns the same envelope — check status, then read data:
{
"status": "ok",
"error": null,
"data": { ... }
}
Example Response
A real response from the Link Scraper API:
{
"status": "ok",
"error": null,
"data": {
"url": "http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/concepts.html",
"linkCount": 16,
"externalLinkCount": 13,
"internalLinkCount": 3,
"links": [
{
"text": "Documentation",
"href": "http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/concepts.html/index.html",
"external": false
},
{
"text": "Amazon EC2 Instance Types Guide",
"href": "https://docs.aws.amazon.com/ec2/latest/instancetypes/instance-types.html",
"external": true
},
{
"text": "Amazon EC2 Auto Scaling",
"href": "https://docs.aws.amazon.com/autoscaling/",
"external": true
}
],
"uniqueDomains": [
"docs.aws.amazon.com",
"aws.amazon.com"
],
"maxLinksReached": false
}
}
Support & Community
- 🏠 API Home: Link Scraper API
- 💬 Support: https://apiverve.com/contact
- 🐛 Issues: GitHub Issues
- 📖 Documentation: https://docs.apiverve.com
- 🌐 Website: https://apiverve.com
Contributing
We welcome contributions! Please see CONTRIBUTING.md for guidelines.
Security
For security concerns, please review our Security Policy.
License
This project is licensed under the MIT License - see the LICENSE file for details.
Acknowledgments
Built with ❤️ by APIVerve
Copyright © 2026 APIVerve. All rights reserved.