Scrapinghub Overview
What is Scrapinghub?
Scrapinghub is a provider of full stack web scraping solutions, offering a suite of platform products for transforming websites into data at scale. Combining technology and services to meet the needs of business users and developers from entry to Enterprise-level, Scrapinghub's custom on-demand data extraction plans are backed by qualified web scraping engineers. In addition, its Crawlera product promises "smart" IP proxy management that operates via HTTP request sends to its API, providing automatic proxy rotation and ban management. Available across scalable pricing plans designed for small to Enterprise-level scraping based on monthly and concurrent requests; Crawlera offers automatic ban detection, user behavior simulation and unlimited bandwidth. Also supported by headless browsers, Scrapinghub's own Splash browser is a purpose-built solution available as an open source project or hosted SaaS product. This lightweight headless browser scrapes data from websites at scale, including JavaScript-generated content, while simulating user behavior via custom scripting. Scrapy Cloud is the provider's cloud-based platform for managing and automating the deployment of web crawlers or "spiders" via a real time dashboard interface. Built-in QA tools and integration of Scrapinghub’s own Spidermon framework join intelligent scheduling options and customizable containers. Lastly, Scrapinghub's automatic data extraction API (beta) provides eCommerce and article data extraction at scale. The Select Product API returns structured data such as product information from eCommerce URLs, while the Select Article API scrapes news articles and blog posts.Scrapinghub Overview
Pricing
Pricing options
Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually
Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month
Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom
Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month
Scrapinghub Features
Screenshots
Scrapinghub Reviews
Scrapinghub Reviews
When it just works
It makes me work really fast but still secure for my clients. I look really professional even though what I did was only suggesting and installing Crawlera. It's awesome!
Relatively Easy To Use
Our company, whatoplay.com, aggregates data from multiple sources around the world. Since we started using Crawlera, we haven't really encountered big issues. Our common ones in the last 6 months is just reaching our limit, so we just had to increase our plan.
K-LIX
I have a good experience with scrappinhumb, in a matter of minutes I can develop and publish a new spider.
Why do you need that title?
I use and recommend that platform for years for my customers which need production-ready enterprise-grade data scraping systems.
Simple, reliable and powerful service
Never had a problem, and customer services always replied to our requests promptly, and with attention to detail.
Compare overall rating with alternatives
Compare with alternatives
When it just works
Pros
It really saves my time as a web scraping specialists. I always need rotated proxies for my client needs. I keep creating a new project and it is a lot of hassle of I have to buy proxies, renew proxies, and create proxy rotation on my own. I am glad I don't even need to think about it. It just works!
Cons
Well, it's just doesn't have enough advanced documentation on Scrapy Splash combined with Crawlera. Their development team in Github is very responsive though.
Relatively Easy To Use
Our company, whatoplay.com, aggregates data from multiple sources around the world. Since we started using Crawlera, we haven't really encountered big issues. Our common ones in the last 6 months is just reaching our limit, so we just had to increase our plan.
Pros
We're only using Crawlera for our data scraping needs and it has worked seamlessly since we started using it in 2016. When we had to upgrade to a higher limit, the transition was fast, and no dev time was wasted updating our existing codebase.
Cons
Pricing can be a bit tricky especially if your need is right in between the plans.
K-LIX
I have a good experience with scrappinhumb, in a matter of minutes I can develop and publish a new spider.
Pros
The software delivers the exactly promised result. It has a friendly interface and an efficient support.
Cons
You need a roadmap of new features and the pricing of third-party services.
Response from Scrapinghub
Thank you for the review. All new features will be announced in our Support Center.(https://support.scrapinghub.com/support/home) We also have an Ideas Forum (https://support.scrapinghub.com/support/discussions/forums/22000200101) where we would love your input on ideas or new features you would like to see. We appreciate all input from our Customers to continue to help us improve our products.
Why do you need that title?
I use and recommend that platform for years for my customers which need production-ready enterprise-grade data scraping systems.
Pros
- Original and flexible technology
- No vendor-lock
- Easy to use for professionals
- Pretty convenient API system for integration with third-party solutions
Cons
- Not so easy to use by non-professional IT person that still wants to use data scraping
- Lack of ability to create some kind of simple and clear user interface for such a persons
- No simple solution for distributed/high-volume crawling
- Lack of monitoring and alerting, non convenient logging system
- Overpriced Crawlera
Response from Scrapinghub
Thank you for your review we appreciate all customer feedback. We do have a managed service offering for non IT professional who want access to the Data without having any scraping skills.
Simple, reliable and powerful service
Never had a problem, and customer services always replied to our requests promptly, and with attention to detail.
Pros
We are very happy with Crawlera. It works like a charm with our Scrapy projects, just adding a few lines of code we completely forgot about proxies that ended up failing anyway.
Cons
Some requests end up being very slow, but good news is most of them end up going through.
Compare user recommendation rating with alternatives
Compare with alternatives
Scrapinghub Pricing
Scrapinghub Pricing
Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually
Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month
Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom
Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month
Data on demand:
Once-off: From $500 per site
Data Subscription: $250 per month
Custom: From $2,000 annually
Scrapy Cloud
Starter: FREE
Professional: $9 per unit, per month
Splash
Small: $25 per month
Medium: $50 per month
Large: $100 per month
Enterprise: Custom
Crawlera
C10 Plan: $25 per month
C50 Plan: $100 per month
C100 Plan: $250 per month
C200 Plan: $500 per month
Enterprise: From $1,000 per month
Compare value for money rating with alternatives
Compare with alternatives
Scrapinghub Features
Scrapinghub Features
Compare features rating with alternatives
Compare with alternatives
Categories
Videos and Tutorials
Videos and Tutorials
Additional information for Scrapinghub
Additional information for Scrapinghub
Key features of Scrapinghub
- Email Address Extraction
- Phone Number Extraction
- Web Data Extraction
Benefits
• Scrapinghub is a full stack web scraping platform for business startups and Enterprises, comprising a suite of developer tools alongside managed services for data on demand applications.
• Custom data extraction services are also available, supported by a team of over 100 qualified web scraping engineers.
• Crawlera is a proxy network designed for scalable web scraping based on monthly requests, with main features including automatic ban detection and IP rotation, persistent sessions, headless browser support, plus unlimited bandwidth.
• Splash is Scrapinghub's lightweight headless browser that facilitates the scraping of JavaScript generated content and the simulation of user behavior with custom scripts.
• Scrapy Cloud offers cloud-based management of the deployment and running of web crawlers, comprising a real time dashboard, built-in QA tools including spider monitoring, scheduling, customizable containers etc.
Scrapinghub FAQs
Scrapinghub FAQs
Below are some frequently asked questions for Scrapinghub.
Q. What type of pricing plans does Scrapinghub offer?
Scrapinghub offers the following pricing plans:
Starting from: $9.00/month
Pricing model: Free, Open Source, Subscription
Free Trial: Available
Data on demand: Once-off: From $500 per site Data Subscription: $250 per month Custom: From $2,000 annually Scrapy Cloud Starter: FREE Professional: $9 per unit, per month Splash Small: $25 per month Medium: $50 per month Large: $100 per month Enterprise: Custom Crawlera C10 Plan: $25 per month C50 Plan: $100 per month C100 Plan: $250 per month C200 Plan: $500 per month Enterprise: From $1,000 per month
Q. What are the main features of Scrapinghub?
Scrapinghub offers the following features:
- Email Address Extraction
- Phone Number Extraction
- Web Data Extraction
Q. Who are the typical users of Scrapinghub?
Scrapinghub has the following typical customers:
Large Enterprises, Mid Size Business, Small Business
Q. What languages does Scrapinghub support?
Scrapinghub supports the following languages:
English
Q. What type of pricing plans does Scrapinghub offer?
Scrapinghub has the following pricing plans:
Free, Open Source, Subscription
Q. Does Scrapinghub support mobile devices?
We do not have any information about what devices Scrapinghub supports
Q. What other apps does Scrapinghub integrate with?
Scrapinghub integrates with the following applications:
Dropbox, GitHub, Google Drive
Q. What level of support does Scrapinghub offer?
Scrapinghub offers the following support options:
Online Support, Phone Support
It makes me work really fast but still secure for my clients. I look really professional even though what I did was only suggesting and installing Crawlera. It's awesome!