What is GoogleScraper used for?

GoogleScraper is a free, Apache-licensed Python module for scraping search engines such as Google, Bing, Yandex and DuckDuckGo, now superseded by a JavaScript successor. It is a good fit for research requiring search engine results data and SEO data collection scripts.

Is GoogleScraper open source?

Yes. GoogleScraper is open source under the Apache-2.0 licence. Its source code is on GitHub at NikolaiT/GoogleScraper.

Is GoogleScraper free?

Yes. GoogleScraper is open source, so the software itself is free to use.

What is GoogleScraper an alternative to?

GoogleScraper is an open-source alternative to SerpApi. Other open-source alternatives to SerpApi include OpenSERP, SearXNG and Wigolo.

Is GoogleScraper actively maintained?

The most recent commit to GoogleScraper was on 3 July 2021. The project has 2.9k stars on GitHub.

GoogleScraper: open-source alternative to SerpApi

About GoogleScraper

GoogleScraper is a Python module built to scrape results from several search engines, including Google, Bing, Yandex and DuckDuckGo, with support for asynchronous networking. It was created for developers who needed programmatic access to search engine results pages for research, SEO or data collection purposes.

According to its own README, the project is no longer actively maintained by its author as of 2019, who explains that Python and Selenium-based scraping were a poor match for how modern bot-detection and browser automation work, in contrast to Node.js tools built on Puppeteer. The author's related, actively developed successor project moved to a general-purpose crawling infrastructure built in JavaScript, and a commercial scraping service called Scrapeulous is also mentioned as an alternative for people who want a managed option.

GoogleScraper itself remains available as open-source Python code, written with an HTML/Python stack, and is released under the Apache-2.0 license. New projects should weigh the author's stated preference for the newer JavaScript-based tooling before building on this module.

Key features

Scrapes multiple search engines (Google, Bing, Yandex, DuckDuckGo)
Asynchronous networking support
Python module usable in custom scripts
Historical reference implementation for search scraping

Good fit for

→Research requiring search engine results data
→SEO data collection scripts

Built with: HTML; Python
Tags: web-scraping; search-engine; python; crawler; seo; deprecated

GoogleScraper: questions and answers

What is GoogleScraper used for?: GoogleScraper is a free, Apache-licensed Python module for scraping search engines such as Google, Bing, Yandex and DuckDuckGo, now superseded by a JavaScript successor. It is a good fit for research requiring search engine results data and SEO data collection scripts.
Is GoogleScraper open source?: Yes. GoogleScraper is open source under the Apache-2.0 licence. Its source code is on GitHub at NikolaiT/GoogleScraper.
Is GoogleScraper free?: Yes. GoogleScraper is open source, so the software itself is free to use.
What is GoogleScraper an alternative to?: GoogleScraper is an open-source alternative to SerpApi. Other open-source alternatives to SerpApi include OpenSERP, SearXNG and Wigolo.
Is GoogleScraper actively maintained?: The most recent commit to GoogleScraper was on 3 July 2021. The project has 2.9k stars on GitHub.