fetchbot

A simple and flexible web crawler that follows the robots.txt policies and crawl delays.

Main metrics

Overview

Name With OwnerPuerkitoBio/fetchbot
Primary LanguageGo
Program languageGo (Language Count: 2)
Platform
License:BSD 3-Clause "New" or "Revised" License
Release Count7
Last Release Namev1.4.0 (Posted on )
First Release Namev1.0.0 (Posted on )
Created At2014-01-06 12:45:18
Pushed At2021-05-19 15:11:17
Last Commit At2021-05-19 11:11:13
Stargazers Count789
Watchers Count33
Fork Count93
Commits Count83
Has Issues Enabled
Issues Count17
Issue Open Count1
Pull Requests Count9
Pull Requests Open Count1
Pull Requests Close Count9
Has Wiki Enabled
Is Archived
Is Fork
Is Locked
Is Mirror
Is Private
To the top