fetchbot
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
Main metrics
Overview
Name With Owner | PuerkitoBio/fetchbot |
---|---|
Primary Language | Go |
Program language | Go (Language Count: 2) |
Platform | |
License: | BSD 3-Clause "New" or "Revised" License |
Release Count | 7 |
Last Release Name | v1.4.0 (Posted on ) |
First Release Name | v1.0.0 (Posted on ) |
Created At | 2014-01-06 12:45:18 |
Pushed At | 2021-05-19 15:11:17 |
Last Commit At | 2021-05-19 11:11:13 |
Stargazers Count | 789 |
Watchers Count | 33 |
Fork Count | 93 |
Commits Count | 83 |
Has Issues Enabled | |
Issues Count | 17 |
Issue Open Count | 1 |
Pull Requests Count | 9 |
Pull Requests Open Count | 1 |
Pull Requests Close Count | 9 |
Has Wiki Enabled | |
Is Archived | |
Is Fork | |
Is Locked | |
Is Mirror | |
Is Private |