CloudQuery

点击几下即可将任何网站转化为应用程序接口(无服务器并支持 SPA!)。「Turn any website to API by several clicks (serverless and support SPA!)」

  • Owner: t9tio/cloudquery
  • Platform: AWS Lambda,Linux,Mac,Windows
  • License:: GNU General Public License v3.0
  • Category::
  • Topic:
  • Like:
    0
      Compare:

Github stars Tracking Chart

CloudQuery

Join us

Turn any website to API by several clicks.

Try online: https://cloudquery.t9t.io

API

Query params:

  • url: url of the webpage you want to fetch
  • selectors: css selectors describing the elements interests you

Returns:

  • innerText: element innerText
  • href: element href

Run locally

# install dependencies
npm i
# start frontend server(for auto restart when code change)
npm run sb
# start backend server(for auto restart when code change)
npm run sf

# visit http://localhost:1234

How to deploy your own CloudQuery to AWS lambda

1. Configuration

  • update profile(AWS Credential Profiles) in up.json to use your own aws account
  • update rateLimit in config.json to set your own rate limit (Default: 5 request/hour)

2. Deploy

# deploy to aws lambda
up

# see the URL of your CloudQuery
up url

# deploy production version(to cloudquery.t9t.io)
up deploy production

Thanks

  • up for deploying serverless API to AWS with ease
  • serverless-chrome for running chrome on AWS lambda
  • finder for making it easy to select elements on webpage

Overview

Name With Ownert9tio/cloudquery
Primary LanguageJavaScript
Program languageJavaScript (Language Count: 2)
Platform
License:GNU General Public License v3.0
Release Count0
Created At2019-01-19 06:29:29
Pushed At2023-01-07 04:08:19
Last Commit At2020-07-24 10:21:54
Stargazers Count2.2k
Watchers Count33
Fork Count136
Commits Count36
Has Issues Enabled
Issues Count16
Issue Open Count10
Pull Requests Count3
Pull Requests Open Count21
Pull Requests Close Count5
Has Wiki Enabled
Is Archived
Is Fork
Is Locked
Is Mirror
Is Private
To the top