Skip to content
This repository has been archived by the owner on Oct 16, 2023. It is now read-only.
/ fmhy-scraper Public archive

Cron job to periodically scrape links from fmhy-github page and return in json format.

Notifications You must be signed in to change notification settings

zeus-12/fmhy-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

fmhy-scraper

moved to Fmhy Repo

A cron-job which scrapes the github page of FMHY, and update the db periodically.

  • to setup, run yarn watch on one terminal and yarn start on another.
  • Built using Prisma, Typescript, Node, PlanetScale
  • Set QUERY_BATCH_SIZE=15000 as env => else prisma will close connections reference

About

Cron job to periodically scrape links from fmhy-github page and return in json format.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published