Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write a Scraper, that will scrape Products (Books) from Kz book shop website (Scraper-And-AI-Service) #8

Open
dotpep opened this issue Oct 28, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@dotpep
Copy link
Member

dotpep commented Oct 28, 2024

Use Golang Colly library as for Scraper.

Scrap other service (Book seller Shops):

  • Make http request (curl) and get html data, work with html divs/tags to scrape products
  • Scrape Amazon Shop, Flip.kz, Kaspi Shop, Meloman (marwin) kz websites (choose one of them first) Book section or Anything you liked
  • Define what scraped data you need save, in your database table/entity.

Next Task is (Save it in database Product table, using Golang Colly library.) and (Basic CRUD operation, REST API endpoints)

@dotpep dotpep added enhancement New feature or request good first issue Good for newcomers labels Oct 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

3 participants