react-node-web-scraper
react-node-web-scraper copied to clipboard
Final Year project, scraping data of e-commerce stores and display in ReactJS app.
React Node Web Scraper
This project is a web scraper that consists of a client and a server. The client was bootstrapped with Create React App, and the server uses Express.js, Axios, Cheerio, and Puppeteer for web scraping.
Project Structure
The project has two main folders:
-
client
: This is where the front-end code resides. -
server
: This contains the back-end code for the web scraper.
Server
The server is an Express.js application that uses Axios for making HTTP requests, Cheerio for parsing HTML, and Puppeteer for browser automation.
Install Dependencies
npm install
Available Scripts
In the server directory, you can run:
npm start
Runs the server in development mode with nodemon.
Client
This is a React App bootstrapped with vite.
Getting Started
For Running the client app:
Steps to follows:
install Dependencies:
npm install
# or
yarn
Available Scripts:
npm run dev
# or
yarn dev
Runs the app in development mode. Open http://localhost:5173 to view it in the browser.
npm run build
# or
yarn build
Builds the app for production to the dist
folder.
npm run preview
# or
yarn preview
Preview the production build locally.