webcrawler

[JadeCara]

This pull request introduces a new Rust project called webcrawl-rayon that utilizes the rayon and wikipedia crates for concurrent web crawling and processing of Wikipedia pages. The most important changes include the addition of a Cargo.toml file to define the project and its dependencies, a Makefile for building and managing the project, and the main Rust source file that implements the web crawling functionality.

Project setup:

• Added Cargo.toml file to define the project metadata and dependencies, including wikipedia and rayon crates.

Build and management:

• Added Makefile with various targets for building, running, testing, linting, formatting, and releasing the project using Cargo.

Web crawling functionality:

• Implemented the main Rust source file src/main.rs to fetch and process Wikipedia pages concurrently using the rayon crate, including timing metrics and descriptive statistics.