The Salary Data Scraper is a Python-based web scraping tool that collects salary data from SalaryExplorer, a popular salary comparison website. It processes the scraped data into a structured format, allowing you to analyze and work with salary information for various countries.
-
Data Scraping: Extracts salary data, including average, lowest, and highest salaries, for each country listed on SalaryExplorer.
-
Currency Conversion: Converts salaries to USD using real-time exchange rates, ensuring accurate and consistent data.
-
Median Salary: Extracts and converts the median salary for each country, providing a more comprehensive view of salary statistics.
-
CSV Export: Saves the processed salary data to a CSV file for easy analysis and integration with other tools.
-
User-Friendly Output: Provides user-friendly feedback during scraping and processing operations.
-
Exception Handling: Robust exception handling ensures graceful error handling and recovery.
-
Clone this repository to your local machine:
git clone https://github.com/yourusername/salary-data-scraper.git
-
Navigate to the project directory:
cd salary-data-scraper
-
Install project dependencies:
pip install -r requirements.txt
-
Run the script:
python main.py
- Contributions and improvements to the project are welcome! Feel free to fork the repository, make enhancements, or fix issues. Submit pull requests to collaborate on the project's development.