Building a Data Analysis System for the High School Final Exams in Egypt

Local Chapter Giza, Egypt Chapter

Status: Completed

Project Duration: 29 Oct 2022 - 10 Dec 2022

Open Source resources available from this project

Github Repository Project Management Folder

Project background.

Last year of High school in Egypt educational (Thanaweya Amma) system is a detrimental for students aiming for the best of the best universities to attend. Since the score in this single year is the entry card to those universities.

The problem.

There are plenty of questions about the results of last year of high school that tingles our brains as a data scientists like:
– What schools have highest average?
– What city most care about math?
– Search for outliers in the scores.

Project goals.

Every year about 600,000 students go into their high school. The results of the exams are publicly available on multiple websites. Find ways to collect the data, then we can: - Learn about data ethics - Answer questions through visualization  - Help new students choose their high school

Project plan.

  • Week 1

    work with API:
    Learn how to send multiple http requests
    With web scraping at that scale we need to figure how to send plenty of requests to the server without triggering DoS preventions systems

  • Week 2

    Web scrape the results:
    Learn about web scraping libraries
    Web scraping is the process of using scripts to extract content and data from a website.
    We get to interact with libraries like beautifulsoup and selenium

  • Week 3

    Visualize to answer our questions : Visualization is a powerful tool Using charts or graph to convey meaning is simple yet so informative and to deliver you insights correctly data scientists need to master Visualization techniques

  • Week 4

    Deliver the insights and finalize our research: we can use something like a web app so can deliver insights easily, and help students who lives in different cities what are the best schools to attend in terms of school average

Learning outcomes.

Working with APIs, Web scraping, EDA, data visualization

Share project on: