technifyed

Programming + Data

Write a web scraper for public data and analyse it

Collect a table of public information from a site that allows it and analyse the result.

  • DifficultyIntermediate
  • Estimated time1–2 weeks
  • Budget₹0
  • ClassClass 11 to college
  • TeamSolo
  • You needComputer only

Prerequisites: None beyond your class work

Original · by TechnifyedData AnalysisSoftware ProjectFree to doComputer onlyResearch orientedTwo subjects

My projects

Overview

Collect a table of public information from a site that allows it and analyse the result.

Skills you will use

HTML parsingHTTP requestsRespecting site rules

Safety

  • This project handles personal data. Collect the minimum, store it safely, get permission, and delete it when the project ends.

Materials and tools

  • Computer with Python 3
  • A site whose terms and robots.txt allow automated access

Tools and software

Python

Expected cost₹0Nothing to buy
Estimated duration1–2 weeks5 build steps, plus the report

Step-by-step roadmap

  1. Start

    You will finish with: a dataset, the script that produced it and three findings.

  2. 1

    Prerequisites

    Nothing special to know first. Then collect the 2 items in the materials list.

  3. 2

    Learn

    Read up on python: ethics, HTML parsing, public-data. Your textbook chapter and one short video are enough.

  4. 3

    Plan

    List the features for version one, sketch the screens or data flow and pick the tools. Keep the first version small.

  5. 4

    Build

    1. Check the site's robots.txt and terms, and prefer an official API or data download if one exists.
    2. Fetch one page and extract the fields you need.
    3. Loop over pages slowly, with a delay between requests.
    4. Save the data as a CSV file.
    5. Analyse and chart it.
  6. 5

    Test

    Try it with wrong, empty and unusual input, and ask someone else to use it without your help.

  7. 6

    Document

    Write a README: what it does, how to run it, screenshots and what you learned. Report structure

  8. 7

    Present

    Show a live demo of one complete task, then the design and the hardest problem you solved. Presentation structure

  9. 8

    Publish

    Put the code on GitHub with the README and, if you can, deploy a live demo.

Expected outcome

A dataset, the script that produced it and three findings.

Other versions of this project

Advanced version

Schedule it to run daily and track changes over time.

Ways to do this project

Text marked "You write this" is a prompt for your own work; everything else is specific to this project.

Research question
You write thisOne question you can answer with data, narrow enough to finish in the time you have.
Hypothesis
You write thisWhat you expect to find, and why.
Variables
You write thisWhat you change or compare, what you measure, and what you hold constant.
Methodology
You write thisDescribe the method in enough detail that someone else could repeat it: sample, tools, procedure.
Data collection
You write thisSay what you will record, how many times, and how you will keep the records safe.
Analysis
You write thisChoose the table, chart or test that answers the question; report averages with their spread.
Limitations
You write thisList what could have affected the result: small sample, instrument limits, things you could not control.

Literature review

Find five to eight sources (your textbook, review articles, reports) and note what each says about your question. Group them by idea, not one after another, and end with what is still not known.

References

List every source you used in one style throughout (author, year, title, where it was published, link and the date you opened it).

Report and presentation

Report structure

  1. Title and summary
  2. Problem and target user
  3. Features
  4. Tools and technology
  5. Design: architecture, data model or screens
  6. Implementation
  7. Testing
  8. Results and screenshots
  9. Challenges
  10. Future improvements
  11. References

Presentation structure

  1. The problem
  2. Who it is for
  3. Live demo
  4. How it is built (one diagram)
  5. The hardest part
  6. Testing and results
  7. What you learned
  8. What comes next

Viva questions

Prepare your own answers to these before you present.

  • What is the aim of your project, in one sentence?
  • What is the principle behind it?
  • Why did you choose these materials or tools?
  • What result did you get, and was it what you expected?
  • What went wrong and how did you fix it?
  • How could this be improved or used in real life?

Resources

Source and attribution

Original

Written by Technifyed. Free to use for your own school or college project; write the report in your own words. Added 1 Oct 2026.

Similar projects

More Programming projects

Programming + Cybersecurity

Make a file encryption tool

Encrypt and decrypt files with a password using a well-tested library.

  • Intermediate
  • 2–7 days
  • Free
Software Project · Computer onlyView

Programming · Python

Build a Markdown-to-HTML converter

Write a tool that converts headings, lists, links, bold and code blocks from Markdown to HTML.

  • Intermediate
  • 2–7 days
  • Free
Software Project · Computer onlyView

Programming · Python

Build a Snake game

Program the classic Snake with scoring, growing length and game over.

  • Easy
  • 2–7 days
  • Free
Game · Computer onlyView

Same tools

Literature and English + Data

Analyse word use in a novel with a computer

Count words and character mentions in a public-domain novel and see what the numbers reveal.

  • Intermediate
  • 1–2 weeks
  • Free
Data Analysis · Computer onlyView

Two-subject alternatives

Music, Theatre and Writing + Programming

Create generative art with code

Write programs that draw a different artwork every time they run and curate a series of ten.

  • Intermediate
  • 1–2 weeks
  • Free
Art Project · Computer onlyView

EdTech and Study Tools + Software Development

Build a flashcard app with spaced repetition

Make a web app that shows each card again just before you would forget it.

  • Intermediate
  • 1–2 weeks
  • Free
Software Project · Computer onlyView

Graphic and UI/UX Design + Software Development

Redesign an app you use every day

Find real problems in an app through user tests, redesign one flow and prove your version is better.

  • Intermediate
  • 1–2 weeks
  • Free
Portfolio Project · Computer onlyView

Same difficulty and budget

Software Development · Mobile Apps

Build a habit tracker with streaks

Create an Android app to tick off daily habits and see streaks and a calendar heat map.

  • Intermediate
  • 1–2 weeks
  • Free
Mobile App · Computer onlyView

Data + Operations, HR and Supply Chain

Build a sales dashboard

Turn a public retail dataset into a one-page dashboard that answers a manager's questions.

  • Intermediate
  • 1–2 weeks
  • Free
Visualization · Computer onlyView

Artificial Intelligence + Marketing

Cluster customers into groups

Group customers by spending behaviour with k-means and describe each group in plain words.

  • Intermediate
  • 1–2 weeks
  • Free
AI/ML Project · Computer onlyView

Enter your email and the official page opens. Phone is optional.