Group 44 Information Retrieval Assignment 1

This submission implements an end-to-end Information Retrieval system in Streamlit for Assignment 1.

Files

• app.py - Streamlit application
• data/group44_city_resilience_docs.jsonl - bundled document collection
• report_Group44.pdf - submission-ready report with experimental results and inferences
• report_Group44.md - editable report source
• screenshots/ - application evidence
• requirements.txt - Python dependencies

Setup

python -m pip install -r requirements.txt

Run

streamlit run app.py

The app opens in the browser. Use the sidebar to upload a custom text/CSV/JSONL collection or keep the bundled Group 44 dataset.

Accepted Dataset Formats

• Multiple .txt files: each file becomes one document.
• .csv: recommended columns are doc_id, title, and text.
• .jsonl: one JSON object per line with doc_id, title, and text.

TXT, CSV, and JSONL uploads were tested through both the parser and the Streamlit browser interface.

Evaluation Coverage

The Streamlit front end includes:

• Dataset upload and document viewing
• Tokenization, inverted index creation, lowercasing, stop word removal, hyphen handling, stemming, and lemmatization
• Stemming vs lemmatization retrieval-quality comparison
• Phrase query comparison using biword and positional indexes
• Dictionary search using Binary Search Tree and B-Tree with timing experiments
• Tolerant retrieval using wildcard search, edit-distance correction, and k-gram similarity
• Inference and discussion for every required task

Streamlit Community Cloud

https://irassignment-group-44.streamlit.app/

Final Submission Note

https://irassignment-group-44.streamlit.app/

The assignment awards a separate mark for execution on the BITS Virtual Lab portal. Capture screenshots or a short recording from that environment and include them with the final submission.