Skip to content
View habib-analyst's full-sized avatar
:electron:
Exploring LLMs
:electron:
Exploring LLMs

Block or report habib-analyst

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
habib-analyst/README.md

Habib Ur Rehman

ML/AI engineer working on healthcare AI. I build models, then build the tools that check them — and I release both with the evidence attached: tests, evaluation scripts, and the failure cases included.

What I do

  • ML/AI Engineer at SANWA SYSTEM SERVICE CO. LTD (Jul 2025 – present): training, evaluating, and deploying ML models on custom datasets, including ML/AI work on ERP systems.
  • Before that, Undergraduate Research Assistant at the Center of Data Science, GCUF (Dec 2024 – Jun 2025), working on transformer-based medical imaging.
  • BS in Data Analytics, Government College University Faisalabad (2021 – 2025).
  • Core stack: Python, PyTorch, TensorFlow, Hugging Face, LangChain / LangGraph, FastAPI, Docker, SQL.

Most of my recent open-source work is about one question: how do you know whether a classifier deserves trust? The libraries below each take one part of that question. The models are small, trained from scratch, and published with scripts that re-derive their headline metrics from the released weights.

Open-source libraries & models

Libraries

Eight small, single-purpose Python packages. Each ships with tests and a worked example, and each README states plainly what the tool does not do.

Library What it does
ViewConsensus Runs a trained image classifier over a panel of transformed views of the same input, and returns the consensus probability, the view-spread as uncertainty, the per-view votes, and a verdict: confident, or unsure — defer to a human.
DatasetReceipt Scans an image dataset before training for cross-split leakage, metadata shortcuts, and background-only label signals, and returns one verdict: GO, CAUTION, or NO-GO.
ViewTrainer The train-time sibling of ViewConsensus. Trains a PyTorch classifier so its augmented views agree, then predicts with the same panel, uncertainty, votes, and defer verdict, behind one fit / evaluate / predict Trainer.
SliceSniff Mines a classifier's predictions for the slices where it is confidently wrong, and returns ranked, reproducible failure cards: the slice definition, accuracy against confidence, and the exact example indices.
ProbeShift Measures how little an image must change before a prediction flips — the smallest effective brightness, contrast, blur, noise, shift, or rotation — for any predict function, and summarises the result as a fragility score.
DriftReceipt Compares two windows of logged predictions from a deployed classifier and returns a GO / CAUTION / NO-GO drift receipt: what shifted, in which metadata slice, and the exact rows driving the change.
ChoiceShift Permutes the options of multiple-choice benchmark questions and measures how much an LLM's answers move: stability score, flip rate, and the accuracy range a single benchmark number hides.
ShotShift Permutes the demonstrations in a few-shot prompt and measures how much a classifier's predictions move, with per-query flip cards and leave-one-out example influence.

Models & live demos

Six models, each released on GitHub and Hugging Face with a live demo. Every headline number below is the number on the model card, re-derived from the released weights by the verification script in its repository.

Model Task Headline result Links
SonoCNN BreastMNIST — benign vs. malignant classification of 28×28 breast-ultrasound images Test accuracy 0.8718 · ROC AUC 0.8709 GitHub · Hugging Face · Live demo
PathoCNN PathMNIST — 9-class classification of colorectal histology patches Test accuracy 0.8712 · macro AUC 0.9855, on a test split collected at a different clinical center GitHub · Hugging Face · Live demo
Sukhan-Nano Urdu language model (5.57M parameters), trained from scratch on a documented, openly licensed corpus Held-out perplexity 48.48 GitHub · Hugging Face · Live demo
Nuqta-Nano Roman Urdu → Urdu script transliteration, one word at a time Held-out corpus CER 0.2020 · exact-match 0.3606 on unseen words GitHub · Hugging Face · Live demo
Awaaz-Nano Urdu speech recognition — character-level CTC trained from scratch on FLEURS ur_pk, no pretrained weights Held-out test CER 0.5131 · WER 0.9852 — honestly weak; an educational end-to-end ASR run, not usable transcription GitHub · Hugging Face · Live demo
VesselCNN VesselMNIST3D — vessel vs. aneurysm classification of 28×28×28 brain-vessel volumes with a tiny 3D CNN Test accuracy 0.7539 — below the 0.8874 majority baseline; aneurysm recall 0.4884. A measured failure with an interpretable cause, published as-is GitHub · Hugging Face · Live demo

The model cards also list the weak spots — PathoCNN's weakest class, Nuqta-Nano's systematic letter errors — rather than only the headline numbers.

Research & background

  • Healthcare-AI research at the Center of Data Science, GCUF: transformer-based medical imaging pipelines (Vision Transformers with Perceiver IO), experiments, documentation, and manuscript writing.
  • Other 2025 research: multimodal deepfake detection (Multimodal-FNet — Fourier token mixing for audio-video inconsistency) and a federated-learning security framework combining GANs, blockchain, and differential privacy.
  • I maintain a reproducibility benchmark for MedMNIST v2 — 12 2D and 6 3D datasets across multiple seeds — because reported numbers should be repeatable: MedMNIST_v2_Reproducibility_Benchmark.

Contact

Popular repositories Loading

  1. episembench episembench Public

    Deterministic replication of the EpiSEM-Bench mechanism (arXiv 2610.31650): matched safe/unsafe task pairs across six domains, an omission operator, and an audit tool checking if the agent asked fo…

    1

  2. habib-analyst habib-analyst Public

    Profile README for Habib Ur Rehman, ML/AI engineer and healthcare-AI researcher.

  3. ViT-PiO-Framework-For-Medical-Imaging ViT-PiO-Framework-For-Medical-Imaging Public

    Medical AI Models - Brain, Lung, Skin Disease Detection

    Python

  4. debugging-assignment-by-Habib-Ur-Rehman debugging-assignment-by-Habib-Ur-Rehman Public

    Solutions to the debugging assignment for admission.

    Jupyter Notebook

  5. GCViT-PIO-Medical-Imaging GCViT-PIO-Medical-Imaging Public

    Hybrid Global Context Vision Transformer (GCViT) + Perceiver IO framework for medical image classification — Accepted in The Journal of Supercomputing.

    Jupyter Notebook

  6. Habib_Ur_Rehman_Portfolio Habib_Ur_Rehman_Portfolio Public

    Personal portfolio for habib.top — six interactive designs, Alibaba OSS deploy