Senior Research Scientist · Microsoft Teams AI Lab

Dr Zafiirah Hosenie From reading the stars to measuring how AI sees.

I evaluate vision-language models (VLMs) that understand meetings and the people in them: what they see, what they miss, and why. Before that I built 3D Gaussian splats and avatar technology at Microsoft, and machine-learning pipelines that still run on the MeerKAT and MeerLICHT telescopes. Outside work, I'm learning quantitative trading and exploring agentic evaluation.

1stIoP Computational Physics Thesis Prize 2022
🏆Grand Prize · Microsoft Global Hackathon 2021
11peer-reviewed & arXiv publications
2telescopes running my ML pipelines
Portrait of Zafiirah Hosenie
🤖Artificial Intelligence
📈Quantitative finance
🌴Mauritius → London
"It's not important what people think when you come in, it's much more important what people think when you leave."
Jürgen Klopp · A line I live by: in every team, project and mentorship, I aim to leave things better than I found them.
🌍 Mauritius → South Africa → United Kingdom

My journey

I grew up in Mauritius, a small island in the Indian Ocean, where I fell for physics long before I knew what machine learning was. After a BSc in Physics at the University of Mauritius, I won SKA and North-West University bursaries for an MSc in Astrophysics & Space Science in South Africa, where I was the first to use a GAN to augment radio-astronomy images.

A Newton Fund DARA Big Data scholarship (one of only three) took me to Jodrell Bank, University of Manchester, for my PhD. The pipelines I built there run on the MeerKAT and MeerLICHT telescopes, and my thesis won the Institute of Physics Computational Physics Thesis Prize.

Then I moved from stars to people: climate risk at a FinTech, then Microsoft Research Cambridge (face tracking, synthetic data, Gaussian splats and avatars for Microsoft Mesh), and now VLM evaluation in the Teams AI Lab.

Curious by default

Stars, faces, 3D, markets: I follow interesting data wherever it leads.

Evidence over vibes

If it isn't measured, sliced and stress-tested, it isn't finished.

Lift as I climb

Mentor to women in data science; WomenTech Network Global Ambassador.

Island roots

Proudly Mauritian, shaped by three continents and many teams.

Experience & Education

Vision & multimodal

VLM evaluationMultimodal LLMsFace detection & trackingIdentity metricsCNNs & ViTsMask R-CNN

3D & generative

3D Gaussian splattingVector quantisationCOLMAP · GLOMAPAvatarsSynthetic dataGANs & diffusion

Evaluation & metrics

Failure slicingFP / FN analysisLLM-as-a-judgeQuality scoringOutlier detectionEval dashboards

ML & statistics

PyTorchTensorFlow / Kerasscikit-learnGaussian processesBayesian evidence & MCMCImbalanced learning

Quant (learning)

GARCHTSMOM · MACD · SMAVolatility targetingPortfolio optimisationWalk-forward CV · OptunaESG & climate risk

Data & tools

PythonAzure MLPandas · NumPyGoogle Earth EnginePrompt engineeringGit
🔭 Astronomy · Vision · 3D

Research & publications

Now · Teams AI Lab

Enrollment quality

Quality scores, outlier metrics and dashboards for meeting-room devices, replacing manual enrollment.

Now · Teams AI Lab

Identity & tracking metrics

False positives and negatives under occlusion, head pose, resolution and frame rate.

ICCV 2025

VoluMe: live 3D video calls

Real-time Gaussian splats of people from a single webcam.

SIGGRAPH Asia 2024

Avatars from synthetic data

Fairness-aware hairstyles and markerless capture, feeding auto-generated avatars.

My work on 3D Gaussian Splatting at Microsoft: what splats are, how to compress them, and what I measured. Click a card to read.

MSc, PhD and FinTech work. Each card opens a short summary with the key results.

Learning in public: Diffusion models · Vision Transformers · NLP · FRGAN

👁️ VLMs · Agents · Prompts

AI that's measured, not assumed

My day job

A vision-language model can describe a meeting fluently and still miss who is speaking, invent an object, or fall apart when the camera is far away. My job is to measure what it gets right, where it fails, and why.

1

Define "good"

A clear task and rubric for each meeting scenario.

2

Test on real scenarios

Representative video: rooms, lighting, camera distance, number of people.

3

Score what matters

Perception, grounding, reasoning over time, and hallucinations.

4

Slice the results

Break down by occlusion, head pose, resolution and frame rate to find real failure modes.

5

Calibrate and track

Check automatic judges against people, then track everything on dashboards.

Sample slice report

Same model, same questions, different conditions. An overall score of 0.82 hides a much weaker tail.

Finding: heavy occlusion and low resolution drive most errors. Fix the data and capture conditions before changing the model.

Illustrative example of how I present results, not real data.

Interest  Agents plan, call tools and loop, so they need more than output grading. Here is the framework I use to think about it, built from public Hugging Face and LangChain material. Click a card to read.

1 · Final answerIs the result right?
2 · Each stepRight tool, right arguments?
3 · TrajectoryA sensible path?
4 · Observe liveTraces & online evals
5 · HarnessDatasets, pass^k, gates

Role & context

Give the model a clear persona, audience and constraints. Ambiguity in, ambiguity out.

Few-shot examples

Curated, diverse examples, including edge cases, that show the behaviour I want.

Decompose & reason

Break tasks into steps; ask for reasoning where it measurably helps, and verify it.

Structured outputs

JSON schemas and typed fields so outputs are parseable, testable and easy to compare.

Visual prompts

For VLMs: say which frames, regions or people matter, and ask for evidence from the image.

Rubrics & judges

Judge prompts with explicit rubrics, checked against people before they're trusted.

Prompts are code: version them, test them, and never ship one without a regression suite.
My notes & resources: github.com/Zafiirah13/Prompt-Engineering
📊
2019

Classic NLP

NLTK & spaCy pipelines.

word counts · n-grams · polarity
🔗
2020

Applied NLP

Matching power-plant names for climate risk.

fuzzy matching · scoring
🧠
2022

Transformers

Mentoring NLP teams at Africa Women in Data Science.

attention · ViTs · diffusion
✍️
2023

LLMs & prompting

Building a prompt-engineering playbook.

few-shot · reasoning · JSON
👁️
Now

VLMs & agents

VLM evaluation at work; agentic evals as an interest.

grounding · judges · reliability

What I measure, then and now

↗

Word frequency → Task success

Did the model actually do what the user needed?

↗

Polarity score → Rubric-based judges

Automatic judges, checked against human ratings.

↗

N-gram prediction → Visual grounding

Does the answer match what is on screen?

↗

Subjectivity → Hallucination rate

How often does it describe things that aren't there?

📈 A passion I'm learning

The Quant Lab

This is my learning journal. I'm working through Deep Learning in Quantitative Trading by Zihao Zhang and Stefan Zohren (Cambridge University Press, 2025). Each card is one topic: my objective, what I ran, and my results, in my own words. The book's text and code are not reproduced. Not investment advice.

Annualised Sharpe ratio: my runs

Out of sample where applicable. Higher is better.

What the numbers taught me

1

Risk-adjusted beats raw

Volatility targeting cut returns from 23% to 13% but lifted Sharpe from 0.58 to 0.85.

2

Baselines are brutal

Equal-weight long-only (0.79) beat long-short momentum (0.07).

3

Check behaviour, not only PnL

My deep momentum net learned a small, steady long bias: drift, not timing.

4

Respect time and regimes

Walk-forward validation, lagged signals, and the COVID-19 crash exposed an overfit model.

Volatility-targeting simulator

Simulates a GARCH(1,1) market and compares buy and hold with a strategy that scales exposure to hit a target volatility, using only past data.

Buy & holdVol-targetedGARCH σ (scaled)
✍️ Short, simple notes

The blog

🏆 Awards · Mentorship · Community

Impact & community

Open to conversations

Let's make something people remember after they leave.

Happy to chat about VLM evaluation, Gaussian splats, quant, speaking, or mentoring, especially if you're early in your data-science journey.

📍 Based in the UK · originally from Mauritius 🌴

ZH
Zafiirah's agentSearches this site, the blog and the web

Answers use site search, Wikipedia, DuckDuckGo and the free Pollinations.ai model. Please don't share personal information.