← All case studies

246 hours · sustained engagement

Multimodal RAG Application

Retrieval over source material that is part text, part table and part image — where naive chunking quietly returns answers that are confident and wrong.

The problem

A retrieval application over multimodal data, where the source material is part text, part table and part image rather than the clean prose most RAG tutorials assume.

What we built

Each format parsed on its own terms before anything reaches the vector store, rather than flattening everything to text and hoping the embedding model sorts it out. 246 hours of sustained engineering across the ingestion, retrieval and evaluation layers.

Before: Tables split mid-row; Numbers hidden in images; Confident, wrong answers. After: 246 hours · sustained engagement.

Before

  • Tables split mid-row
  • Numbers hidden in images
  • Confident, wrong answers

After

246 hours · sustained engagement

Stack

RAGMultimodalMachine LearningPython

Why it holds up

That mix of formats is where naive retrieval quietly fails: the chunker splits a table down the middle, the image carries the number nobody indexed, and the answer comes back confident and wrong. Nothing errors, nothing alerts — you simply get wrong answers delivered with total fluency, which is the worst failure mode a retrieval system has.

Related service: Enterprise RAG in Hong Kong

Get started

Talk to the engineer who will build it.

You will speak with me directly. Bring the use case, the data and the constraints, and I will give you a straight view on feasibility, effort and the first thing to ship.

Cat YungBook a call

Hong Kong & London time zones