Enterprise RAG Chatbot for a Big 4 Accounting Firm
The problem
Junior auditors at a Big 4 firm were reading thousands of pages of compliance whitepapers and audit guidelines to answer a single question. Every senior became a search engine, and the same question got asked and re-answered across teams that never saw each other’s work.
What we built
A multimodal retrieval system over the full compliance library, running entirely on the firm’s own infrastructure. OCR and table parsing mean the semi-structured exhibits — the rate tables, the disclosure matrices, the scanned annexes — are searchable rather than silently skipped. Retrieval is tuned for citation rather than summary, so the system returns the passage that supports the answer alongside the answer itself.
Why it holds up
In audit work, an answer you cannot cite is not an answer — it is a liability. That single constraint shaped the whole build: the ranking, the chunking strategy, the refusal behaviour when the library genuinely does not cover the question. A confident guess is worse than no answer at all when the output ends up in a working paper.