Rebuilding a dashboard people have stopped trusting
Most analytics teams have one: the dashboard people open mainly to argue with. Two tabs disagree about the same number. Someone keeps a second report open as a sanity check. Then something implausible shows up on a tile, it gets escalated, and the dashboard’s credibility is gone.
I’ve rebuilt dashboards like this. Here is the approach I use, without the specifics.
Trace one wrong number all the way down
Don’t start with a redesign. Take the single most embarrassing number and follow it to the rawest record you can get. More often than not the data isn’t wrong. The dashboard is faithfully showing one system’s version of an event while people read it as another’s. You only find that by reading raw records.
Pick one methodology and name it
When four metrics are each computed three ways, visual polish won’t help. Choose a single source of truth and write down the rules: what is included, what is excluded, and what is estimated. Then give it a name people can use in conversation.
Use fewer sources and document their scope
In a rebuild I aim for every visual to read from one or two views, each with a stated scope. Where a tab intentionally differs from the report people compare it against, a note at the top says so and explains why.
Validate three ways
Check the source logs against the warehouse table against the BI dataset, over several time windows. If all three agree, you’re done. If they don’t, the gap gets a written explanation.
Build it as code
Deploy through the BI tool’s API instead of clicking through the interface. A script that duplicates sheets, remaps datasets, and regenerates IDs makes the work repeatable and reviewable.
Keep the old version
Leave the original tabs in place next to the new ones, with snapshots for rollback. People accept a new number faster when they can compare it with the old one themselves.
Write down what is still wrong
A short list of known gaps, with reasons, does more for credibility than any chart. It tells people you checked.
The stakeholders in a rebuild rarely want the same thing. An engineer wants every record included. An account lead wants it to match the report they already use. Finance trusts nothing until cash reconciles. The version that wins is the one where each of them can see how their number relates to the others.
