Technology and fragmentation

Part 4 of 5

Technology and fragmentation

The analytics stack is the set of technologies that move data from source systems into something your team can query, model, and act on. Getting the stack right matters — but it's easy to over-invest in tools before you're clear on the questions you need to answer.

Core layers

Storage — Where data lives: data warehouses (Snowflake, BigQuery, Redshift, etc.) or data lakes. Choice depends on volume, structure, and how you'll query.

Transformation — Turning raw data into clean, modelled datasets. SQL-based tools (dbt, etc.) or low-code platforms. This is where a lot of "data quality" work happens.

Orchestration — Scheduling and dependency management so pipelines run in the right order and failures are visible.

Consumption — How users and systems access the data: BI tools, APIs, reverse ETL, or agentic platforms that query the warehouse directly.

Fit for purpose

The right stack depends on your team size, data volume, and how much you rely on self-serve vs centralised delivery. Start with the decisions you need to support, then choose tools that get you there without unnecessary complexity.

Handling fragmentation

Analytics tooling tends to fragment: different teams adopt different BI tools, pockets of the business spin up their own pipelines, and new platforms get added without retiring old ones. The result is duplicated effort, inconsistent definitions, and data that's hard to trust across the organisation.

What helps:

  • Standards before tools — Agree on a small set of canonical sources, metrics, and ways of working before layering on more technology. A single well-governed warehouse beats multiple siloed marts.
  • Consolidate when the pain is real — Don't consolidate for its own sake. When fragmentation is blocking decisions (e.g. "we can't compare regions because they use different tools") or creating unacceptable risk (e.g. no single view of customer), that's when to invest in convergence.
  • Ownership and governance — Someone needs to own the stack and the standards: what goes in the warehouse, how it's transformed, who can publish reports, and when a new tool is allowed. In larger teams, that's often the analytics product or platform owner (see Team roles).

The goal is enough consistency that the organisation can trust and reuse analytics, without locking everything down so tightly that teams can't move fast.