WHITE PAPER 3 · DATA GOVERNANCE
Data mesh and data fabric are two answers to the same problem: central data teams and central platforms struggle to keep up with the number of sources, consumers and changes in a modern organization. Data mesh moves ownership to business domains and treats data as a product; data fabric builds an integration and metadata layer across distributed sources.
Bassirah Technology — Innovation & R&D · 26 October 2026 · Free to share with attribution
Data mesh and data fabric are two answers to the same problem: central data teams and central platforms struggle to keep up with the number of sources, consumers and changes in a modern organization. Data mesh moves ownership to business domains and treats data as a product; data fabric builds an integration and metadata layer across distributed sources. Both depend on two governance artifacts: the data product, a managed unit of data with an owner and a purpose, and the data contract, an explicit and testable agreement between the producer of data and its consumers. This paper examines both. It sets out what research says about data mesh, data fabric and data products, including the evidence from implementations; describes the open specifications for describing data products, including W3C DCAT, OMG DPROD, Bitol’s Open Data Product Standard and the Data Product Descriptor Specification; and describes data contracts, with the Open Data Contract Standard as the open format that the practitioner community has converged on. It then covers schema evolution rules, how contracts are enforced in build tools, streaming registries, quality engines and catalogs, impact analysis before change, and how contracts implement federated computational governance. It compares the maturity of each part, sets out open challenges and closes with notes for platform decisions.
Much of what goes wrong with data goes wrong at boundaries. An empirical study of data pipeline quality, combining a literature review, expert interviews and analysis of developer issues, found that incorrect data types are among the main root causes of data-related problems and that compatibility between pipeline stages is a problem area of its own [1]. Even in databases described as schema-free, an implicit schema lives in application code and keeps evolving over a project’s history [2]. When one team changes a table or an event and another team’s report, model or application depends on it, the change is a governance event, whether anyone treats it as one or not.
Data mesh was proposed partly in response. Its originator criticized central data lakes and warehouses owned by specialist teams as a bottleneck between the domains that produce data and the people who use it, and proposed domain ownership, data as a product and self-serve infrastructure [3], to which a fourth principle, federated computational governance, was added [4]. Data products and data contracts are the artifacts through which those principles are governed: the product makes ownership and purpose explicit, and the contract makes the producer’s commitment explicit and testable.
This is the third of six papers. Paper 1 covered the data that AI systems consume and produce. Paper 2 covered continuous, risk-adaptive governance and policy as code. This paper covers the units that those controls attach to. Paper 4 covers data sovereignty and cross-border compliance, Paper 5 privacy-enhancing computation and Paper 6 data sharing ecosystems, where products and contracts cross organizational boundaries.
This paper covers the concepts of data mesh, data fabric and data products and the research on them; open specifications for describing data products and data contracts; schema evolution and compatibility rules; enforcement of contracts in tools; impact analysis; and the governance model that connects them. It concentrates on peer-reviewed research, open specifications and official documentation, cites foundational practitioner writing where it introduced an idea still in use, and labels practitioner books, articles and project announcements as such. Statements about specifications and products reflect documentation accessed in October 2026; several of these specifications are revised often. The paper does not quote adoption, performance or survey figures from its sources.
A domain is a business area that produces or owns data, such as sales or logistics. A data product is a managed artifact that satisfies recurring information needs and creates value by transforming and packaging relevant data into consumable form [5]. An output port is the interface through which a data product’s consumers read it, such as a table, view, topic or API. A data contract is a machine-readable agreement for an output port that states its schema, quality expectations, service levels and terms, and that can be checked against the actual data. A breaking change is a change that can make existing consumers fail or produce wrong results. Data mesh is a sociotechnical, decentralized approach to enterprise data management; data fabric is a design concept for reusable integration services, pipelines and semantics built on metadata [6].
Data mesh rests on four principles: domain-oriented decentralized data ownership and architecture; data as a product; self-serve data infrastructure as a platform; and federated computational governance [4]. The data product is described as the architectural quantum of the mesh, bundling the code, data, metadata and infrastructure needed to serve it [4]. Governance is a federation of domain and platform product owners that sets global rules for interoperability, with the platform executing those decisions automatically [4]. The principles were set out at book length in 2022 [7]. These primary sources are practitioner writing, not research, and the peer-reviewed literature that followed treats data mesh as a paradigm shift away from monolithic architectures [8]. A systematic review of the industry literature maps practitioner descriptions of the four principles to service-oriented reference architectures and lists open research questions [9].
Data fabric is a different kind of concept. A peer-reviewed comparison describes it as a design concept for reusable integration services, data pipelines and semantics, built on metadata modeled as a knowledge graph, and notes that the term was propagated mainly by an analyst firm rather than by research [6]. An early academic comparison of data fabric, the logical data warehouse and data mesh made the same observation [10]. Peer-reviewed work on data fabric is still mostly architecture for specific domains; a recent example for manufacturing combines uniform messaging, semantic integration, automated metadata generation and connector templates around a central knowledge graph [11].
The term data product is older than data mesh but was long used loosely. Research in information systems defines it, from literature and case studies, as a managed artifact that satisfies recurring information needs and creates value through packaging data into consumable form, and identifies its characteristics and categories [5]. The Data Product Canvas extends this into a design tool that assesses products for customer desirability, technical feasibility and economic viability and supports a managed portfolio of products [12]. Internal enterprise data marketplaces, which let employees find and access company data, have been studied as a consumption layer distinct from a data catalog [13]. The FAIR principles, written for scientific data, offer a useful yardstick by analogy: products should be findable, accessible, interoperable and reusable, with metadata that machines as well as people can act on [14].
Mesh and fabric are often presented as alternatives. The research suggests a different framing. A review that delimits data platforms, data spaces, data meshes and data fabrics characterizes platforms and fabrics as centralized and control-oriented and meshes and data spaces as decentralized and flexibility-oriented [15]. The comparison in Table 1 follows a peer-reviewed analysis that treats data products as the unit of consumption and value, data fabric as the provision and integration layer, and data mesh as the sociotechnical model that bridges them; the three overlap on catalogs, active metadata and the lifecycle of data products, and are best combined [6].
| Aspect | Data product | Data mesh | Data fabric |
|---|---|---|---|
| What it is | A managed unit of data with owner and purpose | A sociotechnical operating model | A design concept for integration and metadata |
| Main emphasis | Consumption and value | Ownership and federated governance | Provision and integration |
| Ownership | Product owner | Business domains | Usually central |
| Governance style | Lifecycle and quality of each product | Federated rules executed by the platform | Central policies over a metadata layer |
| Key artifacts | Descriptor, output ports, contract | Domains, products, self-serve platform | Knowledge graph, catalog, integration services |
The practical question is therefore not mesh or fabric, but which decisions are federated to domains, which are kept central, and how the products and contracts at the boundary are described and enforced.
Empirical studies of data mesh are few but consistent. An interview study of practitioners found that the hardest challenges were the transition to federated governance, shifting responsibility for data products to domains, and understanding the concept itself; it recommended a cross-domain steering unit, monitoring of how products are used, early quick wins and small dedicated product teams [16]. A case study at a bank, written by practitioners, framed governance around the data catalog, data quality and data ownership and argued that it needs change management and aligned incentives as well as technology [17]. A public-sector case study in Norway described moving from central data management to a distributed approach because central management conflicted with agile development, and reported both benefits and challenges [18].
On the platform side, practitioners building a mesh platform found inconsistent terminology and little guidance for implementing governance, and proposed driving governance through automation and self-service infrastructure [19]. A catalog of architectural design decisions for self-serve data platforms, validated with experts, positions the platform as what makes products and computational governance practical [20]. Two cautions apply. Several of these studies are written by consultancies that implement data mesh, and none measures outcomes against a control. The evidence supports the claim that governance and ownership are the hard part; it does not yet show by how much data mesh improves results.
A data product needs a description that both people and machines can read: owner, domain, purpose, output ports, lifecycle status and the contracts that apply. Several open specifications now provide one, as Table 2 shows.
W3C’s Data Catalog Vocabulary, version 3, is the established standard for describing catalogs, data sets, distributions and data services, and adds versioning properties and data set series [21]. It does not define a data product. The Data Products Ontology, DPROD, now an Object Management Group specification at version 1.0 beta 2, is a profile of DCAT that does: a data product has an owner, a lifecycle status, a purpose, a domain, and input and output ports that are data services, so that product metadata can be aggregated across marketplaces [22]. Bitol’s Open Data Product Standard, version 1.1.0, maintained under the LF AI & Data Foundation, defines products with input and output ports, management information, support and team, and each output port can reference the data contract that governs it [23]. A separate Open Data Product Specification, version 4.1, from the Open Data Product Initiative, uses the same abbreviation but is oriented to products as commercial offerings, with pricing plans, licensing, access methods and contracts [24]. The Open Data Mesh Initiative’s Data Product Descriptor Specification, version 1.0.0, describes a product through its input, output, discovery, observability and control ports and internal components, with promises, expectations and obligations on output ports [25].
| Specification | Maintainer | Version as of October 2026 | Focus |
|---|---|---|---|
| DCAT | W3C | 3 (Recommendation, 2024) | Catalogs, data sets and data services |
| DPROD | Object Management Group | 1.0 beta 2 | Data products as a DCAT profile |
| Open Data Product Standard | Bitol, LF AI & Data Foundation | 1.1.0 | Products, ports and links to contracts |
| Open Data Product Specification | Open Data Product Initiative | 4.1 | Products as offerings, with pricing and licensing |
| Data Product Descriptor Specification | Open Data Mesh Initiative | 1.0.0 | Products through ports and components |
The fields these specifications share, owner, domain, ports, lifecycle and a link to a contract or service level, are a good indication of what a product description needs. The landscape is fragmented, and there is no single dominant standard for products as there now is for contracts (Section 6).
Platforms implement products in different ways. Starburst Enterprise documents a data product as a schema of views or materialized views, with a required domain and owner, a draft, published and pending-changes lifecycle, and definitions that can be managed as code through YAML and a command-line tool [26]. DataHub documents an open-source data product entity that groups related assets under one domain, defined in YAML and synchronized with version control [27]. Atlan documents products organized by domain, with output ports, lifecycle states from draft to archived, and contracts linked to output ports [28].
Data contracts emerged from practice. Two practitioner books treat them at length [29], [30], and the main peer-reviewed treatment found for this paper is a systematic review of the practitioner literature on data contracts in data mesh [31]. The concept therefore rests on practitioner experience and on older research on adjacent problems: automated data validation in production machine learning pipelines [32], declarative “unit tests for data” [33], the causes of data pipeline failures [1] and the extensive literature on API evolution and its effect on consumers, which is a useful analog but does not cover data contracts [34].
The Open Data Contract Standard, ODCS, is an open YAML standard for data contracts maintained by the Bitol project under the Linux Foundation’s LF AI & Data Foundation [35]. It began as a data contract template developed at PayPal [36]. Bitol moved from sandbox in 2023 to incubation in 2024 and, according to its own announcement, graduated in mid-2026 [37]. The current version, 3.2.0, released in September 2026 together with version 1.1.0 of the companion product standard, is declared backward compatible with version 3.1.0 [38].
An ODCS contract is organized into sections for fundamentals, schema, context, references, data quality, support and communication channels, pricing, team, roles, service-level agreement, infrastructure and servers, custom properties, authoritative definitions, tags and variables [35]. Version 3.2.0 added, among other things, a context section with instructions and constraints for AI agents that consume the data, variables for contracts that span environments, and a deprecation flag on fields [38]. The companion product standard lets each output port name the contract that governs it, so the link between product and contract is explicit [23].
The practitioner community has largely settled on ODCS. The Data Contract Specification, an alternative format, now carries a deprecation notice recommending migration to ODCS, with support in its tooling promised until the end of 2026 [39]. The open-source Data Contract CLI works natively with ODCS and documents commands to lint a contract, test it against the live data source it names, compare versions for breaking changes, and import and export other formats [40]. A single open format matters for governance: contracts can be checked by different tools, stored with code, and read by catalogs and platforms without translation.
Data products must change, and contracts are mostly about how. Serialization formats provide the formal foundation. Apache Avro defines how a reader’s schema resolves against a writer’s: fields are matched by name, fields unknown to the reader are ignored, fields missing from the writer take the reader’s default value and fail without one, and certain type promotions are allowed [41]. Protocol Buffers rests compatibility on field numbers: adding fields is safe, removing a field is safe only if its number is never reused, and some type changes are wire-compatible but can alter values [42]. Confluent’s Schema Registry turns such rules into enforced compatibility modes, backward, forward, full and their transitive variants, each implying an order of upgrade: consumers first for backward compatibility, producers first for forward [43].
Analytical tables need the same discipline. dbt’s model versions let a producer publish a breaking change as a new version while consumers move on their own schedule, with a deprecation date after which consumers are warned [44]. Its documentation distinguishes breaking changes, such as removing or renaming a column or changing its type, from non-breaking ones, such as adding a column [44]. The resulting rules are simple to state and worth writing into every contract: add fields with defaults, deprecate before removing, publish a new version for any breaking change, and give consumers a stated window to migrate.
A contract that is not checked is documentation. Enforcement happens in tools, at different points:
– At build time. dbt model contracts require every column to be declared with its name and type, check the model’s output against the declaration before building and fail the build on mismatch; whether constraints such as uniqueness are enforced depends on the data platform [45]. dbt also detects breaking changes against the previous state of a project [45].
– At write time. Confluent extends registered schemas into data contracts with metadata, tags, domain rules that validate or transform data on write or read, and migration rules between major versions; failures can stop a record or send it to a dead-letter topic. These rules require Confluent’s enterprise or advanced cloud governance editions [46].
– On the data. Soda Core version 4 verifies YAML contracts with schema, missing-value, validity, duplicate and row-count checks from the command line or an API [47]. The Data Contract CLI tests an ODCS contract against the data source it describes [40]. These build on the research on automated validation [32], [33].
– In the catalog. DataHub defines a contract as a bundle of verifiable assertions on schema, freshness, volume and columns; contract status follows assertion results, which can come from DataHub Cloud or from external tools such as dbt tests [48]. The open-source metadata model records contracts for data sets but does not enforce them automatically; enforcement depends on the assertions being evaluated [49].
No single tool covers schema, quality, service levels and semantics end to end. A workable design keeps the contract in one open format, runs schema checks at build or write time, runs quality checks on the data on a schedule or on change, and publishes results to the catalog, where owners and consumers can see whether each contract is being met.
Before changing a contract, a producer needs to know who reads the affected fields. OpenLineage, an open standard for lineage collected while jobs run, records each data set’s schema as a facet and supports column-level lineage [50]. DataHub’s impact analysis shows downstream dependencies at a chosen depth, with owners and domains, and is framed explicitly for assessing a breaking schema change; it is available in the open-source edition and depends on lineage having been collected [51]. Combined with contract versioning, impact analysis turns a breaking change from a surprise into a planned migration: the producer sees the affected consumers, notifies their owners and sets a deprecation date.
Federated computational governance asks a federation of domain and platform owners to set global rules and the platform to execute them automatically [4]. Contracts and product descriptors are how that works in practice. The federation decides the rules that every product must meet: required fields in each descriptor, mandatory contract sections, evolution policy, classification tags and quality thresholds for critical products. The platform encodes them as checks: a product cannot be published without an owner, a domain and a contract on each output port; a contract cannot be merged if it fails linting or breaks compatibility without a new version; and a product whose contract checks fail is flagged in the catalog. Paper 2 described the policy engines and tag-driven controls that enforce access and use; contracts add the producer’s commitments on shape, quality and service.
The evidence suggests where to be careful. The move to federated governance is the most frequently reported difficulty [16], governance needs incentives and change management as well as tools [17], and practitioners report a lack of guidance on implementing governance on the platform [19]. Automated checks reduce the burden on domains, but someone must still own the rules, arbitrate disputes between producers and consumers and decide when a product should be retired.
Table 3 gives a qualitative judgment of maturity, drawn from the sources cited. It describes the state of practice, not any single product.
| Area | State of practice | Maturity |
|---|---|---|
| Contract format | One graduated open standard; the main alternative deprecated in its favor | Mature |
| Schema evolution and compatibility | Formal rules in serialization formats; enforced modes in registries; versioning in build tools | Mature |
| Product descriptors | Several open specifications with common fields; no dominant one | Maturing |
| Product-to-contract links in platforms | Present in some standards and catalogs; contracts often attach to data sets rather than products | Maturing |
| End-to-end enforcement | Split across build tools, registries, quality engines and catalogs; some features commercial | Maturing |
| Impact analysis | Lineage standards and catalog impact views available; depends on lineage coverage | Maturing |
| Federated governance operating model | Recognized as the hardest part; little outcome evidence | Open problem |
| Evidence that contracts improve outcomes | Reviews of practitioner literature; no controlled evaluations found | Open problem |
| Contracts for AI agents | Newly specified in ODCS 3.2.0 | Early |
The formats and the schema mechanics are ready. The open questions are organizational and empirical: how federation works over time, and what difference products and contracts make.
Challenge. Peer-reviewed work on data contracts mostly synthesizes practitioner writing, and implementation studies do not measure outcomes [31], [16]. Research direction. Longitudinal studies of incidents, change lead times and consumer trust before and after contracts. Opportunity. Evidence would let organizations decide where contracts are worth their cost.
Challenge. The transition to federated governance and domain ownership is the most reported difficulty [16], [17]. Research direction. Operating models, incentives and steering structures for federated governance [19], [20]. Opportunity. Proven models would reduce the risk of moving ownership to domains.
Challenge. Several product specifications coexist, two of them with the same abbreviation [22], [23], [24], [25]. Research direction. Mappings between specifications and a DCAT-based core [21]. Opportunity. A common product description would let catalogs and marketplaces exchange products without custom integration.
Challenge. Schema is checked well; quality, service levels and meaning are checked unevenly and in different tools [45], [48], [47]. Research direction. Executable quality and service-level sections and semantic definitions tied to business glossaries [35]. Opportunity. Contracts that test meaning as well as shape would catch errors that types cannot.
Challenge. Catalogs often attach contracts to individual data sets rather than to products, and record rather than enforce them [49]. Research direction. Product-level contracts that cover all output ports [23]. Opportunity. Product-level commitments would match how consumers think about what they depend on.
Challenge. Breaking changes require knowing every consumer, and lineage coverage is rarely complete [50], [51]. Research direction. Automatic consumer discovery and migration support, borrowing from API evolution research [34]. Opportunity. Safe, planned change would let producers improve products without fear of breaking others.
Challenge. Fabric architectures emphasize central metadata and integration, meshes emphasize distributed ownership, and research on combining them is early [6], [15], [11]. Research direction. Knowledge-graph metadata layers that carry ownership, contracts and policies from domains. Opportunity. A combined design would offer integration without taking ownership away from domains.
Challenge. AI agents consume data without reading documentation, and contract sections for them are new [38]. Research direction. Machine-readable context, constraints and permitted uses for agent consumers, connected to the controls in Papers 1 and 2. Opportunity. Contracts that agents can read would make AI use of data products safer and more predictable.
Decide first which decisions are federated and which stay central, and write them down as rules the platform can check. Give every data product an owner, a domain, a stated purpose, defined output ports and a lifecycle status, and describe it in a machine-readable form aligned with DCAT. Put an ODCS contract on each output port, kept in version control with the code that produces it. Write evolution rules into the contract, add with defaults, deprecate before removing and version breaking changes, and enforce them with compatibility checks in build tools and registries. Run quality checks on the data and publish the results to the catalog. Use lineage and impact analysis before every breaking change. Measure incidents and change lead times, so that the value of products and contracts can be judged on evidence.
For federated query and data products, Bassirah works with Starburst as a Strategic Technology Partner; Starburst Enterprise documents data products with domains, owners, a lifecycle and definitions managed as code, and contracts can be checked alongside them with open tools, since contract checks are not among the features documented on the pages reviewed. For metadata, data products, lineage and impact analysis, Bassirah provides independent support for DataHub Core, the open-source edition of DataHub; this support is Bassirah’s own and is not vendor support from DataHub’s maintainers. DataHub Core records data products and contracts, while scheduled contract assertions are documented for DataHub Cloud. Other products, projects and specifications named in this paper are ecosystem references. In each case, validate the design against your own data, organization and versions before relying on it.
Paper 4 turns to data sovereignty and cross-border compliance, where the location and jurisdiction of each product and its consumers become part of what must be governed.
Product and project names are trademarks of their respective owners. Their mention describes publicly documented technology and does not imply a business relationship, except where Bassirah names a Strategic Technology Partner.
About this paper.
A technology survey of published research and publicly documented systems. It does not report Bassirah benchmarks or customer results. Product and project names are trademarks of their respective owners; their mention does not imply a business relationship, except where Bassirah names a Strategic Technology Partner.
Summaries of laws, regulations and standards are general information as of the paper’s date, not legal advice. Obtain qualified legal advice for your organization and jurisdictions.
THE SERIES
Each paper takes one governance frontier in depth, with the regulation, standards and research behind it. Planned papers are listed without dates and are published as they are reviewed.
From periodic audits to continuous risk scoring, active metadata and policy as code.
Training and retrieval data, prompt and response logs, synthetic data and agent tool access, governed through metadata, lineage and quality.
Bring one data domain or AI use case to a short governance workshop. We will map it to the practices in this paper and plan the first controls to put in place.