# Latest

**URL:** https://forum.data-community.org/latest.md

[Latest](https://forum.data-community.org/latest.md) · [Categories](https://forum.data-community.org/categories.md) · [Tags](https://forum.data-community.org/tags.md)

---

## [Delivering a continuous enterprise data pipeline](https://forum.data-community.org/t/delivering-a-continuous-enterprise-data-pipeline/2163)

<div class="topic-metadata">

**Author:** [@RhysHanscombe](https://forum.data-community.org/u/RhysHanscombe)\
**Replies:** 0\
**Last updated:** [September 10, 2026, 2:24pm UTC](https://forum.data-community.org/t/delivering-a-continuous-enterprise-data-pipeline/2163 "2026-09-10T14:24:18Z")

</div>

After last week’s virtual conference, we’re back to business as usual in October, when we welcome Scott Ambler to the Data Community. Delivering a Continuous Enterprise Data Pipeline :date: 2026-10-21T15:00:00Z (UTC)→2…

---

## [Welcome to the Data Vault User Group Discourse](https://forum.data-community.org/t/welcome-to-the-data-vault-user-group-discourse/7)

<div class="topic-metadata">

**Author:** [@system](https://forum.data-community.org/u/system)\
**Replies:** 0\
**Last updated:** [November 23, 2021, 3:10pm UTC](https://forum.data-community.org/t/welcome-to-the-data-vault-user-group-discourse/7 "2021-11-23T15:10:42Z")

</div>

Our Data Vault User Group is an open independent community of data professionals committed to sharing knowledge and experience of building data platforms (warehouses, lakes, hubs) using the Data Vault method, or any cont…

---

## [Semantic Layer Stories](https://forum.data-community.org/t/semantic-layer-stories/2174)

<div class="topic-metadata">

**Author:** [@Frankie](https://forum.data-community.org/u/Frankie)\
**Replies:** 3\
**Last updated:** [October 1, 2026, 2:12am UTC](https://forum.data-community.org/t/semantic-layer-stories/2174 "2026-10-01T02:12:02Z")

</div>

Anyone built a semantic layer on top of their DV2.X solution yet? What was your experience, did you have any issues with stakeholder engagement? What sort of tooling did you use, any pros/cons? Interested to see peopl…

---

## [Event: VaultSpeed NEXT in New York - 22nd Oct](https://forum.data-community.org/t/event-vaultspeed-next-in-new-york-22nd-oct/2180)

<div class="topic-metadata">

**Author:** [@kevin.monk](https://forum.data-community.org/u/kevin.monk)\
**Replies:** 0\
**Last updated:** [September 30, 2026, 3:07pm UTC](https://forum.data-community.org/t/event-vaultspeed-next-in-new-york-22nd-oct/2180 "2026-09-30T15:07:10Z")

</div>

Register here - VaultSpeed NEXT in New York One day (22nd October), two ways to engage The day opens with a technical workshop: a hands-on, in-depth session for data professionals building a governed data layer. Brin…

---

## [How Can Businesses Improve PII Data Governance When Using AI?](https://forum.data-community.org/t/how-can-businesses-improve-pii-data-governance-when-using-ai/2178)

<div class="topic-metadata">

**Author:** [@rom\_c](https://forum.data-community.org/u/rom_c)\
**Replies:** 1\
**Last updated:** [September 30, 2026, 11:38am UTC](https://forum.data-community.org/t/how-can-businesses-improve-pii-data-governance-when-using-ai/2178 "2026-09-30T11:38:30Z")

</div>

As businesses use AI to process customer information, employee records, and other sensitive data, PII data governance is becoming an important part of responsible data management. Personally identifiable information can …

---

## [Business key(BK) standardisation# BK to be used for hash key creation](https://forum.data-community.org/t/business-key-bk-standardisation-bk-to-be-used-for-hash-key-creation/2171)

<div class="topic-metadata">

**Author:** [@Rupa](https://forum.data-community.org/u/Rupa)\
**Replies:** 2\
**Last updated:** [September 29, 2026, 12:12pm UTC](https://forum.data-community.org/t/business-key-bk-standardisation-bk-to-be-used-for-hash-key-creation/2171 "2026-09-29T12:12:35Z")

</div>

In this example, we are receive details of insurable entity ids from source and the records contain different levels of granularity as shown under ‘Source Data’ section. A record may represent data for content item(f…

---

## [Handling Retroactive Changes to Historical Effectivity in Data Vault 2.0](https://forum.data-community.org/t/handling-retroactive-changes-to-historical-effectivity-in-data-vault-2-0/2166)

<div class="topic-metadata">

**Author:** [@juan.jimenez](https://forum.data-community.org/u/juan.jimenez)\
**Replies:** 7\
**Last updated:** [September 23, 2026, 3:36am UTC](https://forum.data-community.org/t/handling-retroactive-changes-to-historical-effectivity-in-data-vault-2-0/2166 "2026-09-23T03:36:55Z")

</div>

Hi everyone, I completed my Data Vault 2.0 certification about three years ago, and there is one modelling problem that keeps coming back in our implementations. I would be very interested to hear how other experienced …

---

## [Data Vault: Core Concepts is now available on demand](https://forum.data-community.org/t/data-vault-core-concepts-is-now-available-on-demand/2169)

<div class="topic-metadata">

**Author:** [@RhysHanscombe](https://forum.data-community.org/u/RhysHanscombe)\
**Replies:** 0\
**Last updated:** [September 22, 2026, 11:34am UTC](https://forum.data-community.org/t/data-vault-core-concepts-is-now-available-on-demand/2169 "2026-09-22T11:34:24Z")

</div>

We’ve retired the live Data Vault: Core Concepts session and rebuilt it as a free on-demand course. @neil.strange’s walkthrough is now recorded, split into modules, and available to watch whenever suits you. If you’ve…

---

## [Data Community Virtual Conference 2026 Debrief. What stuck with you?](https://forum.data-community.org/t/data-community-virtual-conference-2026-debrief-what-stuck-with-you/2161)

<div class="topic-metadata">

**Author:** [@RhysHanscombe](https://forum.data-community.org/u/RhysHanscombe)\
**Replies:** 1\
**Last updated:** [September 9, 2026, 1:19pm UTC](https://forum.data-community.org/t/data-community-virtual-conference-2026-debrief-what-stuck-with-you/2161 "2026-09-09T13:19:43Z")

</div>

That’s a wrap on the Data Community Virtual Conference 2026! Thank you to everyone who joined us across the two days. A few themes came up again and again in the sessions and the Q&A: where Data Vault fits as AI reshape…

---

## [Introduce yourselves!](https://forum.data-community.org/t/introduce-yourselves/20)

<div class="topic-metadata">

**Author:** [@richard.strange](https://forum.data-community.org/u/richard.strange)\
**Replies:** 47\
**Last updated:** [September 7, 2026, 2:44pm UTC](https://forum.data-community.org/t/introduce-yourselves/20 "2026-09-07T14:44:35Z")

</div>

New to the user group? Say hello here!

---

## [LLM API Returning Inconsistent Responses When Using RAG](https://forum.data-community.org/t/llm-api-returning-inconsistent-responses-when-using-rag/2151)

<div class="topic-metadata">

**Author:** [@soumitradutta](https://forum.data-community.org/u/soumitradutta)\
**Replies:** 0\
**Last updated:** [September 1, 2026, 9:04am UTC](https://forum.data-community.org/t/llm-api-returning-inconsistent-responses-when-using-rag/2151 "2026-09-01T09:04:35Z")

</div>

Hi Everyone, I am Soumitra Dutta, I have an issue with LLM API and Retrieval-Augmented Generation (RAG). Sometimes the same query returns different answers even if the retrieved documents and the prompt are the same. T…

---

## [Introducing myself: governed self-service, semantics and AI](https://forum.data-community.org/t/introducing-myself-governed-self-service-semantics-and-ai/2148)

<div class="topic-metadata">

**Author:** [@GarethYap](https://forum.data-community.org/u/GarethYap)\
**Replies:** 3\
**Last updated:** [August 31, 2026, 7:55am UTC](https://forum.data-community.org/t/introducing-myself-governed-self-service-semantics-and-ai/2148 "2026-08-31T07:55:53Z")

</div>

Hi everyone, I’m Gareth. I work with enterprise data teams on governed self-service analytics, so I spend a lot of time thinking about how business users can get trusted answers without creating more tickets, dashboards …

---

## [How ready is your data function, really? (Free 5-min self-assessment)](https://forum.data-community.org/t/how-ready-is-your-data-function-really-free-5-min-self-assessment/2145)

<div class="topic-metadata">

**Author:** [@RhysHanscombe](https://forum.data-community.org/u/RhysHanscombe)\
**Replies:** 0\
**Last updated:** [August 20, 2026, 3:45pm UTC](https://forum.data-community.org/t/how-ready-is-your-data-function-really-free-5-min-self-assessment/2145 "2026-08-20T15:45:14Z")

</div>

Hi everyone, We’ve been having a similar conversation with a lot of people in the community lately around data maturity. Do you really know how mature your data function is, scored against a proper framework? We put t…

---

## [📣 Data Community Virtual Conference 2026 — Free, 2 Days, All Online](https://forum.data-community.org/t/data-community-virtual-conference-2026-free-2-days-all-online/2144)

<div class="topic-metadata">

**Author:** [@RhysHanscombe](https://forum.data-community.org/u/RhysHanscombe)\
**Replies:** 0\
**Last updated:** [August 19, 2026, 11:04am UTC](https://forum.data-community.org/t/data-community-virtual-conference-2026-free-2-days-all-online/2144 "2026-08-19T11:04:37Z")

</div>

Hi everyone, We’re back with the Data Community Virtual Conference 2026, happening September 2nd–3rd on Microsoft Teams. Completely free, as always. Two days packed with sessions across three themes: AI in Practic…

---

## [What load timestamp should we use when migrating 10 years of daily deltas](https://forum.data-community.org/t/what-load-timestamp-should-we-use-when-migrating-10-years-of-daily-deltas/2141)

<div class="topic-metadata">

**Author:** [@barkeeper42](https://forum.data-community.org/u/barkeeper42)\
**Replies:** 7\
**Last updated:** [August 12, 2026, 9:54am UTC](https://forum.data-community.org/t/what-load-timestamp-should-we-use-when-migrating-10-years-of-daily-deltas/2141 "2026-08-12T09:54:59Z")

</div>

We need to init (NOT BACKFILL) a data vault from a incremental archive of 10 years daily deltas. The deltas are no real deltas but let’s say that the records have been extracted with some sort of CDC. The daily batches h…

---

## [Meet the IRiS Assistant](https://forum.data-community.org/t/meet-the-iris-assistant/2120)

<div class="topic-metadata">

**Author:** [@JulienRedmond](https://forum.data-community.org/u/JulienRedmond)\
**Replies:** 1\
**Last updated:** [June 28, 2026, 11:21pm UTC](https://forum.data-community.org/t/meet-the-iris-assistant/2120 "2026-06-28T23:21:37Z")

</div>

Here is what you can get done in under 15 minutes if the silver layer of your Lakehouse is automated.

---

## [DV hub methodology question about load\_date](https://forum.data-community.org/t/dv-hub-methodology-question-about-load-date/2137)

<div class="topic-metadata">

**Author:** [@julia](https://forum.data-community.org/u/julia)\
**Replies:** 1\
**Last updated:** [June 26, 2026, 7:57pm UTC](https://forum.data-community.org/t/dv-hub-methodology-question-about-load-date/2137 "2026-06-26T19:57:28Z")

</div>

Hi everyone, I have an important question regarding the load\_date in Data Vault hubs. In my implementation, hubs are created using a standard macro with an insert-only incremental approach, meaning that existing record…

---

## [Scaling Data Vault](https://forum.data-community.org/t/scaling-data-vault/2136)

<div class="topic-metadata">

**Author:** [@RhysHanscombe](https://forum.data-community.org/u/RhysHanscombe)\
**Replies:** 0\
**Last updated:** [June 23, 2026, 3:24pm UTC](https://forum.data-community.org/t/scaling-data-vault/2136 "2026-06-23T15:24:02Z")

</div>

Automation has transformed how organisations build and maintain Data Vault solutions. Tools like AutomateDV have helped teams accelerate development, reduce manual effort, and deliver value faster than ever before. B…

---

## [VaultSpeed News Letter - What's New in June 26](https://forum.data-community.org/t/vaultspeed-news-letter-whats-new-in-june-26/2131)

<div class="topic-metadata">

**Author:** [@kevin.monk](https://forum.data-community.org/u/kevin.monk)\
**Replies:** 0\
**Last updated:** [June 23, 2026, 3:02pm UTC](https://forum.data-community.org/t/vaultspeed-news-letter-whats-new-in-june-26/2131 "2026-06-23T15:02:58Z")

</div>

We just launched our monthly LinkedIn newsletter and the first edition is live! “What’s New in June” is packed: • We’re at Databricks Data + AI Summit next week, come find us at booth #112 • Webinar on June 23rd: What…

---

## [Detecting Delete of a Relationship in Snapshots](https://forum.data-community.org/t/detecting-delete-of-a-relationship-in-snapshots/2129)

<div class="topic-metadata">

**Author:** [@barkeeper42](https://forum.data-community.org/u/barkeeper42)\
**Replies:** 2\
**Last updated:** [June 22, 2026, 9:45am UTC](https://forum.data-community.org/t/detecting-delete-of-a-relationship-in-snapshots/2129 "2026-06-22T09:45:08Z")

</div>

Our source system sends daily snapshots of Bookings and Booking Items. It does not send explicit information when a particular booking item was removed, it just sends the new snapshot of the booking and the currently act…

---

## [Why AI Projects Fail Without Trusted Data Foundations](https://forum.data-community.org/t/why-ai-projects-fail-without-trusted-data-foundations/2113)

<div class="topic-metadata">

**Author:** [@JulienRedmond](https://forum.data-community.org/u/JulienRedmond)\
**Replies:** 0\
**Last updated:** [June 11, 2026, 3:27am UTC](https://forum.data-community.org/t/why-ai-projects-fail-without-trusted-data-foundations/2113 "2026-06-11T03:27:10Z")

</div>

We’ve been seeing a common pattern across AI projects lately: the issue usually isn’t the model, it’s the quality and structure of the data underneath it. If the data lacks consistency, lineage, context, or trust, AI t…

---

## [Effect on link structure if source table changes structure](https://forum.data-community.org/t/effect-on-link-structure-if-source-table-changes-structure/1217)

<div class="topic-metadata">

**Author:** [@kvs.naidu](https://forum.data-community.org/u/kvs.naidu)\
**Replies:** 4\
**Last updated:** [June 8, 2026, 12:23am UTC](https://forum.data-community.org/t/effect-on-link-structure-if-source-table-changes-structure/1217 "2026-06-08T00:23:58Z")

</div>

Hello All, I have been thinking about this? table 1 - car (car\_id) table 2 - customer (cust\_id) table 3 - salesinvoice (inv\_id(pk),card\_id(fk),cust\_id(fk)) When i generate data vault model on salesinvoice table i go…

---

## [Experience Modeling ACDOCA](https://forum.data-community.org/t/experience-modeling-acdoca/2112)

<div class="topic-metadata">

**Author:** [@asouissi](https://forum.data-community.org/u/asouissi)\
**Replies:** 0\
**Last updated:** [June 3, 2026, 2:30pm UTC](https://forum.data-community.org/t/experience-modeling-acdoca/2112 "2026-06-03T14:30:21Z")

</div>

Hi everyone, We’re currently working on integrating SAP FI data into a client’s Data Vault. One of the key source tables is ACDOCA (Universal Journal line items), and we’re evaluating how best to model it in the Raw Vau…

---

## [DV Modelling Is Hard](https://forum.data-community.org/t/dv-modelling-is-hard/2055)

<div class="topic-metadata">

**Author:** [@JustOneCog](https://forum.data-community.org/u/JustOneCog)\
**Replies:** 9\
**Last updated:** [May 30, 2026, 4:45am UTC](https://forum.data-community.org/t/dv-modelling-is-hard/2055 "2026-05-30T04:45:38Z")

</div>

Hi all, Apologies in advance for my rant below. So I’m one cog in a machine that is trying to build a data vault. The machine has been running for a while now and I’m coming in a bit blind. I’m doing my best to underst…

---

## [Partitioned Multi-Active Satellite](https://forum.data-community.org/t/partitioned-multi-active-satellite/2106)

<div class="topic-metadata">

**Author:** [@patrickcuba](https://forum.data-community.org/u/patrickcuba)\
**Replies:** 0\
**Last updated:** [May 29, 2026, 9:15am UTC](https://forum.data-community.org/t/partitioned-multi-active-satellite/2106 "2026-05-29T09:15:46Z")

</div>

What if you are in a modelling situation where you know you have dependent-child keys but you need to those partitions like a multi-active state of the business key? They are not composite keys (although business keys ar…

---

## [PIT, MAS, and Bridge Tables — Do They Belong to the Raw Vault or the Business Vault?](https://forum.data-community.org/t/pit-mas-and-bridge-tables-do-they-belong-to-the-raw-vault-or-the-business-vault/2085)

<div class="topic-metadata">

**Author:** [@julia](https://forum.data-community.org/u/julia)\
**Replies:** 4\
**Last updated:** [May 29, 2026, 9:07am UTC](https://forum.data-community.org/t/pit-mas-and-bridge-tables-do-they-belong-to-the-raw-vault-or-the-business-vault/2085 "2026-05-29T09:07:33Z")

</div>

Hi all, I’m currently working on a Data Vault 2.0 project and have a question regarding modeling layers. Do PIT and bridge tables belong to the Raw Vault or the Business Vault layer? From my perspective, PIT tables se…

---

## [Structure of the PIT table for Snowflake DB](https://forum.data-community.org/t/structure-of-the-pit-table-for-snowflake-db/2061)

<div class="topic-metadata">

**Author:** [@LVDV](https://forum.data-community.org/u/LVDV)\
**Replies:** 4\
**Last updated:** [May 29, 2026, 9:05am UTC](https://forum.data-community.org/t/structure-of-the-pit-table-for-snowflake-db/2061 "2026-05-29T09:05:57Z")

</div>

Hello, For PIT tables, do we have to repeat the hashkey for each Satellite table along with the load\_dts, if the DV is implemented in Snowflake database? In other DBs to help the query plan we might want to do that but …

---

## [Soumitra Dutta Oxford-How do I quantify ROI from data initiatives?](https://forum.data-community.org/t/soumitra-dutta-oxford-how-do-i-quantify-roi-from-data-initiatives/2081)

<div class="topic-metadata">

**Author:** [@soumitradutta26](https://forum.data-community.org/u/soumitradutta26)\
**Replies:** 1\
**Last updated:** [May 29, 2026, 9:04am UTC](https://forum.data-community.org/t/soumitra-dutta-oxford-how-do-i-quantify-roi-from-data-initiatives/2081 "2026-05-29T09:04:20Z")

</div>

Hi everyone, My name is Soumitra Dutta, an Oxford-based entrepreneur & photographer. I’m trying to better understand how to quantify ROI from data initiatives, and I’m finding it a bit challenging to put clear numbers ar…

---

## [Ingesting JSON in to Raw Vault](https://forum.data-community.org/t/ingesting-json-in-to-raw-vault/2035)

<div class="topic-metadata">

**Author:** [@mlord1979](https://forum.data-community.org/u/mlord1979)\
**Replies:** 3\
**Last updated:** [May 29, 2026, 8:39am UTC](https://forum.data-community.org/t/ingesting-json-in-to-raw-vault/2035 "2026-05-29T08:39:48Z")

</div>

Hi Are there any patterns for ingesting JSON files in to the raw vault? We have an upcoming use case where we will need to ingest medical questionnaires. We have developed our own framework for automating ingestion in t…

---

## [Thin BSATs in projects, is this best practices?](https://forum.data-community.org/t/thin-bsats-in-projects-is-this-best-practices/1970)

<div class="topic-metadata">

**Author:** [@Frankie](https://forum.data-community.org/u/Frankie)\
**Replies:** 4\
**Last updated:** [May 29, 2026, 8:09am UTC](https://forum.data-community.org/t/thin-bsats-in-projects-is-this-best-practices/1970 "2026-05-29T08:09:09Z")

</div>

Hi all, Been a bit quiet here so figured I’d post something that’s more of a feeler than an issue. I’ve noticed a trend when maintaining long running vault projects and figured it’d be good to crowd source some knowledg…

[Next page](https://forum.data-community.org/latest.md?page=1)
