Make datasets unique at the workspace level instead of organization
S
Slight Bass
We just discovered dataset names must be unique to an organization instead of a workspace. This is troublesome since we want to have
dev
and prod
workspaces that run in parallel and have essentially the same setup, including datasets. But if the dev
space has dataset project_00
then prod
cannot and vice versa.Even if we combined the
dev
and prod
workspaces so they both have access to the dataset (which is non-ideal for other reasons), we'd run into a different issue: both the dev
and prod
upstream processes would update the same dataset potentially allowing the dev
environment to corrupt the dataset before prod
uses it.