We just discovered dataset names must be unique to an organization instead of a workspace. This is troublesome since we want to have
dev
and
prod
workspaces that run in parallel and have essentially the same setup, including datasets. But if the
dev
space has dataset
project_00
then
prod
cannot and vice versa.
Even if we combined the
dev
and
prod
workspaces so they both have access to the dataset (which is non-ideal for other reasons), we'd run into a different issue: both the
dev
and
prod
upstream processes would update the same dataset potentially allowing the
dev
environment to corrupt the dataset before
prod
uses it.