google/grizzly: End-to-end DataOps platform deployed by Terraform.

URL

https://github.com/google/grizzly

Grizzly

The Grizzly DataOps platform is a deployable blueprint to create and operate an analyst-first data warehouse with minimal engineering support. It provides a simple Git .yml and .sql file interface as the single pane of glass to configure and run the following components in concert:

BigQuery including its database, function, assert, table-level security, column-level security, row-level security, and machine learning functionality.
Cloud Composer as a complete end-to-end data movement/integration tool for BigQuery, Cloud Spanner, CloudSQL, Cloud Storage, and Google Sheets.
Cloud Data Loss Prevention to detect and mask or remove sensitive data automatically.
Cloud Pub/Sub to provide outbound event-driven data and streaming analytics.
Cloud Source Repositories to control code.
Cloud Storage to provide object and file storage.
Data Catalog to provide data taxonomy and data discovery.
Dataflow to provide inbound streaming data.

Please see the Documentation to get started.

License

Copyright 2022 Google LLC

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    https://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.