Google Managed data processing service
Use Cases and Deployment Scope
In our company we are using Google Cloud Dataflow to create data pipe lines for data transformation and ingestion use cases before loading data into database. Flexibility to create our own flex templates for any special case handling. Capability to fit streaming and batch data loads are some benefits. We have some real time loads, which Dataflow helps alot.
Pros
- Streaming, Real time work load
- Batch processing
- Auto scaling
- flexible pricing
Cons
- inbuild template options can be expanded
- more data connector options
- easy of use
Return on Investment
- cost saving from managing our own data center for ETL servers
- consumption based pricing
- with auto scaling feature, we were able to expand components to support work load
Other Software Used
Google BigQuery, erwin Data Modeler, Microsoft Teams
