Moneo

Moneo's main challenge lay in integrating and optimizing its data flows in a scalable and efficient way, allowing the creation of a data warehouse that could support autonomous and self-service analysis. In addition, Moneo needed to improve its analytical capabilities to offer its customers a direct and interactive visualization of data. To solve these problems, a robust infrastructure was needed that could handle large volumes of data efficiently.

Semantiks, after understanding the specific needs of Moneo during the discovery phase, proposed a solution based on the following elements:

1. BigQuery as a basis for the Canonical Data Warehouse, allowing the centralization of data and ensuring scalability.
2. Looker Embed to provide interactive dashboards directly to Moneo customers, allowing them to obtain actionable insights autonomously.
3. Use of GCP Datastream to integrate data from Postgres to BigQuery, implementing workflows ELT Efficient (Extract, Load, Transform) that allow automatic updates and the creation of views in BigQuery to flexibly transform data.

The implementation of the solution was carried out as follows:

• Data Integration: Data is automatically extracted from the Postgres database using GCP Datastream, which ensures that data in BigQuery is updated without the need to keep redundant copies.
• Data Transformation: In BigQuery, views were created that allow for necessary transformations such as denesting arrays, joining tables, and creating aggregations at the user and ticket levels. This makes it easy to analyze the data in depth without additional complications.
• Looker: Using Looker, the data was modeled using LookML to allow end users to create customized visualizations. The integration of Looker Embed provided Moneo with the ability to provide interactive dashboards that connect directly to BigQuery, providing an exceptional user experience.

With the implementation of this solution, Moneo has experienced a significant improvement in its analytical capabilities:

• Scalability: Thanks to BigQuery and Datastream, the system is highly scalable, capable of handling large volumes of data without compromising performance.
• Autonomy in the analysis: Moneo users can now explore and visualize data on their own through Looker, reducing dependence on technical equipment and improving decision-making speed.
• Advanced Business Intelligence: With the ability to integrate interactive visualizations, Moneo has managed to offer an enriching experience for its customers, allowing them to obtain actionable insights in real time.

Moneo has big plans for the future, including a possible migration to Google Cloud SQL to further optimize its architecture and reduce storage costs. In addition, they are considering expanding the use of Dbt to improve the scalability of your data engineering pipelines. The collaboration with Semantiks will continue to refine its analytical capabilities and explore new opportunities to improve its processes and products.

This project with Moneo highlights Semantiks' ability to provide advanced and scalable solutions in the world of data analytics. Through the implementation of Google Cloud Platform and Looker tools, Moneo has taken an important step towards digital transformation, providing its teams and customers with a solid platform for data-based decision-making. We are excited to continue to accompany Moneo on its path to success.