Snowflake Cloud Database
We solve the need to implement a centralized repository that allows queries, pipelines and BI processes with Azure infrastructure - Snowflake.
- Industry
- Other
- Solution
- Data Engineering
01 / 03
The challenge
There is a need to implement a centralized repository that allows queries, pipelines and BI processes to quickly obtain information and generate reports and visualizations, to meet business needs.
The repository that was used and given the large volume of data that was handled simultaneously, had the following drawbacks:
- It was a relational database.
- It presented great delays when carrying out operations.
- It delayed the workflow and the development of new processes.
- Caused repetitive failures in automated processes.
02 / 03
What Tekne did
Objective of the Project
Migrate the repository to a centralized platform, which solves the current problems of capacity, delays and failures.
That allows to unify, analyze and share information between the users of the organization, in a faster, more efficient and safer way.
Looking for the best cost / benefit alternative that allows adapting the processing resources according to the client's needs.
Solution
03 / 03
Results
- The ETL Query processing time, file parsing from various sources and database loads were reduced to 8 minutes.
- The development and generation of reports were reduced to 30 seconds.
Before
Old traditional server
6h
(average) Querys ETL - parsing - DB loads
10m
(average) Development and report generation
After
Azure Infrastructure - Snowflake
8m
(average) Querys ETL - parsing - DB loads
30s
(average) Development and report generation
