ETL Processes Fine-tuning to Streamline Insurance Data Management

Client and Business Goal:
The customer pursued the goal of transforming the existing ETL processes and creating new ones with the Astera Centerprise tool. They intended to unify the codebase to alleviate future changes in the code when needed. They got down to the project with their effort, however, the work proceeded not as expected: requirements definition and development process were flowing with delays.

Our team works with incoming and transmitting data, sent in xlsx, csv, and txt formats. Files containing information uploaded from the database must correspond to the business needs of the vendor they are sent to. To ensure compliance, the imported data are validated for mandatory fields and data format. When data is uploaded to the database, it is run through a range of filters. We utilize Microsoft SQL Server to manage the database. There are two main servers our team uses in daily work: DEV for process development and UAT for testing. After the developed process is tested, it is released on the Prod server. At this stage, the team is involved in support to ensure error-free system functioning.

Accession of our team to the project brought results. The customer points out significant improvements and acceleration of the development pace with the involvement of our ETL experts. Processes transformed from the current state to the Astera Centerprise must be improved when converted to the platform but at the same time save the logic. The team is constantly refining sample operations applied for a variety of processes through daily meetings.
Work added: 07.12.21, edited: 10.07.23