Prior Situation / Scenario
- A leading North American Telecommunications company operating in over 20 countries across LATAM and the Caribbean under various brands.
- They offer a range of communications and entertainment services to residential and business customers, including video, broadband internet, telephone, and mobile services.
- Company deployed a SAS Customer Engagement marketing platform (MA and RTMD), SAS Viya Visual Analytics, and SAS Data Integration Studio.
- ETL jobs were running on a SAS Cluster based on SAS Data Integration, with its main database engine being an RDS Oracle.
Client Challenges
- Increased operational costs due to Oracle DB.
- SAS dedicated instances.
- Expected growth in costs.
Strata Solution/ Key Enablers
- Migration and refactoring from SAS Code and Data Integration jobs to PySpark AWS Glue jobs, orchestrated with AWS Step Functions and Apache Airflow.
- Data Lake is now based on the AWS Glue catalog, composed of Parquet files, accessed via the Athena connector. Dashboards and analytics are performed on Quicksight.
- Reduction in EC2 instances due to re-clustering of high-availability SAS RTDM nodes. Also, RDS instances are decreased.
Outcome
- Substantial Cost reduction.
- Refactoring and migrating Data Lake from SAS to AWS Serverless Glue / PySpark jobs.
- Streamlined operations and simplified pipeline tracking with Airflow.
Results
After migrating the SAS Data platform to AWS and orchestrating with Apache Airflow, we managed to cut database costs and reduce instance expenses by a total of 30% compared to previous costs.
