Login- Consulting
- Training
- Partners
- About Us
x
PSU
AWS DMS, Amazon Redshift, Amazon CloudWatch, AWS CloudTrail, AWS IAM, AWS Support.
Seamless Data Migration from Amazon Aurora to Redshift Using AWS DMS
The client is a state nodal agency formed to support and drive all e-government initiatives of the Government of Tamil Nadu. The client is implementing various e-government projects to make all Government services efficient and transparent and accessible to the common man wherever feasible.
Comprehensive pipeline setup
Data integration
Row-Level Security (RLS)
The customer had a problem analyzing their survey data to determine the complete details of each person belonging to their district or government. They needed near real-time dashboards in which details would be shown district-wise, and they wanted dashboards with multiple users based on district. CloudThat assisted in creating a data warehouse solution on AWS and developed multiple dashboards on Amazon QuickSight tailored to the customer’s specific use case.
• Setting up the Amazon QuickSight service and checking all the permissions required for this service.
• Implemented AWS DMS tasks Full Load and CDC (Change Data Capture) for migrating the survey data present in their data source Amazon Aurora to Amazon Redshift.
• Created multiple materialized views for extracting the required fields by joining all the tables together.
• Created a scheduler for refreshing the SQL views and queries in the Redshift when any new data is inserted into their source database, and the same data will be updated in the dataset used in the QuickSight.
• Established the connection between Amazon QuickSight with Amazon Redshift for preparing the dataset.
• Created dashboards using the datasets based on the client’s requirements.
• Implemented RLS (Row Level Security) feature for giving access to the dashboards to multiple users based on the district.
• Publishing the dashboards with the RLS (Row Level Security) feature.
• AWS Services used are Amazon Aurora, AWS DMS, Amazon Redshift, and Amazon QuickSight.
Implemented a comprehensive pipeline and dashboards tailored to client needs, utilizing Amazon Redshift for data warehousing and Amazon QuickSight for real-time data integration. Enhanced security through Row-Level Security and automated data injection ensured optimized performance and efficiency.
SHARE
Our support doesn't end here. We have monthly newsletters, study guides, practice questions, and more to assist you in upgrading your cloud career. Subscribe to get them all!
