AWS Data Engineer (Cloud and DevOps)

long term Contract // Toronto, ON //Canada. Please share resumes to randhir.kumar@tekishub.com

Role: AWS Data Engineer (Cloud and DevOps)
Location-Toronto ON // Hybrid
Duration: 12+months
Experience- 10+ Years

Roles & Responsibilities
• Build, design and implement scalable data lake architecture using AWS S3 and Lakeformation
• Build and optimize ETL Pipelines using AWS Glue, EMR and Spark
• Implement Event-Driven workflows using EventBridge, SNS and SQS
• Design and query datasets using Athena
• Manage metadata and data lineage using Amazon Neptune DB
• Expose APIs for data subscription and sharing using API Gateway and AWS Lambda
• Automate infrastructure provisioning using Terraform and CloudFormation
• Ensure data security and compliance by implementing robust IAM policies and access controls.
• Develop and maintain a self-serve data portal using Angular and integrate it with backend services

Must Have Technical/Functional Skills
• Strong experience in automating infrastructure provisioning using Terraform or CloudFormation (Preferably with Terraform)
• Strong Experience with AWS Services: S3, Lake Formation, Glue, EMR, Athena, Lambda, EventBridge, SNS, SQS
• Proficiency in Apache Spark for distributed data processing
• Familiarity with Amazon Neptune DB for graph-based metadata management
• Strong understanding of Data lake architecture, data governance and security best practices
• Proficiency in SQL, Python and Spark for Data Engineering tasks