Staff Engineer (Platform Engineer)

Must have SkillsAWS Glue Sodacore Lakehouse architecture CDC Medallion design principlesKey ResponsibilitiesData Ingestion DevelopmentBuild and implement AWS Glue jobs for Bronze layer ingestion using defined standards and templates.Implement correct loading methods based on source requirements (CDC full load delta snapshot).Design and execute historical loading mechanisms to bring legacy data into the Lakehouse.Performance OptimizationOptimize Glue job performance (DPU allocation parallelization partitioning) according to best practices.Collaborate with platform teams to ensure tooling and optimization alignment.Migration & AutomationAggressively migrate source tables to Bronze layer initially using manual approaches with standards/templates later leveraging AI-enabled acceleration.Ensure jobs are version-controlled and production deployment is automated via Git and Terraform.Governance & MonitoringImplement source system connectivity into CDP in collaboration with source system owners.Ensure jobs comply with data contracts and are properly monitored.Prepare documentation and handover to operational support teams.CollaborationWork closely with Data Architect for ingestion patterns and standards.Coordinate with Data Assurance Lead to apply quality checks across all jobs.Partner with platform engineers for tooling and optimization.Required Skills & ExperienceTechnical ExpertiseStrong experience in AWS Glue PySpark and ETL pipeline development.Knowledge of Lakehouse architecture and Medallion design principles.Familiarity with CDC delta loads and historical data ingestion strategies.Tools & TechnologiesAWS services: Glue S3 Athena Lambda.Git Terraform for CI/CD automation.Understanding of data quality frameworks (e.g. Soda Core) is a plus.Able to identify ways to automate their work / repetitive tasks.Soft SkillsAbility to work in a fast-paced environment and deliver aggressive migration targets.Strong collaboration and communication skills.Work with Jira and agile way of working.Remote Work : NoEmployment Type : Full-time#J-18808-Ljbffr