Data Engineer-AWS Glue

Affine Analytics limited

Chennai, India

Salary : 15,500 - 19000

Roles and Responsibilities: We are seeking an experienced Data Engineer to join our team. The ideal candidate will have 5 to 8 years of experience in data engineering and a strong background in building data pipelines, data warehousing, and data management solutions. In this role, you will work closely with data scientists, analysts, and other stakeholders to design, build, and maintain scalable and robust data infrastructure. • • • Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS. • • Create and enforce data modeling standards, best practices, and governance policies. • Excellent in Advanced SQL end to end development and Optimization of existing processes • Ability to understand and write complex Pyspark/Python code according to business requirement. • Table Partition mechanism, Types of Partitions, column store index • Maintenance and optimization of existing processes • Experience in leading, overseeing tasks and providing guidance to the team. • Requirement gathering and feasibility analysis, design, develop from scratch and deliver • Experience in designing data warehouse/data mart. • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements • Experience in deploying data pipelines using automated CI/CD approach. • • Ability to write modularized reusable code components. • Proficient in identifying data issues and anomalies during analysis. • Leading the client calls to flag off any delays, blockers, escalations and collate all the requirement