Job Description:

We are looking for a skilled Data Engineer to join our Data Platforms team at MBIG IT SERVICES (OP) PVT. LTD. As a Data Engineer, you will play a crucial role in developing and maintaining scalable data architectures and platforms using AWS services. The ideal candidate will have strong experience in AWS cloud technologies, data engineering practices, and the ability to work with large-scale data systems.

Responsibilities:

Design, implement, and maintain data pipelines and architectures to support business operations.

Work with large datasets and ensure they are integrated, stored, and made accessible for analysis and reporting.

Build and maintain data models for improved data flow and performance.

Collaborate with data scientists, analysts, and other engineers to deliver actionable data insights.

Implement data quality and governance measures to ensure reliable and accurate data.

Leverage AWS tools (e.g., Redshift, S3, Lambda, Glue) to build, scale, and optimize data solutions.

Monitor data pipeline performance, troubleshoot issues, and resolve bottlenecks.

Stay up-to-date with the latest AWS offerings and data engineering best practices.

Skills & Qualifications:

Proven experience as a Data Engineer with a focus on AWS technologies.

Strong proficiency in data modeling, ETL processes, and building scalable data pipelines.

In-depth experience with AWS services like Redshift, S3, Glue, Lambda, and RDS.

Expertise in SQL and other data processing languages (Python, Spark, etc.).

Experience with data warehousing and big data tools (Hadoop, Kafka, etc.).

Solid understanding of data governance, data security, and compliance best practices.

Strong problem-solving abilities and excellent troubleshooting skills.

Ability to work in an agile and collaborative environment.

Preferred Qualifications:

Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

Experience with containerization technologies like Docker and Kubernetes.

Familiarity with machine learning frameworks or data science tools.