Data Engineer

About the Role

Prasam IT Services Ltd is seeking an experienced and technically skilled Data Engineer to design, develop and maintain scalable, high-performance data solutions within AWS cloud environments. The successful candidate will have strong hands-on experience with Apache Spark, Java or Scala, SQL and AWS data services. You will play a key role in building modern data platforms, developing reliable ETL/ELT pipelines and enabling data ecosystems that support Generative AI, machine learning and advanced analytics. This is an excellent opportunity for a motivated Data Engineer to contribute to innovative cloud-based data engineering solutions.

Key Responsibilities

Continuously improve data engineering practices to support AI-ready data platforms and evolving business requirements.

Design, develop and maintain high-throughput, scalable data pipelines using Apache Spark and cloud-native technologies.

Build and optimise ETL/ELT workflows to process structured and unstructured data within AWS environments.

Develop and maintain data processing solutions using Java, Scala or Python.

Design and implement data lakehouse architectures to support enterprise analytics and large-scale data processing.

Collaborate with AI/ML teams to build and maintain data platforms supporting Generative AI and advanced analytics use cases.

Develop complex SQL queries and optimise data transformations for performance and efficiency.

Implement data quality, governance, security and monitoring standards across data pipelines.

Work with AWS services to deliver secure, scalable, resilient and highly available data solutions.

Troubleshoot and resolve complex data processing issues in distributed computing and production environments.

Collaborate with cross-functional engineering teams to improve automation, data observability and platform reliability.

Essential Skills & Requirements

Experience working with distributed data processing systems and cloud-native architectures.

4–8 years of professional experience in Data Engineering, developing and maintaining large-scale data solutions.

Strong hands-on experience with Apache Spark, preferably using Java or Scala. Python experience will also be considered.

Good working knowledge of AWS cloud services, particularly Amazon S3, EMR, AWS Glue and IAM.

Strong SQL development skills, including query optimisation and performance tuning.

Practical experience developing and managing ETL/ELT pipelines and enterprise data models.

Understanding of data lakehouse architectures and modern cloud-based data platforms.

Familiarity with Generative AI, AI/ML workflows and data engineering requirements for AI-driven applications.

Strong understanding of data governance, data quality, security and operational best practices.

Desirable Skills

Experience with Databricks and/or Snowflake.

Previous experience in the financial services domain.

Understanding of financial data compliance and governance frameworks.

Familiarity with data observability and monitoring tools.

Experience with DevOps practices, automation and CI/CD pipelines.

Knowledge of building reliable, production-grade data platforms.

What We Are Looking For

We are looking for a proactive and analytical professional with strong problem-solving skills and the ability to work independently in a remote engineering environment.

The ideal candidate should be passionate about modern data technologies, cloud engineering and building scalable data solutions that support advanced analytics and Generative AI initiatives.

Interested candidates are invited to apply with their updated CV.