Data Engineer – AI/ML

Responsibilities

Design, develop, and maintain scalable data pipelines

that support analytics, AI/ML, and Generative AI applications, including vector databases and Retrieval-Augmented Generation (RAG) solutions.

Build and optimize data infrastructure and workflows

for the ingestion, transformation, processing, and serving of structured and unstructured data for AI/ML use cases.

Develop data solutions that enable AI applications

, including data pipelines for embeddings, vector search, document processing, and RAG-based systems.

Integrate data platforms with AI/ML services and models

, ensuring data quality, reliability, scalability, and performance.

Leverage AI-assisted software development tools

to improve engineering productivity, code quality, testing, debugging, and documentation.

Collaborate with

Data Scientists, AI/ML Engineers, and Analytics teams

to translate AI and business requirements into robust and production-ready data solutions.

Establish appropriate practices for

data quality, monitoring, governance, security, and performance

across data and AI pipelines.

Preferred / Nice-to-have

Experience building

data engineering solutions for AI/ML or Generative AI applications

.

Hands-on experience with

vector databases, embeddings, semantic search, and RAG architectures

.

Familiarity with

LLM-based applications

and the data pipelines required to support them.

Experience working with

unstructured data

such as documents, text, or other content used in AI applications.

Familiarity with

AI-powered software development tools

such as GitHub Copilot, Cursor, Claude Code, or similar tools.

Understanding of

modern AI/ML engineering practices

, including model/data pipelines, evaluation, observability, and deployment workflows.

Agam

was founded in 2016 with the vision to create a cutting edge differentiated analytical platform. The execution towards this vision continued with the development of pALM, Agam’s proprietary asset and liability management (ALM) system. Offering the only end-to-end enterprise-wide risk and capital analytic solution, Agam empowers strategic decision makers towards their capital optimization goals. With a fully embedded dynamic strategic asset allocation (SAA) and enterprise risk management (ERM) infrastructure, pALM supports Agam’s ability to offer one stop, turnkey insurance solutions.