Senior AI Data Engineer #AIDA
Singtel · Singapore, Singapore
Full-timeonsiteseniorEngineeringTechnology
รายละเอียดงาน / Description
Based in Singapore, this role involves designing, building, and operating scalable data ingestion and transformation pipelines within a modern hybrid cloud environment. As part of the Artificial Intelligence and Data Analytics team, you will implement retrieval-augmented generation architectures and knowledge bases to power generative AI applications. You will also collaborate cross-functionally to ensure high standards of data governance, system resilience, and continuous platform optimization across the enterprise.
หน้าที่ความรับผิดชอบ / Responsibilities
- Design, build, and optimize high-throughput batch and streaming data pipelines using modern cloud platforms.
- Implement and maintain enterprise knowledge bases and retrieval-augmented generation (RAG) frameworks for GenAI.
- Perform complex data transformation, cleansing, and validation using PySpark and SQL.
- Provide technical mentorship to engineering colleagues and collaborate with partners on platform design standards.
- Lead data integration efforts across diverse source systems, APIs, files, and streaming platforms.
- Oversee platform observability, incident triage, deployment automation, and production readiness.
คุณสมบัติ / Qualifications
- Bachelor's degree in Computer Science, Engineering, or a related technical discipline.
- 5 to 8 years of data engineering or cloud analytics platform experience managing production pipelines.
- Demonstrated expertise in building and operating scalable batch and streaming workflows.
- Strong hands-on proficiency in Python, SQL, and Apache Spark/PySpark.
- Experience implementing knowledge base architectures and RAG solutions for agentic AI applications.
- Solid understanding of cloud security, data governance, access controls, and CI/CD operations.
ทักษะที่ต้องการ / Required skills
- Python
- SQL
- PySpark
- Databricks
- Apache Kafka
- RAG
- Data Pipelines
- CI/CD
- Data Architecture
- Cloud Security
ทักษะเพิ่มเติม / Nice to have
- Microsoft Fabric
- Delta Lake
- Vector Databases
- Generative AI