Job Snapshot
Job Summary
- Design and implement infrastructure to automate log ingestion across varied internal and external sources
- Develop and maintain custom applications/scripts (Python/Golang) to retrieve, process, and ingest logs
- Ensure reliability, performance, and scalability of log ingestion pipelines across AWS
We are seeking a DevSecOps Engineer to join a high-impact Security and Automation team to build and scale systems that enable secure, automated log ingestion across the organization. You'll design and develop high-performance solutions to automate log collection, enhance monitoring, and streamline connectivity across AWS environments. This is a long-term, business-critical initiative with no defined end date.
This role sits within an Automation sub-team that collaborates closely with the broader Security and Platform Engineering teams. It’s ideal for someone with a strong software engineering background and a passion for infrastructure, cloud, and problem-solving in production environments.
Key Responsibilities:
- Design and implement infrastructure to automate log ingestion across varied internal and external sources
- Develop and maintain custom applications/scripts (Python/Golang) to retrieve, process, and ingest logs
- Ensure reliability, performance, and scalability of log ingestion pipelines across AWS
- Set up and manage infrastructure components (e.g., VMs, APIs) for ingestion based on different integration methods
- Provision infrastructure using Terraform (IaC)
- Monitor pipelines, detect missing/incomplete logs, and debug pipeline or source-related issues (on-call support included)
- Collaborate with stakeholders to understand logging requirements, ingestion frequency, and system behavior
- Document ingestion processes and maintain transparency across engineering and security teams
- Support and enhance CI/CD workflows in alignment with DevOps best practices
- Apply ETL and data modeling best practices to structure and manage ingested data
Qualifications & Experience:
- Hands-on experience in AWS (setup, configuration, connectivity, and security)
- Familiarity with CI/CD tools and DevOps principles
- Strong coding background in Python or Golang
- Experience with Terraform and infrastructure-as-code concepts
- Experience in ETL processes and data modelling
- Solid understanding of system design and performance optimization
- Excellent communicator, able to collaborate cross-functionally and document systems clearly
- Comfortable troubleshooting distributed systems and providing on-call operational support
- Nice to have: Security knowledge or prior experience working on security-oriented automation or infrastructure projects
We regret to inform that only shortlisted candidates will be notified.
Job Reference: Ivory lee / JN -042025-47778
EA Registration No.: R22110493, Ivory lee Hong
Allegis Group Singapore Pte Ltd, Company Reg No. 200909448N, EA License No. 10C4544