Systems Engineer

Systems Engineer

Job Description

[c. $250-350k Comp Package (or equivalent), Hybrid Working]

Join a leading investment firm as a Systems Engineer, contributing to a dynamic Systems team. Our client's team manages a vast distributed compute cluster, petabyte-scale storage, and low-latency trading infrastructure, alongside operating systems, automation tools, and development support. We are seeking a highly skilled engineer with expertise in Linux administration and experience with Big Data technologies, particularly Kafka, Trino, and Elasticsearch.

Key Responsibilities

• Enhance Linux trading systems (hardware, network, OS) for speed and adaptability
• Optimise large-scale distributed compute and HPC clusters
• Set up and manage Trino clusters for large-scale data analytics, optimising and troubleshooting query performance and ensuring data integrity across the system
• Design, deploy, and maintain Apache Kafka clusters, implementing and monitoring Kafka-based data pipelines to ensure efficient and reliable data flow
• Configure and maintain Elasticsearch clusters on managed compute platforms such as Kubernetes
• Develop and implement monitoring solutions to ensure high system uptime and reliability; utilise tools to detect and resolve issues proactively
• Maintain and manage a large-scale Linux-based infrastructure; ensure system stability, security, and performance through best practices in system administration
• Work closely with development and research teams to understand their requirements and provide robust data infrastructure solutions, participating in cross-functional projects as needed
• Create and maintain comprehensive documentation for system architecture, processes, and best practices

What You Bring...

• Bachelor's degree in computer science, information technology, or a related field
• 3+ years of experience in systems engineering, with a focus on Linux administration
• (Must) Linux system expertise (installation, configuration, troubleshooting)
• Expertise in designing and managing low-latency systems
• Experience with large scale, big data query engines and technologies such as Trino, Presto, Iceberg, and Hive
• Experience with operating and managing large scale Kafka clusters, including design, deployment, and capacity management
• Experience with operating and managing large scale Elasticsearch clusters
• Experience with container orchestration platforms and technologies such as Kubernetes, Terraform, and Helm
• Proficiency in scripting languages such as Python or Bash
• Strong problem-solving skills and the ability to work in a fast-paced environment
• Ability to manage multiple projects concurrently
• Experience with configuration management tools
• (Desired) Experience with Debian/Ubuntu

...

Apply for this role

All fields marked with * are required.