System Engineer

We are seeking a highly skilled engineer with expertise in Linux administration and experience with Big Data technologies, particularly Kafka, Trino, and Elasticsearch. As a Big Data Systems Engineer, you will play a critical role in ensuring our data infrastructure is robust, scalable, and reliable. You will work closely with our engineering and research teams to design, deploy, and maintain systems that support our research and trading activities.ResponsibilitiesTrino Administration: Set up and manage Trino clusters for large-scale data analytics. Optimize and troubleshoot query performance and ensure data integrity across the systemKafka Administration: Design, deploy, and maintain Apache Kafka clusters. Implement and monitor Kafka-based data pipelines to ensure efficient and reliable data flowElasticsearch Administration: Configure and maintain Elasticsearch clusters on managed compute platforms such as KubernetesSystem Monitoring: Develop and implement monitoring solutions to ensure high system uptime and reliability; utilize tools to detect and resolve issues proactivelyLinux Administration: Maintain and manage a large-scale Linux-based infrastructure; ensure system stability, security, and performance through best practices in system administrationCollaboration: Work closely with development and research teams to understand their requirements and provide robust data infrastructure solutions, participating in cross-functional projects as neededDocumentation: Create and maintain comprehensive documentation for system architecture, processes, and best practicesSkillsBachelor's degree in computer science, information technology, or a related fieldMinimum of 3-5 years of experience in systems engineering, with a focus on Linux administrationExperience with large scale, big data query engines and technologies such as Trino, Presto, Iceberg, and HiveExperience with operating and managing large scale Kafka clusters, including design, deployment, and capacity managementExperience with operating and managing large scale Elasticsearch clustersExperience with container orchestration platforms and technologies such as Kubernetes, Terraform, and HelmProficiency in scripting languages such as Python or BashStrong problem-solving skills and the ability to work in a fast-paced environmentExcellent communication and collaboration skills