Infrastructure/ Platform Engineer Apache

Role Title: Infrastructure/ Platform Engineer - Apache Duration: 9 Months Location: Remote Rate: - Umbrella onlyWould you like to join a global leader in consulting, technology services and digital transformation?Our client is at the forefront of innovation to address the entire breadth of opportunities in the evolving world of cloud, digital and platforms.Role purpose / summary? Refactor prototype Spark jobs into production-quality components, ensuring scalability, test coverage, and integration readiness. ? Package Spark workloads for deployment via Docker/Kubernetes and integrate with orchestration systems (e.g., Airflow, custom schedulers). ? Work with platform engineers to embed Spark jobs into InfoSum''s platform APIs and data pipelines. ? Troubleshoot job failures, memory and resource issues, and execution anomalies across various runtime environments. ? Optimize Spark job performance and advise on best practices to reduce cloud compute and storage costs. ? Guide engineering teams on choosing the right execution strategies across AWS, GCP, and Azure. ? Provide subject matter expertise on using AWS Glue for ETL workloads and integration with S3 and other AWS-native services. ? Implement observability tooling for logs, metrics, and error handling to support monitoring and incident response. ? Align implementations with InfoSum''s privacy, security, and compliance practices. Required Skills and Experience: ? Proven experience with Apache Spark (Scala, Java, or PySpark), ..... full job details .....