Who are we?

Job Summary

We are seeking a seasoned RabbitMQ and Kafka Platform Engineer with 7+ years of experience, including a strong track record of leading end-to-end design and implementation of enterprise-grade messaging solutions. This role requires deep expertise in RabbitMQ (self-hosted), Kafka, and related technologies, along with a solid understanding of distributed systems and messaging frameworks. The ideal candidate will have demonstrated leadership in guiding engineering teams, setting technical direction, and driving the development of high-performance, scalable, and reliable communication platforms.

Responsibilities

Design and Architecture

• Architect and implement RabbitMQ solutions tailored to the organization's needs

• Develop and maintain efficient message-routing strategies, including exchanges, queues, and bindings

• Optimize RabbitMQ clusters for scalability, fault tolerance, and performance

Deployment and Management

• Deploy RabbitMQ clusters in on-premise, cloud, or hybrid environments

• Managing users and permissions, ensuring that only authorized users have access to specific queues and exchanges, and implementing security best practices

• Monitor and troubleshoot RabbitMQ nodes to ensure system health and uptime

• Implementing backup strategies for RabbitMQ data and ensuring that there are recovery plans in place in case of failures

• Keeping RabbitMQ and its dependencies up to date with the latest versions and security patches

Performance Optimization

• Analyze and resolve performance bottlenecks in message processing

• Optimize resource utilization by fine-tuning RabbitMQ configurations

• Implement caching, clustering, or sharding strategies as needed

Security and Compliance

• Implement robust authentication and authorization mechanisms (e.g., TLS, OAuth)

• Ensure RabbitMQ clusters comply with organizational security policies and best practices

• Perform regular security audits and vulnerability assessments

Collaboration and Support

• Work with developers to define messaging patterns and best practices

• Provide support and training to teams on RabbitMQ usage

• Collaborate with DevOps teams to integrate RabbitMQ into CI/CD pipelines

Monitoring and Alerting:

• Set up monitoring tools (e.g., Prometheus, Grafana) to track RabbitMQ metrics

• Implement alerting mechanisms to proactively address potential issues

Responsibilities

Kafka Infrastructure Design and Management

• Architect, deploy, and maintain Kafka clusters in on-premise and cloud environments

• Ensure high availability, scalability, and fault tolerance of the Kafka platform

• Implement and manage Kafka components, including brokers, Zookeeper, Kafka Connect, Kafka Streams, and Schema Registry

• Managing user access and permissions, ensuring that only authorized users and applications can produce or consume messages from specific topics

• Configuring data retention policies for topics, managing log segments, and ensuring that old data is cleaned up according to organizational policies

• Configure and manage Kafka topics, partitions, and replication

• Develop and implement backup and disaster recovery plan for Kafka cluster

Monitoring and Performance Optimization

• Continuously analyze system performance, troubleshoot issues, and optimize resource utilization

• Address bottlenecks in message throughput and processing

Security and Compliance

• Configure and manage Kafka security features, including encryption, authentication (SASL), and ACLs

• Ensure the Kafka environment complies with organizational and regulatory standards

Collaboration and Support

• Collaborate with development, data engineering, and DevOps teams to implement event-driven solutions

• Provide technical guidance and troubleshooting expertise for Kafka-related issues

• Maintain clear documentation for Kafka infrastructure and processes

Leadership

• Lead cross-functional teams in the architecture, deployment, and optimization of messaging solutions, ensuring alignment with enterprise-scale system requirements and business objectives

• Drive technical strategy and decision-making for messaging platforms, mentoring junior engineers and fostering best practices across development, deployment, and operations

Qualifications

• Platform Management experience in any Messaging Product like Solace etc.

• Good scripting skills ( Python, etc.)

• Working knowledge of Ansible & Automation

• Knowledge of any Cloud  is plus

• strong verbal and written communication skills

Equinix is committed to ensuring that our employment process is open to all individuals, including those with a disability.  If you are a qualified candidate and need assistance or an accommodation, please let us know by completing this form.

Equinix is an Equal Employment Opportunity and, in the U.S., an Affirmative Action employer.  All qualified applicants will receive consideration for employment without regard to unlawful consideration of race, color, religion, creed, national or ethnic origin, ancestry, place of birth, citizenship, sex, pregnancy / childbirth or related medical conditions, sexual orientation, gender identity or expression, marital or domestic partnership status, age, veteran or military status, physical or mental disability, medical condition, genetic information, political / organizational affiliation, status as a victim or family member of a victim of crime or abuse, or any other status protected by applicable law.