Lead Data Engineer
Who are we?
Equinix is the world’s digital infrastructure company, operating 210 data centers across the globe and providing interconnections to all the key clouds and networks. Businesses need one place to simplify and bring together fragmented, complex infrastructure that spans private and public cloud environments. Our global platform allows customers to place infrastructure wherever they need it and connect it to everything they need to succeed.
At Equinix, we help the world’s digital leaders scale with agility, speed the launch of digital services, deliver world-class experiences, and transform people’s lives. Our culture is based on collaboration and the growth and development of our teams.
We hire hardworking people who thrive on solving challenging problems and give them opportunities to hone new skills, and try new approaches, as we grow our product portfolio with new software and network architecture solutions. We embrace diversity in thought and contribution and are committed to providing an equitable work environment. that is foundational to our core values as a company and is vital to our success.
As a key member of the Data Research @ Equinix using AI/ML (DREAM) team, you will be responsible for end to end development of Data Analytics use cases, Equinix Data Lake platform and tools. The role must be hands on and will be willingness to work as DevOps model.
The role is for a self-motivated individual with software engineering skills and expertise with Big Data technologies. The candidate will be extensively involved in hands-on activities including POCs, design, documentation, development, and test of new functionality. Candidate must be agile and flexible with changing priorities based on team’s needs.
What You’ll Do:
Massive data: You will source / examine, analyze, engineer data pipelines for gigabytes/terabytes of structured and unstructured data with our platform to create value for customers.
Pushing the limits: This role will be on the cutting edge of our Data / Machine Learning platform. As we push to solve more of our customer challenges, you will be prototyping new features, tools and ideas. Innovate at a very fast pace to maintain our competitive edge.
Linux hacking: You will be masterfully using the command line, including tools like vi/emacs and understanding beyond basics of grep, bash, awk, sed, etc to aggressively dive into data, systems, and compute platforms to get the results you are seeking.
Production deployment: You will be responsible for integration and deployment of the machine learning pipelines into production where your ideas can come to life.
Coordinate and work with cross functional teams, sometimes located at different geo locations.
What you have done:
Commercial software engineering: You have 10+ years of professional software development experience with languages and systems such as Java, Python (PySpark), and version control (git), with good analytical & debugging skills.
Big data: You have extensive experience with data analytics and working knowledge of big data infrastructure such as Hadoop Eco System, HDFS, Spark, Google Cloud, Big Query, Data Flow. You've routinely built data pipelines with gigabytes/terabytes of data and understand the challenges of manipulating such large datasets for ML use cases.
Data Modeling: Flair for data, schema, data model, PL/SQL, Star & snowflake schema, how to bring efficiency in data modeling for efficient querying data for analysis, understands criticality TDD and develops data validation techniques.
Cross Functional knowledge in ERP/CRM and other enterprise applications
Real Time Systems: Understands evolution of databases for in-memory, NoSQL & indexing technologies along with experience on real-time & stream processing systems like Kafka, Storm, pub sub, Spark Streaming.
Strong design skills: with a proven track record of success on large/highly complex projects preferably in the area of Enterprise Apps and Integration.
Project management: You demonstrate excellent project and time management skills, exposure to scrum or other agile practices in JIRA.
Excellent verbal and written communication skills: Must be able to effectively communicate & work with fellow team members and other functional team members to coordinate & meet deliverables.
CS fundamentals: You have earned at least a B.S. / MS in Computer Science, or related degree AND you have a strong ethos of continuous learning.
Equal Employment Opportunity:
Equinix is an Equal Employment Opportunity and Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex, sexual orientation, gender identity, age, status as a protected veteran, or status as a qualified individual with disability.
Please click here to see the “EEO is the Law” poster and supplement.
Please click here to see our EEO Policy Statement.
Please click here to see our Pay Transparency Policy Statement.
You can change your cookie preferences within your browser settings at any time.
To find out more about our policy, please click here.