Unknown Company

Principal Engineer, Big Data Platform

Apply Now Save
san francisco, ca • Posted Yesterday
Remote Full Time IT & Technology

  • Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications
  • Build and scale data infrastructure frameworks for petabyte-scale datasets, including compute engines, job management, resource management, scheduling, and remote shuffling
  • Work with internal customers on critical business use cases relying on big data
  • Provide company-wide thought leadership on processing and storing data reliably, quickly, and efficiently at scale
  • Contribute to the team’s technical vision and long-term roadmap

Requirements

  • 12+ years of industry experience with a proven track record of technical excellence
  • 8+ years of experience building and supporting large scalable Kubernetes or big data platforms
  • Deep knowledge of big data / ML technologies, including Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow
  • Proficiency in one or more programming languages: Java, Go, Scala, or Python
  • Experience with Kubernetes and AWS technologies
  • Exceptional collaboration skills with cross-functional partners, ability to navigate ambiguity, make tradeoffs, and align stakeholders
  • Bachelor’s degree in Computer Science, a related technical field, or equivalent experience

Core Competencies

Demonstrates expertise in leading the strategy and technical direction of data infrastructure for big data and AI applications, with a strong focus on building scalable frameworks and collaborating with cross-functional teams.

Highest-signal resume keywords

  • Big Data Technologies
  • Kubernetes Platform Development
  • Data Infrastructure Frameworks
  • Programming in Java, Go, Scala, or Python
  • AWS Technologies

Hard Skills

  • Big Data
  • Machine Learning
  • Flink
  • Spark
  • Presto
  • Ray
  • PyTorch
  • TensorFlow
  • Kubernetes
  • Data Processing

Soft Skills

  • Collaboration
  • Stakeholder Alignment
  • Navigating Ambiguity
  • Tradeoff Decision-Making

Industry Keywords

  • Data Infrastructure
  • Petabyte-Scale Datasets
  • Compute Engines
  • Job Management
  • Resource Management
  • Scheduling
  • Remote Shuffling

Tools & Technologies

  • AWS

#J-18808-Ljbffr

Principal Engineer, Big Data Platform in san francisco at Unknown Company

This position is listed as full time and able to be worked remotely.

Back to Job Search