Principal Data Platform Engineer



Software Engineering
Cambridge, MA, USA
Posted on Wednesday, February 1, 2023

Who we are
At CarGurus (NASDAQ: CARG), our mission is to give people the power to reach their destination. We started as a small team of developers determined to bring trust and transparency to car shopping. Since then, our history of innovation and go-to-market acceleration has driven industry-leading growth. In fact, we’re the largest and fastest-growing automotive marketplace, and we’ve been profitable for over 15 years.

What we do
The market is evolving, and we are too, moving the entire automotive journey online and guiding our customers through every step. That includes everything from the sale of an old car to the financing, purchase, and delivery of a new one. Today, tens of millions of consumers visit each month, and ~30,000 dealerships use our products. But they're not the only ones who love CarGurus—our employees do, too. We have a people-first culture that fosters kindness, collaboration, and innovation, and empowers our Gurus with tools to fuel their career growth. Disrupting a trillion-dollar industry requires fresh and diverse perspectives. Come join us for the ride!

Role overview

The Data Engineering team is looking for a highly motivated Principal Data Pipeline Engineer to evolve our modern data warehousing platform to world-class levels! As CarGurus enters the next phase of dramatic growth with new data sources, new business lines, and business acquisitions, we are looking for a candidate who is interested in revamping how we do data at the company. You will act as a technical mentor for the other data engineers in the team.

What you'll do

  • Gain a deep understanding of our evolving data and analytics stack and provide guidance in enhancing those
  • Define and drive tactical decisions around Data Platform domain while providing input into larger strategic decisions around data infrastructure, data quality, data observability, and data governance
  • Build robust and scalable data integration (ETL/ELT) pipelines using Python, SQL and Airflow
  • Build and deliver high quality data architecture to support our team of Analytics Engineers, Data Analysts, Data Scientists, and various stakeholders throughout the company
  • Be a technical mentor to other data and sr data engineers and expose the team to new technologies and techniques
  • Maintain the data infrastructure layer using IaaS and keep enhancing the framework.

What you'll bring

  • 7+ years of experience in data engineering, designing and building scalable and reliable data pipelines and infrastructure
  • Extensive knowledge in programming languages like Python
  • Advanced knowledge of SQL, Snowflake preferred
  • Expert in system architecture – with the ability to understand the context of a business need and build a system that addresses it
  • 3+ years experience with cloud-based data platforms like AWS or GCP
  • Excellent problem-solving and communication skills, and ability to work collaboratively with cross-functional teams including product managers, data scientists, and software engineers
  • Proficient with data streaming frameworks like Kafka or Kinesis
  • Extensive knowledge of working with workflow management tools like Airflow.
  • Proficiency in performance tuning the ETLs/ELTs and database solutions for large data sets
  • Extensive knowledge in data governance.
  • Proficiency with modern Agile development methodologies.
  • Extensive experience in requirement gathering, analysis, design, code review, and unit and integration testing
  • Deliver maintenance and improvements for existing applications.
  • The ability to be an exceptional team player, act as a technical mentor, interested in sharing knowledge with other team members, and passionate about learning new technologies
  • Experience on managing and maintaining the data infrastructure with the use of Terraform, Cloudform, Ansible or other tools.
  • Experience in building monitoring and alerting techniques.

Nice to have

  • Experience in managing and maintaining warehouses in Snowflake.
  • Experience working with NoSQL databases.
  • Worked building event driven streaming pipelines.
  • Familiarity with dbt.

Working at CarGurus
We reward our Gurus’ curiosity and passion with best-in-class benefits and compensation, including equity for all employees, both when they start and as they continue to grow with us. Our career development and corporate giving programs, as well as our employee resource groups (ERGs) and communities, help people build connections while making an impact in personally meaningful ways. A flexible hybrid model and robust time off policies encourage work-life balance and individual well-being. Thoughtful perks like daily free lunch, a new car discount, meditation and fitness apps, commuting cost coverage, and more help our people create space for what matters most in their personal and professional lives.

We welcome all
CarGurus strives to be a place to which people can bring the ultimate expression of themselves and their potential—starting with our hiring process. We do not discriminate based on race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, or sexual orientation. We foster an inclusive environment that values people for their skills, experiences, and unique perspectives. That’s why we hope you’ll apply even if you don’t check every box listed in the job description. We want to know what only you can bring to CarGurus.