Senior Data Engineer

As the second Data Engineer on the Data team, you will play an essential part in building the data infrastructure for a well-funded early-stage startup. We are looking for a data architecture enthusiast who is excited to improve the scalability of our systems and keep our tooling and operations at the cutting edge, as we are taking a data-first approach across the board. You will be building data infrastructure for both our discovery products as well as our internal cross-functional business needs. 

In this role you will:
  • Build robust pipelines across a variety of internal systems
  • Work with Spark for supporting machine learning jobs
  • Make our data warehouse ecosystem more efficient and work with a variety of data sources
  • Optimize our schemas, indexes, partitions, and bulk loading strategies
  • Integrate our data warehouse with third party tools and services

We are looking for:
  • Experience with data pipeline management tools: Luigi, Airflow or similar
  • Experience with big data technologies: Spark, Kinesis/Kafka, Hadoop/MapReduce
  • Experience with container management: Docker, Kubernetes, AWS ECS, GCP GKE
  • Experience with infrastructure tooling: Terraform
  • Experience with logging and alerting systems: NewRelic, Datadog, Sumologic 
  • Experience working with databases at scale: DynamoDB, HBase
  • Experience working within the Amazon Web Services (AWS) ecosystem
  • Experience working within the Google Cloud Provider (GCP) ecosystem
  • Strong programming experience with one or more of these languages: Python, Scala, Go.
  • Familiarity with data storage formats: CSV, Parquet, JSON, etc.

Qualifications:
  • Strong work ethic and drive to learn new skills
  • Solid programming and testing (unit, integration, load, etc.) abilities and experience
  • Appreciation for logging and alerting technologies’ role in the stack
  • Exceptional communication skills
  • Curiosity about data, especially around scaling to the needs of millions of active users

About the Company
Luminary. We are podcasts.
Luminary is a new way to listen to and discover podcasts. We are a platform and a publisher; an ecosystem and a curator. We aim to build a platform that brings together pod lovers and creators with industry-leading innovation and an unmatched listening experience. 62 million people currently listen to podcasts—a number that is growing at 20% per year. We are building a better podcast community for all.

Perks
  • Unlimited paid time-off
  • Competitive compensation
  • Competitive benefits package, including health, dental, and vision insurance
  • Competitive snacks :-)
  • Incredible opportunity for growth within the company (after all, we’re a start-up)
  • Happy work environment with a great office location in Flatiron
  • And more (ask us!)
 
Luminary is an equal opportunity employer and makes all employment decisions on the basis of job-related factors such as merit and business need. Luminary will not unlawfully discriminate based upon race, color, sex, age, national origin, religion, family status, alienage or citizenship status, sex, sexual orientation, gender identity, disability, pregnancy, childbirth, and related medical conditions, military or veteran status, genetic information or any other characteristic protected under applicable federal, state or local law.

Want to apply later?

Type your email address below to receive a reminder

Apply to Job

ErrorRequired field
ErrorRequired field
ErrorRequired field
Error
Error
insert_drive_file
insert_drive_file