Senior Data Engineer

Location: San Francisco, CA

Req #200154

Would you like to help people find the best doctor -- one that is in their network, knows how to treat their condition, is high quality, has good reviews, is affordable and is located nearby? If so, please consider working on the Care Guidance team at Castlight. We are devoted to helping people navigate the complex healthcare benefits available to them and steering them to the best choices.

We are looking for an experienced Senior Data Engineer who is a solid problem solver with a passion for innovation to join our Provider Directory data engineering team. You must be comfortable dealing with large sets of imperfect data and designing components to process it. You will be working in the context of a complex set of systems within a multi-tier enterprise architecture. As our data volume expands, you will apply your deep knowledge of performance, scalability, and optimization to make appropriate recommendations, as well as to help materialize them.

To succeed in this role, you'll need to be a versatile engineer. You must have an innate desire to build things the right way.  You should be averse to manual processes -- if some system isn't as streamlined as it could be, you want to fix it! You want to accelerate your career growth by taking on a role that will give you deep knowledge of a complex system, acting as the gatekeeper of the results. Finally, you should want to communicate and collaborate with a team of smart people just like you.


  • Lead development efforts to build a completely automated pipeline to process existing sources, ingest new sources, and transform all into the format our application expects
  • Provide architectural and technical leadership to improve and scale our existing ETL capabilities
  • Enjoy working in a collaborative engineering team, analyzing data, writing code and validating the resulting data
  • Participate in design discussions, sizing exercises, and code reviews


  • BS or MS in Engineering or Computer Science, or related technical field
  • 5+ years of experience in production software development, preferably in a SaaS environment
  • Experience handling complex data sources and large scale batch data infrastructure
  • Proficiency in writing SQL queries, performance tuning, and data analysis
  • Proficiency in Python, or another object-oriented programming language such as Ruby or Java
  • Knowledge of PostgreSQL and Greenplum a plus

Our Values

One team. On a mission. Making things happen.

Diversity and Inclusion

The Castlight culture values and celebrates different backgrounds, perspectives, and points of view. We believe our diversity helps drive creativity and innovation. We strive to make everyone feel included, valued, and engaged; enable them to do their best work; and build their careers here at Castlight. That is why diversity and inclusion are more than just words to us. Rather, they are a commitment to a culture where employees feel respected and empowered to share their ideas and deliver the best results.

Learn more about our continuing commitment to diversity and inclusion.

About Castlight

Castlight is on a mission to make it as easy as humanly possible to navigate healthcare and live happier, healthier, more productive lives. Our health navigation platform connects with hundreds of health vendors, benefits resources, and plan designs, giving rise to the world’s first comprehensive app for all health needs. We guide individuals—based on their unique profile—to the best resources available to them, whether they are healthy, chronically ill, or actively seeking medical care. In doing so, we help companies regain control over rising healthcare costs and get more value from their benefits investments. Castlight revolutionized the healthcare sector with the introduction of data-driven price transparency tools in 2008 and the first consumer-grade wellbeing platform in 2012. Today, Castlight serves as the health navigation platform for millions of people and is a trusted partner to many of the largest employers in the world. We are headquartered in San Francisco, and can be found online at and on the New York Stock Exchange as CSLT.

Castlight Health provides equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, pregnancy, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, Castlight Health will provide reasonable accommodations for qualified individuals with disabilities.

Castlight Health does not accept unsolicited assistance from recruitment search firms for employment opportunities. All resumes submitted by search firms to any employee at Castlight Health via email, the Internet or in any form and/or method without a signed search agreement on Castlight’s form in place ahead of time will be deemed the sole property of Castlight Health. In such cases, no fee will be paid or payable in the event the candidate is hired by Castlight as a result of the submission.