REMOTE!!! Sr Data Engineer - $150k-$175k + Equity + Unlimited PTO!

San Francisco US

Job Details

  • Managed by

    Joseph Jeske

  • Job Type

    Full Time

  • Compensation


About Us:

My Client is a data-as-a-service company and a leading provider of population movement data to data science and analyst teams at Fortune 10s, cutting edge startups, nonprofits, and everything in between. Our purpose is to fuel innovation by providing easy, safe access to data.

They are hiring a Senior Data Engineer - AWS, Python to bring their expertise, desire to build, and strong technical skills to our engineering team.

What you'll do:

  • Improve production workflows by creating and incorporating new features
  • Develop a deep understanding of Veraset's data and our massive geospatial data pipeline
  • Deep-dive into the infrastructure underlying our data pipeline: Spark, AWS, Databricks, and Airflow. Know the internals of these technologies. Develop fluency in Terraform, ECS, serverless apps in AWS, serverless databases, and Kubernetes
  • Develop subject matter expertise in geospatial data analytics. Prototype open source software and the latest geospatial libraries such as Apache Sedona (geospark) and Geomasa, and demonstrate how they can be utilized in our future product pipeline
  • Participate in the scoping and development of the next generation of our product
  • Oversee (as a part of the team) the daily production deliveries and historical data sharing
  • Innovate new exciting data products and technologies

What you Need:

  • Production experience in Spark, with either Python or Scala
  • You understand the tradeoffs between different types of databases and storage options
  • Experience designing production environments
  • 3+ years experience in a software engineering role
  • Experience in Cloud Architecture, ideally AWS. Experience in cloud administration, cost management, and cloud security
  • Experience contributing to a best-in-class engineering culture and process: version control, CI/CD, Code Reviews, QA/QC, Production engineering
  • You have written Spark jobs and have experience working with distributed data pipelines. Bonus if you have written Spark jobs in scala
  • You have written software designed to run in the cloud

What's in it for you:

  • Competitive Salary $150K-$175K
  • Equity
  • Unlimited PTO
  • Comprehensive Benefits
  • Yearly educational Stipend
  • Quarterly retreats

So, If you are a data engineer with a desire to work with an exciting fast paced work environment apply today!

Easy Apply Now!

Upload your resume (pdf, doc, docx)

I agree to the Terms of Use and Privacy Policy