Data Engineer

  • Bids0
  • Budget $85,000

Posted on January 28, 2019

Active

Project Desciption

Wirecutter is seeking a Data Engineer to help build the infrastructure, data architecture, and pipelines that power our business.  In this role, you would report to the Engineering Manager for Data. This is a new position created as we continue to invest in the talent and support needed for our data.  

Data Engineers operate within a distributed, agile, cross-functional squad that includes a Product Manager, Engineering Manager, Project Manager, and other Data Engineers. The data squad has an organization-wide impact by providing the data to inform the user experience, product, editorial, growth, and financial decisions at Wirecutter.  The squad is responsible for the ETL processes, architecture, storage, reliability, accuracy, monitoring, and infrastructure surrounding our internal data and analytics.

Our data engineering tech stack consists of:

  • Shell & Python scripts on Linux hosted on AWS
  • Apache Airflow hosted on AWS
  • PostgreSQL Database hosted on AWS RDS
  • Google Analytics exports hosted on GCS
  • Looker BI tool
  • Github

 
You will:

  • Collaborate with your squad leaders and stakeholders on the scoping, planning, prioritization, successful execution, and rollout of complex technical projects to generate insights and addresses reporting needs.
  • Create new data models that are appropriately scalable, standardized, and reliable.
  • Evolve our current data models from production services into readily consumable formats for all downstream data consumption.
  • Help drive the optimization, testing, and tooling to improve data quality.
  • Write, debug, and test complex ETL processes for new or existing data pipelines.
  • Write and maintain database design and architecture documentation.
  • Support and maintain the integrity and security of our internal data.
  • Provide insight into changing database storage and utilization requirements.
  • Recommend solutions that best align with our product and business goals, as well as the quality, reliability, and secure storage and replication of our data.
  • Improve our development workflow and infrastructure.
  • Mentor and coach other members of your squad and the engineering team.
  • Contribute to engineering initiatives as a member of Wirecutter’s engineering team.

 
About You

  • You have 3+ years in software or data engineering and scaling large data sets.
  • You can design & optimize queries, data sets, and data pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs.
  • You understand the challenges of reliable data replication, optimizing for a data warehouse, and maintaining the integrity of a data lake.
  • You have experience reliably integrating and handling data from multiple APIs.
  • You have experience building applications at scale on any major cloud provider (AWS, GCP, etc.)
  • You are thoughtful, clear, and persuasive in writing and in person.
  • You have strong problem-solving skills and critical thinking abilities.
  • You have experience listening to business users, and can translate their needs into actionable tasks
  • You are excited to play a pivotal role in Wirecutter’s mission, innovation, and growth.
  • You are passionate and enthusiastic about what you do.
  • You have experience with version control, shell scripting, the Unix filesystem, and automating deployments.
  • Ideally, you have production experience with Python and Apache Airflow.
  • Ideally, you have experience with BI tools and managing data sets for BI tools.
  • Ideally, you have a basic understanding of statistics and sampling.
  • Ideally, you’ve worked as a member of a distributed team.

Category

Data Engineer

Employer Information

74 project(s) posted hire 2 freelancers
Member since: May 18, 2018
FREELANCER BIDDING (0)

There are no bids yet.