We are looking for a qualified data engineer to join our data team. You will be working on an experienced data team that is focused on data engineering, business intelligence, and advanced analysis. Your experience will complement and expand the team’s current expertise in data engineering. You will work closely with the data engineering team in refining the transformation process to support your work. You will dive deep into the various related datasets to better understand the various relationships and create first in class models.
Responsibilities:
- Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS (Amazon Web Services) data and analytics services in combination with 3rd parties - Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, Glue, Snowflake.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using SQL and Python.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Lead proof-of-concepts and then effectively transition and scale those concepts into production at scale through, engineering, deployment, and commercialization.
- Work with analytics teams using Looker, QuickSight, and Q to deliver clean, reliable datasets.