HN Jobs

Shopify | Senior Data Engineer | Waterloo, Ontario, Canada | On-site | Full-time Shopify is looking for a data engineer to join the Shopify Plus data team. You will build data pipelines, ML pipelines, and data warehouse models to help our analysts leverage the data to develop insights, and to enable the Shopify Plus organization to make key business decisions. You will tackle challenging problems, including extracting data from both internal and external sources, transforming data using Spark and Python, modeling and aggregating data at different grains, and building ML pipelines (including feature engineering, model training, and evaluation). You will also work with the larger data team, leveraging our Hadoop/Spark cluster, continuous integration/deployment, job scheduling, monitoring, and reporting tools. You’ll need to have: - Experience with data modeling, data transformation, and SQL - Experience with Apache Spark and Python - Experience with relational data stores - Strong programming skills, preferably in Python - Great team collaboration skills It’d be pretty awesome if you have: - Experience with big data stores such as Redshift and Presto - Good understanding of distributed systems and cluster environments - Experience with data analysis - Working knowledge of machine learning - Some experience with data visualization Apply here: https://jobs.lever.co/shopify/7887b412-23f7-46e9-9114-517b24...