The Senior Data Engineer - Data Platform will be passionate about all things data, loading large datasets, faster and utilize the latest cloud technology to do so. The Senior Data Engineer will be intimately familiar with Amazon Web Services, Google Cloud Platform as well as other global cloud service providers. This candidate should have strong experience with large ETL projects, evidence of experience with cloud/modern ELT architecture, Data Lake and more.
Familiar with Data Virtualization Technology
Build robust, scalable data integration (ETL) pipelines using SQL, Integration Services, Python, Spark, many others.
Work directly with business teams to extract, transform, and load data from a wide variety of data sources using SQL and other technology
Knowledge of Master Data Management specific to ETL processes.
Improve ongoing reporting and analysis processes through automation, scale and best practice
Implement data structures using best practices in data modeling, ETL/ELT processes, and SQL, as well as other technology
Passion for data in all shapes and forms
The duties and responsibilities described above may provide only a partial description of this position. This is not an exhaustive list of all aspects of the job. Other duties and responsibilities not outlined in this document may be added as necessary or desirable, with or without notice.
Knowledge, Skills and Abilities:
SQL Database and SQL Server
Knowledge of Kubernetes, Big Query, Snowflake, Redshift, Spark, Kafka, batch and Streaming data, Timeseries
Understanding of ETL, ELT, Informatica, AWS Glue, Google Cloud Dataprep,Trifacta and other tools as use case dictates.
Attending daily sprint meetings
Working closely with PM and other upstream source system teams to address production issues.
Understanding of eCommerce, global scale networks and cloud architecture
7-10+ years of Data Platform expertise
Some form of formal education (boot camp) in Computer Science, Software Development, Database or related technologies
Bachelor's Degree in Computer Science is highly preferred.