Overview
The Senior Data Engineer position will be responsible for designing and developing data streaming architectures that leverage microservice and message-oriented integration patterns and practices within AWS cloud native technologies.
Responsibilities
- Scale company’s data ingestion pipelines to support client reporting as well as internal analytics and operational teams;
- Work with senior leadership, architects, engineers, data analysts, product managers and cloud infrastructure teams to deliver new features and capabilities;
- Write clean, robust, and well thought out code with an emphasis on quality, performance, scalability, and maintainability as needed; and
- Maintain strong end-to-end ownership and craftsmanship, including conducting the analysis, design, coding, testing, debugging, and deployment of code.
- 100% remote work allowed.
Qualifications
- Requires a Master’s degree (or foreign equivalent) in Project Management, or a related field;
- 1 year of experience as a Database Engineer or a related occupation;
- Experience designing, developing, and supporting data pipelines, warehouses, and reporting systems;
- Experience creating extract, transform, and load (ETLs) and reporting systems for new data;
- Experience collaborating with internal stakeholders;
- Experience supporting engineers to develop new solutions for evolving product and customer;
- Experience supporting and maintaining data platform infrastructure (Tech stack – Python, AWS, Redshift, Airflow, DBT, Superset, GIT, and Kubernetes);
- Experience debugging data issues and optimizing performance;
- Experience clearly communicating technical concepts to non-technical stakeholders;
- Experience drafting documentation and making presentations;
- Experience ensuring data integrity and precision in data engineering tasks; and
- Experience using: SQL, Cloud/VM Infrastructure, Agile Methodology (Scrum/Kanban), and Version Control Systems.
