Title: Senior Data Engineer V
Contract Duration: 12 Months
Role: Remote
Job Description:
The Enterprise Data Platform team is seeking a Senior Data Engineer to design and implement data pipelines for our cloud data warehouse. In this role, you will collaborate with cross-functional stakeholders to understand and gather data requirements, ensuring that our data architecture meets organizational needs.
Key Responsibilities:
- Collaborate with stakeholders to collect and analyze data requirements.
- Develop and maintain data pipelines using Python to ingest data into Snowflake.
- Extract data from REST APIs and transform it for cloud data warehouse integration.
- Work with S3 buckets for data storage and management.
- Write and manage directed acyclic graphs (DAGs) using Airflow.
- Ensure data quality, integrity, and performance throughout the data lifecycle.
- Stay current with industry trends and best practices in data engineering.
Required Skills:
- Strong proficiency in Python and SQL.
- Proven experience in building and optimizing data pipelines.
- Experience with REST APIs and cloud data warehousing solutions.
- Familiarity with AWS S3 and data storage practices.
- Knowledge of Apache Airflow for workflow management.
- Ability to work collaboratively in a team-oriented environment.
Qualifications:
- Bachelor's degree in Computer Science, Data Science, or a related field.
- 5+ years of experience in data engineering or a similar role.