IN
Role: Data Engineer
Hire Type: FTE
Work Location: Bangalore (Client location)
About the Role:
We are seeking a highly motivated and experienced Data Engineer to join our team. In this critical role, you will be crucial in designing and developing a robust and scalable data architecture to support the continued growth and functionality of the system. You will ensure efficient data management and analysis, enabling data-driven decision-making and enhancing the user experience.
Responsibilities:
Designing and implementing Azure Data pipelines for handling structured/semi structured datasets, apply complex data transformation rules.
Utilizing Azure Data Factory, Azure Logic Apps, Azure Stream Analytics, Azure Data Lake, Azure SQL Server, Databricks and other Azure services for advanced data processing, analytics.
Collaborating with the architects to establish data engineering best practices and standards within the Azure ecosystem to design and develop scalable data pipelines.
Designing and developing batch and real time integration using Azure Event Hubs and Azure Functions.
Designing and developing CI/CD pipelines.
Familiarity with data modelling architectures (Kimball/Inmon) and its implementation.
Familiarity with metadata driven frameworks on cloud.
Experience with version and source control (Git) and Azure DevOps
Experience in analyzing the Data Analytics and translate it to Technical Specification.
Stay current with the latest data architecture trends and technologies and identify improvement opportunities
Monitor the health and performance of infrastructure and identify and resolve issues proactively.
Mentoring and guiding junior data engineers in Azure-specific technologies, fostering a culture of continuous learning.