Job Description

• Over 8 years of IT experience
• 4+ recent years in Azure stack
• 4+ years of experience with DataOps & CI/CD practices to enable automated building, testing, and deployment of data products and applications
• 2+ years of experience in integrating with heterogenous sources using linked services.
• 2+ years of experience enabling data governance capabilities and configuration in data engineering lifecycle (data privacy, data security & compliance, and data quality)
• 2+ years integrating and nuances around maintaining GitHub and GitHub actions.
• 2+ recent years in ADF creating pipelines with several activities
• 2+ recent years of experience developing PySpark notebooks in Azure databricks cluster
• 1+ years of hardcore experience with SparkSQL
• 1+ years of relevant configuration experience in unity catalog integration and use
• Strong experience with configuration and administration of Azure data platforms (Azure Data Factory, Azure Databricks, etc)
• Provide code review and facilitate code management for engineering team to ensure best practices and performance standards
• 4 years in SDLC agile and using CI/ CD pipeline using Github actions.
• 1+ years in deployment and post deployment activities in production.

Job Tags

Similar Jobs