Gainwell Azure Data Engineer

The Azure Data Engineer role at Gainwell in Bangalore, India is an exciting opportunity to work on cutting-edge data solutions within the healthcare technology sector. This role is ideal for someone with strong experience in Azure data services, data integration, and ETL processes.

Primary Skills Required

• Azure Data Factory (ADF): Pipeline setup, management, and automation of ETL tasks.
• SQL Programming: Proficiency in MS SQL Server (SSMS) for database operations.
• Azure Troubleshooting: Strong problem-solving skills in Azure environments.
• Testing and Validation: Ensuring data accuracy and system reliability.
• Process Efficiency: Identifying and implementing improvements.

Secondary Skills

• Log Analysis & Monitoring: Set up Azure Monitor and analyze logs for performance optimization.
• Security & Access Management: Managing access control and ensuring data security.
• Problem Solving: Conduct root cause analysis and troubleshooting.

Key Responsibilities

1. Data Pipeline Management:
   • Develop and maintain ADF pipelines for CI/CD processes across various environments (development, testing, production).
   • Optimize ETL processes for integrating data from multiple sources.
   • Track and enhance pipeline performance, ensuring continuous improvement.
2. SQL Operations:
   • Execute and optimize SQL queries for data accuracy and performance.
   • Collaborate with teams to troubleshoot and improve data operations within Azure.
3. Issue Resolution & Troubleshooting:
   • Perform root cause analysis and address performance issues like memory leaks and inefficiencies.
   • Work closely with Azure IT to resolve system errors and minimize downtime.
4. Logs & Monitoring:
   • Configure alerts and analyze logs to preemptively identify and resolve performance issues.
   • Set up monitoring for CI/CD processes to ensure robust and reliable infrastructure.
5. Testing & Validation:
   • Thoroughly test pipelines and infrastructure pre-deployment.
   • Conduct performance, regression, and functional testing in collaboration with IT teams.
6. Security & Access Management:
   • Manage access control, maintain security documentation, and coordinate with IT on data privacy protocols.
   • Ensure compliance with security protocols by setting up security levels for reports and applications.
7. Additional Responsibilities:
   • Create monthly refresh plans and maintain documentation for pipelines and processes.
   • Contribute to Azure cloud transformation strategies, focusing on governance, security, and automation.

Qualifications

• Education: Bachelor’s degree in Computer Science, IT, or a related field.
• Certifications: Azure Data Engineer Associate or similar certifications are preferred.
• Technical Skills:
  • Proficiency in Azure DevOps for CI/CD, Power BI for data visualization, and Azure services (Data Factory, Data Lake, SQL Database).
  • Working knowledge of Azure Log Analytics for system monitoring and health analysis.
• Soft Skills:
  • Strong communication skills and attention to detail.
  • Ability to work independently, prioritize tasks, and manage time effectively.

Additional Requirements

• Shift Flexibility: Ability to work evening shifts to ensure overlap with US teams for effective collaboration.
• Attention to Detail: Meticulous in monitoring and troubleshooting.