Senior Data Engineer

Client of Talentegrity is looking for a Senior Data Engineer. Work timing will be 01:00 PM IST to 09:30 PM IST. Incumbent can work from home for this project. Work location otherwise will be Bangalore (Indira Nagar). The ideal candidate will be responsible for developing Data Engineering solutions for our clients. Taking end-to-end responsibility in the Projects. This role demands a blend of technical expertise, leadership, and client-facing skills. 6+ years of experience will be required. CTC budget : 15L - 18L/annum

Key Responsibilities:

• Design, build, and maintain data pipelines using Azure Data Factory, Databricks, Snowflake, and PySpark.
• Develop and implement data transformation and cleansing techniques to ensure data quality and reliability.
• Collaborate with cross-functional teams to define technical requirements and deliver end-to-end data solutions.
• Work closely with client technical teams to understand business objectives and provide guidance on optimal data architectures.
• Design and optimize data models and structures to support analytical and reporting needs.
• Perform advanced SQL queries for data extraction, transformation, and analysis.
• Leverage best practices for data governance, security, and documentation.
• Participate in technical discussions, client meetings, and solution design workshops to ensure alignment with client goals.
• Troubleshoot and resolve issues related to data quality, data transformation, and pipeline performance.

Skills Required

• Data Engineering Tools: Azure Data Factory, Databricks, Snowflake
• Programming Languages: Python, SQL
• Cloud Technologies: Microsoft Azure
• Data Governance and Quality:
• Data quality assessment and improvement
• Data governance practices and frameworks
• Data Visualization (Optional):
• Tools like Power BI, Tableau, or Looker for reporting and visualization
• Version Control and CI/CD:
• Git or other version control systems
• Continuous integration and deployment practices
• Communication Skills:
• Ability to communicate technical concepts to non-technical stakeholders
• Experience in client interactions and discussions with technical teams

Qualifications

• 6-8 years of experience in Data Warehousing and Data Engineering.
• Proficiency in cloud-based DWH solutions (Azure Synapse, Snowflake, Databricks).
• Strong expertise in SQL, Python, PySpark, and data integration tools like ADF.
• Proven track record in designing and implementing Data Warehousing solutions.
• Excellent communication and presentation skills.
• Demonstrated ability to lead and mentor technical teams.
• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.