Hybrid
Description:
The client is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics, ensuring data accessibility, performance, and security for the Child Welfare Program.
The client requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. The primary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
Synapse
Design, Develop and maintain data models in Synapse to support reporting and analytics
Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
Analyze the source system and design the ETL data load.
Ability to create and configure Azure Synapse Analytics workspace.
Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like SalesForce.
Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
Power BI Tools
Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.
Required/Desired Skills:
Skill - Required / Desired - Amount of Experience
Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows - Required - 5 Years
Programming Languages: Strong proficiency in Python or Scala for data processing. - Required - 3 Years
SQL Mastery: Advanced query writing, performance tuning, and optimization. - Required - 7 Years
Experience with Data Modeling and Warehousing (star schema, snowflake schema) - Required - 4 Years
Experience with ETL/ELT processes - Required - 5 Years
Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) - Highly desired - 4 Years
Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions - Desired - 4 Years
Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) - Desired - 1 Years
Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage - Desired - 5 Years
Experience with Power BI - Nice to have - 1 Years
Notes:
Hybrid
VIVA is an equal opportunity employer. All qualified applicants have an equal opportunity for placement, and all employees have an equal opportunity to develop on the job. This means that VIVA will not discriminate against any employee or qualified applicant on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status