Job ID: NC-758028 (911091002)
Hybrid/Local Synapse Data Engineer (15+) with Azure Data Factory/Data Lake/SQL Server, Stream Analytics/Functions, ETL/ELT, DW, Event Hubs, Salesforce, MuleSoft, Informatica, DevOps, CI/CD, Git, laC, SOAP and Power BI experience
Location: Raleigh, NC (NCDHHS-NCFAST)
Duration: 6 Months
Position: 1 (2)
Skills:
Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 5 Years
Programming Languages: Strong proficiency in Python or Scala for data processing. Required 3 Years
SQL Mastery: Advanced query writing, performance tuning, and optimization. Required 7 Years
Experience with Data Modeling and Warehousing (star schema, snowflake schema) Required 4 Years
Experience with ETL/ELT processes Required 5 Years
Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) Highly desired 4 Years
Familiarity with Event Hubs, Azure Stream Analytics, and Azure Functions Desired 4 Years
Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) Desired 1 Years
Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage Desired 5 Years
Experience with Power BI Nice to have 1 Years
Description:
DHHS-ITD is seeking a Senior Data Engineer to lead the development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics, ensuring data accessibility, performance, and security for the Child Welfare Program.
The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Senior Synapse Data Engineer. The primary purpose of this position is to lead the development and optimization of our data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
Synapse
Design, Develop and maintain data models in Synapse to support reporting and analytics
Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
Analyze the source system and design the ETL data load.
Ability to create and configure Azure Synapse Analytics workspace.
Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like SalesForce.
Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
Power BI Tools
Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.