Job ID: NC-777857 (99291028)
Hybrid/Local Data Engineer (15+) with PL/SQL, DB2, ETL, Python/Scala, AWS/Azure Data Factory/Data Lake/Synapse/Databricks, Cloud, Power BI experience
Location: Raleigh, NC (NCDHHS-NCFAST)
Duration: 12 Months
Position: 1 (1)
Skills:
Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows Required 3 Years
Programming Languages: Strong proficiency in Python or Scala for data processing. Required 3 Years
SQL Mastery: Advanced query writing, performance tuning, and optimization. Required 5 Years
Hands-on experience in developing efficient PL/SQL procedures Required 5 Years
Experience with Programming and Scripting (SQL, T-SQL, and data query optimization) Required 1 Years
Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database) Highly desired 1 Years
Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage Highly desired 1 Years
Experience with Power BI Nice to have 1 Years
Description:
DHHS-ITD is seeking a Data Engineer for development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics and Power BI for the Child Welfare Program.
The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Data Engineer for the development and optimization of data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.
Key Responsibilities:
Synapse
Design, Develop and maintain data models in Synapse to support reporting and analytics
Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
Analyze the source system and design the ETL data load.
Ability to create and configure Azure Synapse Analytics workspace.
Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like Salesforce.
Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
Power BI Tools
Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.