Job ID: NC-814296 (911091125)
Hybrid/Local Gen AI Developer ((AI-102/AWS ML Specialty/GCP ML/SC-100/15+)) with Azure/AWS/GCP, LLM/LangChain/Semantic Kernel/LangGraph, RAG pipelines, Pinecone/Weaviate/Milvus/FAISS, SQL, NoSQL/MongoDB/Cosmos DB/DynamoDB, Agile/Scrum/Kanban/SAFe, FastAPI/Node.js, Databricks/HuggingFace, Promptflow/Ragas experience
Location: Raleigh, NC (NCDHHS-NCFAST)
Duration: 12 Months
Skills:
Hands-on experience in applied machine learning or Generative AI development. Required 3 Years
Experience working with a major cloud platform (Azure, AWS, or GCP). Required 3 Years
Python development, including experience with LLM frameworks (LangChain, Semantic Kernel, LangGraph). Required 3 Years
Experience building RAG pipelines or LLM-driven applications. Required 2 Years
Experience with vector databases (Pinecone, Weaviate, Milvus, FAISS) and retrieval optimization. Required 2 Years
SQL experience including data modeling, transformations, and performance tuning Required 5 Years
Experience with NoSQL/document databases (MongoDB, Cosmos DB, DynamoDB). Required 2 Years
Experience implementing AI security controls such as encryption, RBAC, API security, and secret management. Required 2 Years
Experience applying Responsible AI principles including bias testing, hallucination mitigation, and privacy safeguards. Required 2 Years
Experience building and integrating microservices using FastAPI, Node.js, or Azure Functions. Required 5 Years
Experience with Agile (Scrum, Kanban, or SAFe) development. Required 3 Years
Ability to organize, prioritize, and follow complex and/or detailed technical procedures. Required 3 Years
Experience with Azure AI Search, Azure Machine Learning, Databricks, or HuggingFace. Desired 2 Years
Familiarity with Promptflow, Ragas, or similar automated evaluation tools. Desired 2 Years
Experience designing supervised finetuning workflows or LoRA-based training pipelines. Desired 2 Years
Familiarity with enterprise governance tools such as Microsoft Purview or similar compliance platforms. Desired 2 Years
Certifications such as Azure AI-102, AWS ML Specialty, GCP ML Engineer, SC-100, or Responsible AI coursework. Desired 2 Years
Description:
NC DHHS requires the services of a Senior Generative AI Developer responsible for designing, developing, and deploying production-grade Artificial Intelligence solutions leveraging LLMs, RAG, fine-tuning techniques, and secure enterprise data systems.
NC DHHS requires the services of a Senior Generative AI Developer who is responsible for designing, developing, and deploying production-grade Artificial Intelligence solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), fine-tuning techniques, and secure enterprise data systems. The role requires strong technical skills in Python, cloud-native development, data engineering, and the integration of structured and unstructured databases into AI systems. The developer ensures all AI solutions adhere to organizational standards for security, privacy, compliance, and Responsible AI principles. This position collaborates with engineering, security, data, product, and governance teams to advance scalable, ethical, and secure AI adoption across the organization.
The key responsibilities for this position will include the following:
· Build and deploy LLM-driven features, prompts, and agent workflows.
· Customize models using fine-tuning and adapter techniques.
· Develop RAG pipelines using vector, SQL, and NoSQL databases.
· Manage secure ingestion of enterprise content with proper metadata and PII protection.
· Use relational, NoSQL, and vector databases to support AI workloads.
· Apply performance tuning, access control, encryption, and compliant data handling.
· Implement AI safety controls and secure model access.
· Ensure Responsible AI practices include bias, fairness, and privacy reviews.
· Build secure, scalable microservices to integrate AI features into applications.
· Implement best practices for reliability, error handling, and observability.
· Maintain CI/CD pipelines for models and AI services.
· Monitor performance, cost, and drift.
Support documentation and audit readiness.
