Data Engineer – Dynamics Data – Full Remote
Job Description
We are looking for a skilled Data Engineer to design, build, and optimize the data pipelines that transform Dynamics (CRM/ERP) data into actionable business insights. Your expertise will ensure that raw data is efficiently processed, stored, and made available for KPI-driven reporting, empowering stakeholders with reliable, real-time analytics.
This role focuses on the data engineering foundation—architecting scalable data flows, implementing best practices in ETL/ELT processes, and ensuring high data quality—while collaborating with analytics teams to support their reporting needs.
Key Responsibilities
- Design & Build Data Pipelines – Develop robust ETL/ELT workflows to extract Dynamics data, transform it efficiently, and load it into structured databases for reporting.
- Optimize Data Processing – Use PySpark within Databricks to handle large-scale data transformations with performance and reliability.
- Orchestrate Data Workflows – Implement and manage pipelines in Azure Data Factory (ADF) to automate data movement and processing.
- Database Management – Structure and maintain data in Azure SQL DB / MSSQL, ensuring optimal storage, indexing, and accessibility for analytics.
- Data Quality & Monitoring – Implement validation checks, logging, and alerting to maintain data integrity across the pipeline.
- Collaborate with Analytics Teams – Work alongside BI developers and data analysts to ensure data models align with reporting requirements.
Technologies needed
- Data Processing: Databricks, PySpark
- Data Orchestration: Azure Data Factory (ADF)
- Databases: Azure SQL DB, MSSQL
- Source Data: Microsoft Dynamics (CRM/ERP)
English: C1 or above (High level).