Senior Data Engineer - Microsoft Fabric
Full-time
Praesignis
Job Description
- We are looking for an experienced Senior Data Engineer with strong hands-on experience in Microsoft Fabric, data engineering and software development. The successful candidate must be comfortable writing code and have practical programming experience using C# and Python.
- The candidate must have a strong understanding of modern data engineering principles and be able to design, develop, optimise and support scalable data solutions using Microsoft Fabric.
Responsibilities
- Design, develop and maintain modern data engineering solutions using Microsoft Fabric.
- Develop and maintain data ingestion, transformation and integration pipelines.
- Work with OneLake, Lakehouse and Fabric Warehouse.
- Develop and optimise Data Pipelines and Dataflows Gen2.
- Write and maintain production-quality code using Python and C#.
- Develop and maintain Shell scripts to automate data processing, file transfers, job scheduling and operational tasks.
- Use SQL and, where applicable, PySpark/Spark for data processing and transformation.
- Develop data models and support Power BI and semantic models.
- Monitor, troubleshoot and optimise data pipelines and data workloads.
- Investigate and resolve data quality, performance and integration issues.
- Ensure data solutions are reliable, scalable, secure and fit for purpose.
- Translate business requirements into technical data solutions.
- Collaborate with Data Engineers, BI Developers, Architects and business stakeholders.
- Support the implementation of best practices across data engineering, development and deployment.
Requirements
- 5+ years' experience in Data Engineering or a related technical data role.
- 3+ years' strong hands-on experience with Microsoft Fabric.
- Valid Microsoft Certified: Fabric Data Engineer Associate (DP-700) certification – Essential.
- Strong programming and software development experience.
- Proven hands-on experience writing code using C# and Python.
- Hands-on experience with Shell Scripting.
- Strong SQL skills.
- Experience with OneLake, Lakehouse and Fabric Warehouse.
- Experience developing Fabric Data Pipelines and Dataflows Gen2.
- Strong understanding of ETL/ELT, data modelling and data warehousing.
- Experience with Power BI and semantic models.
- Experience with Azure/cloud-based data platforms.
- Strong troubleshooting and problem-solving skills.
- Ability to work independently and engage effectively with technical and business stakeholders.
Certification – Essential
- Microsoft Certified: Fabric Data Engineer Associate (DP-700) – Valid certification required.
Advantageous
- Azure Data Engineering experience.
- PySpark/Spark.
- Azure Data Factory, ADLS or Synapse.
- CI/CD and DevOps experience.
- Data governance, security and data quality.
- Experience working in Agile environments.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Microsoft Fabric in Johannesburg, Gauteng vacancy
- ...Job Description We are seeking a highly skilled Senior Data Engineer to join a dynamic team within a leading banking environment. This... ..., working with cutting-edge technologies such as Microsoft Fabric, Azure Data Factory, and Databricks . Key Responsibilities...
- ...Compliance Technology WatersEdge Solutions is partnering with a global, AI-powered technology business to recruit an experienced Senior Data Engineer . This is an opportunity to join a growing engineering team working at the intersection of data, software engineering, AI,...
- ...A large marketing data generation and distribution company, transforming how businesses... ...They are looking for an experienced Senior Data Engineer to join their technology team and... .../ AWS Glue /Databricks / Snowflake / Microsoft Fabric Power BI / Apache Spark /Kafka /...
R 1.08 pa
...driving innovation across security, compliance, and data. We foster a collaborative and supportive... ...knowledge, and work hands-on with modern cloud and data engineering technologies. We are looking for an experienced Senior Data Engineer with 7+ years of experience to...- ...We are seeking a Senior Data Engineer to join a greenfield/future-state data platform initiative within the healthcare and medical scheme administration environment. The successful candidate will be responsible for owning delivery end-to-end, from discovery...
- ...Security Engineer - Microsoft Security Stack Location: Johannesburg, hybrid. Minimum of three days... ...type: Permanent, full-time. Seniority: Individual contributor. Not a management... ...across Windows and macOS, Purview for data protection. The controls exist and are...
R 700 ph
...Parktown office ( non-negotiable ) Rate: Maximum R700/hour Level: Senior Industry: Insurance / Financial Services We are seeking a highly experienced Senior Data Engineer to join a well-established organisation within the insurance sector. The...- ...Job Description We are seeking two highly skilled Senior Data Engineers to join a fast-paced, data platform delivery team supporting a UK... ...designing, building, and maintaining scalable data solutions on Microsoft Azure, specifically leveraging Azure Synapse and related...
R 1 pa
...Our client is looking for an experienced Data Engineer to join their DataWorks team and play a key role in designing, developing,... .... This role requires strong technical expertise across Microsoft Fabric, AWS, and Databricks , as well as proven experience integrating...R 1.2 pa
We are looking for an experienced Senior Data Engineer to join our growing Data Engineering team... ...experience. ~5+ years of Microsoft SQL Server experience (PostgreSQL is advantageous... ...platforms (Azure, AWS, Microsoft Fabric) and on-premises environments (Microsoft...- ...Type: Permanent | Full-Time Industry: Data Engineering | Applied AI | Financial Services WatersEdge... .... About the Role Youll work within a Microsoft-centred environment spanning SQL Server, Azure SQL, Microsoft Fabric, Power BI, SSRS, Python and Azure DevOps ....
- ...PBT Group is looking for a Senior Data Product Engineer to join a delivery-focused data environment in Johannesburg. We're looking for a senior, hands-on data professional with strong experience in Data Modelling, Data Architecture, Python, Spark, Data Integration...
- ...Senior Microsoft Security Specialist – 6-Month Contract Location: Johannesburg / Gauteng... ...Integrate Microsoft and third-party security data sources into Sentinel and improve... ...Technology, Computer Science, Cybersecurity, Engineering or a related field. Relevant...
- ...meaningful work, visible impact and put something genuinely rare on your CV, keep reading. About The Role As a Backend Senior Software Engineer on the Data Layer team, you'll help build and evolve the storage and query layer that keeps Camunda 8's process data fast,...
- ...this isnt a full-time role Overview: We are seeking a Microsoft Certified Trainer (MCT) specialising in Data & AI to train learners preparing for Microsoft certification exams across the Data Engineering, Data Analytics, and AI disciplines. Responsibilities:...
- ...Make an impact with NTT DATA Join a company that is pushing... ...Your day at NTT DATA This Senior Data Architect’s role acts as... ...(Snowflake, Databricks, Microsoft Fabric), and related managed services... ...Quality, Data Governance, Data Engineering and Data Cloud platforms) ~...
R 1.08 pa
...driving innovation across security, compliance, and data. We foster a collaborative and supportive... ...knowledge, and work hands-on with modern cloud and data engineering technologies. We are looking for an experienced Senior Data Engineer with 7+ years of experience to...- ...Job Description Microsoft Certified Trainer (Data & AI) Location: Remote (US Hours - Based in South Africa) Engagement: Contract / Ad-hoc (Short training engagements as required) Travel: Potential for international travel to North America (passport advantageous...
- ...Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence... ...you can grow, belong and thrive. Your day at NTT DATA The Senior Director, Partner/Vendor Alliances is a leadership role,...
- ...Role: Data Engineer with Backend Location : JHB (100% Onsite) Job Type: Contract/Permanent Contract: 12+ Months Client: Banking... ...development experience using Azure Data Factory, Databricks, Fabric, Synapse Analytics and ADLS Gen2. Proven ability to design,...
- ...Eventspec Buyer Engineering / Fabrication (Johannesburg) Email CV: *****@*****.co.za Seeking an experienced Buyer with strong engineering/fabrication procurement experience. Role involves sourcing steel, mechanical components, rigging equipment, and fabrication...
- ...Proficiency in SQL and data querying fundamentals. Understanding of relational databases... ...technologies. Exposure to modern data engineering tools and platforms, including Spark,... ...tools used across the team. Work with senior and intermediate engineers to understand...
- ...are currently seeking a highly skilled Senior Data Scientist to join a major project within... ...cleansing, transformation, feature engineering, and predictive analytics Collaborate... ...Skills Essential Azure Databricks Microsoft Azure Python SQL Machine...
- About the job Senior AI & Data Architect (Contract) SENIOR AI & DATA ARCHITECT Location: South Africa / Global Delivery Environment Industry: AI / Data Architecture / Enterprise Technology Delivery A leading workforce solutions and enterprise delivery...
- ...Description Our client is seeking a Senior Data Scientist to lead the development of advanced... ...closely with business stakeholders, engineering teams, and leadership to extract... ...Certifications AWS Certified Machine Learning Microsoft Azure Data Scientist Associate...
- ...possible, you will join our Data & AI team in Johannesburg, supporting... ...AI-driven solutions using Microsoft Copilot Studio and Azure AI... ...Experience as a Data AI Engineer or similar role (1-3 years)... ...vary depending on the level of seniority required for the position). During...
R 1 pa
Our client is looking for an experienced Data Engineer to join their DataWorks team and play a key role in designing, developing,... .... This role requires strong technical expertise across Microsoft Fabric, AWS, and Databricks , as well as proven experience integrating...- ...Description We are looking for two highly skilled Platform Data Engineers to join a cutting-edge Customer Save & Open API team.... ...methodology) Build data products using Databricks and Microsoft Fabric (Lakehouse, Warehouse, Pipelines, Semantic Models)...
- About the job Senior Data Scientist A global analytics organisation is expanding its Africa Data Science division and is looking... ...work with a talented team of scientists, statisticians, and engineers who use data to drive smarter business and consumer decisions....
- ...Management Level Senior Associate Job Description & Summary At PwC, our people in... ...address development areas. Interpret data to inform insights and recommendations.... ...architecture concepts. ~ Understanding of data engineering fundamentals. ~ Experience with data...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Microsoft Fabric. Be the first to apply!
