Software Developer ETL

Job Description

The Ontario Public Sector is seeking a Senior Software Developer – ETL with strong expertise in Azure Data Engineering, Microsoft Fabric, Databricks, PySpark, and Power BI.

The successful candidate will be responsible for designing and developing scalable data pipelines, transforming raw data into Silver and Gold data layers, developing semantic models, and delivering high-performance Power BI reports and dashboards.

The resource may also support projects related to the Protect Ontario by Unleashing Our Economy Act, as required.

Key Responsibilities

• Analyze business data and design semantic data models.

• Transform raw data into Silver and Gold layers for reporting and analytics.

• Design, develop, deploy, and maintain Power BI reports and dashboards.

• Develop operational, analytical, and paginated reports.

• Build scalable data pipelines using Microsoft Fabric Data Factory.

• Develop and optimize data access queries using SQL and PySpark.

• Implement data engineering solutions using Azure Databricks and Azure Data Lake Storage Gen2.

• Translate business requirements into technical specifications and working applications.

• Implement CI/CD pipelines using Azure DevOps.

• Develop and support OLAP analytical solutions.

• Troubleshoot technical issues and support software implementation, migration, and deployment.

• Collaborate with data analysts and business stakeholders to deliver reporting solutions.

Mandatory Skills and Experience

• Strong experience with Azure technologies.

• Hands-on experience with Azure Databricks.

• Experience with Azure Data Lake Storage Gen2.

• Strong Power BI development and semantic modelling skills.

• Experience implementing CI/CD pipelines using Azure DevOps.

• Strong PySpark development experience.

• Hands-on Microsoft Fabric experience.

• Experience with Star Schema and Snowflake data modelling.

• Proficiency in Microsoft Fabric Data Factory for developing complex and scalable data pipelines.

• Experience designing Direct Lake semantic models in Power BI using Silver and Gold layer models.

• Experience developing operational, analytical, and paginated Power BI reports.

Desirable Skills

• Experience with Azure Data Factory.

• Experience building Lakehouses and Data Warehouses.

• Strong PySpark and SQL optimization skills.

• Knowledge of Medallion Architecture (Bronze, Silver, and Gold).

• Experience implementing data governance and security.

• Knowledge of Row-Level Security and Column-Level Security.

• Experience with data lineage tracking.

Ideal Candidate Profile

• Senior Azure Data Engineer or ETL Developer.

• Strong background in Azure Databricks, PySpark, and ADLS Gen2.

• Hands-on experience with Microsoft Fabric and Fabric Data Factory.

• Strong Power BI reporting and semantic modelling expertise.

• Experience with Direct Lake and OneLake.

• Strong knowledge of Azure DevOps and CI/CD.

• Previous Ontario Public Service or Canadian public sector project experience.

• Willingness to work onsite in Toronto.