Posted yesterday
Senior Databricks Data Engineer (Azure)
@ K&K Global Talent Solutions INC.
Ontario
Overview
K&K Global Talent Solutions is hiring a Senior Databricks Data Engineer for a full-time, permanent hybrid role in Toronto, ON. The work covers building and optimizing enterprise data pipelines on the Azure Databricks Lakehouse, including batch and streaming ETL/ELT, medallion architectures and Unity Catalog governance. The posting requires 8–10 years of IT/data engineering experience and attendance in the office on a hybrid basis.
Responsibilities:
- Design and optimize batch and streaming pipelines with PySpark, Spark SQL and Delta Lake
- Architect Bronze, Silver and Gold medallion layers using Delta Live Tables
- Build and monitor production workflows in ADF and Databricks Workflows
- Manage access control, lineage and metadata in Unity Catalog
- Automate deployments with Git, Azure DevOps or GitHub Actions and DABs
Requirements summary:
- 8–10 years of IT or data engineering experience
- Deep hands-on production experience on Azure Databricks Lakehouse
- Advanced PySpark, Spark SQL, Delta Lake and DLT skills
- Practical experience with ADF and ADLS Gen2
- Experience administering Unity Catalog
- Solid Git and CI/CD experience
Tools & skills
Source and dates
Source type not verified · apify-linkedin
- Employer posting date
- 2026-11-12
- First seen by our source
- 2026-11-14
- Source record updated
- 2026-11-14
These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.
Job details
| Seniority | Senior |
| Department | Software development |
| Experience | 8+ years |
| Hours per week | 40 (estimated) |
| Work setting | Office |
| Position | Mostly sitting |
| Physical demands | physical low · computer high |
Summary and details written by AI from the posting; the employer’s posting is the authority.
K&K Global Talent Solutions INC.
| Field | Value |
|---|---|
| Open jobs on Jobsy | 15 |
Position: Senior Databricks Data Engineer
Location: Hybrid- Toronto, ON
Job type: Full-time/Permanent hiring
We are seeking an experienced Senior Databricks Data Engineer with 8–10 years of industry experience to architect, build, and optimize enterprise data pipelines on the Databricks Lakehouse platform. You will spearhead end-to-end ETL/ELT development across batch and streaming workloads, implement medallion architectures, and enforce fine-grained data governance using Unity Catalog. Working in an agile environment, you will automate deployment workflows using modern DevOps practices and ensure high performance and reliability across production data ecosystems.
Core Responsibilities
- ETL & Streaming Pipeline Development: Design, build, and performance-tune scalable batch and real-time streaming pipelines using PySpark, Spark SQL, and Delta Lake.
- Lakehouse & Medallion Architecture: Architect and implement multi-layered medallion architectures (Bronze, Silver, Gold) utilizing Delta Live Tables (DLT) for declarative data transformations.
- Workflow Orchestration & Automation: Build, schedule, and monitor production Databricks jobs and end-to-end data workflows using Azure Data Factory (ADF) and Databricks Workflows.
- Data Governance & Security: Configure and manage fine-grained access controls, data lineage, metadata management, and security compliance via Unity Catalog.
- CI/CD & DataOps Engineering: Maintain version-controlled repositories in Git and build automated deployment pipelines utilizing Azure DevOps, GitHub Actions, or Databricks Asset Bundles (DABs).
Required Technical Skills
- Experience: 8–10 years of overall IT/data engineering experience, with deep hands-on expertise delivering production workloads on the Azure Databricks Lakehouse platform.
- Core Big Data Stack: Advanced proficiency in PySpark, Spark SQL, Delta Lake, and Delta Live Tables (DLT), including cluster sizing and query optimization.
- Orchestration & Cloud Ecosystem: Strong practical experience integrating Azure Data Factory (ADF), Databricks Workflows, and Azure storage services (ADLS Gen2).
- Governance & Compliance: Proven track record setting up and administering Unity Catalog for enterprise access control and metadata governance.
- DevOps & Automation: Solid hands-on experience with Git, CI/CD pipelines (Azure DevOps / GitHub Actions), and Databricks Asset Bundles.
Journal
Only you can see this. Kept on this device, and in your account when you sign in.