Posted 6 days ago
Junior Data Engineer – Azure Databricks / ADF / PySpark
@ ThoughtStorm
Toronto, Ontario
Overview
ThoughtStorm is hiring a junior data engineer on contract to build and maintain Azure-based data pipelines using Azure Data Factory, Databricks and PySpark. The role covers ETL/ELT development, Delta Lake and Medallion Architecture work, and data quality and CI/CD practices. The posting states a contract employment type; pay.
Responsibilities:
- Develop ADF, ADLS and Databricks data engineering solutions
- Build ETL/ELT pipelines and batch or near real-time processing
- Develop Databricks notebooks, workflows and Delta Lake tables
- Validate data quality, reconcile data and troubleshoot pipelines
- Deploy code through Azure DevOps and CI/CD pipelines
Requirements summary:
- Degree or diploma in computer science, software engineering or IT
- Hands-on Azure Data Factory, ADLS and Databricks experience
- Strong Python, SQL, PySpark and Apache Spark skills
- Knowledge of Delta Lake and Medallion Architecture
- Experience with Git, CI/CD and automated testing
- Agile/Scrum teamwork experience
Tools & skills
Source and dates
Source type not verified · apify-linkedin
- Employer posting date
- 2026-11-04
- First seen by our source
- 2026-11-10
- Source record updated
- 2026-11-10
These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.
Job details
| Seniority | Entry level |
| Department | Software development |
| Work setting | Office |
| Position | Mostly sitting |
| Physical demands | physical low · computer high |
| Languages | English |
| Education | College diploma (required) |
| Fields of study | Computer Science, Software Engineering, Information Technology |
Summary and details written by AI from the posting; the employer’s posting is the authority.
ThoughtStorm
| Field | Value |
|---|---|
| Open jobs on Jobsy | 9 |
Required Skills & Qualifications
- Degree or diploma in Computer Science, Software Engineering, Information Technology, or a related field.
- Hands-on experience developing data engineering solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Databricks.
- Strong programming skills in Python, SQL, PySpark, and Apache Spark for data processing and transformation.
- Experience developing and maintaining ETL/ELT pipelines, data ingestion frameworks, and scalable batch or near real-time data processing solutions.
- Hands-on knowledge of Delta Lake, Lakehouse Architecture, and Medallion Architecture (Bronze, Silver, Gold).
- Experience developing Databricks notebooks, workflows, data processing jobs, and optimizing Delta Lake tables.
- Strong understanding of data validation, data quality, reconciliation, monitoring, and troubleshooting of data pipelines.
- Experience with Azure DevOps, Git, CI/CD pipelines, automated deployments, and version control.
- Knowledge of REST APIs, data integration patterns, automation frameworks, and reusable development utilities.
- Understanding of data governance, metadata management, data cataloguing, security, privacy, and access control.
- Experience with software development best practices, including code reviews, automated testing, documentation, and secure coding.
- Strong communication and collaboration skills, with experience working in Agile/Scrum teams alongside architects, data engineers, analysts, and business stakeholders.
Journal
Only you can see this. Kept on this device, and in your account when you sign in.