Apply now

Posted 6 days ago

Junior Data Engineer – Azure Databricks / ADF / PySpark

@ ThoughtStorm

Toronto, Ontario

Contract
Apply now
SIGNALS

Overview

ThoughtStorm is hiring a junior data engineer on contract to build and maintain Azure-based data pipelines using Azure Data Factory, Databricks and PySpark. The role covers ETL/ELT development, Delta Lake and Medallion Architecture work, and data quality and CI/CD practices. The posting states a contract employment type; pay.

Responsibilities:

  • Develop ADF, ADLS and Databricks data engineering solutions
  • Build ETL/ELT pipelines and batch or near real-time processing
  • Develop Databricks notebooks, workflows and Delta Lake tables
  • Validate data quality, reconcile data and troubleshoot pipelines
  • Deploy code through Azure DevOps and CI/CD pipelines

Requirements summary:

  • Degree or diploma in computer science, software engineering or IT
  • Hands-on Azure Data Factory, ADLS and Databricks experience
  • Strong Python, SQL, PySpark and Apache Spark skills
  • Knowledge of Delta Lake and Medallion Architecture
  • Experience with Git, CI/CD and automated testing
  • Agile/Scrum teamwork experience

Tools & skills

Source and dates

Source type not verified · apify-linkedin

Employer posting date
2026-11-04
First seen by our source
2026-11-10
Source record updated
2026-11-10

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SeniorityEntry level
DepartmentSoftware development
Work settingOffice
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish
EducationCollege diploma (required)
Fields of studyComputer Science, Software Engineering, Information Technology

Summary and details written by AI from the posting; the employer’s posting is the authority.

ThoughtStorm

FieldValue
Open jobs on Jobsy9
Job description

Required Skills & Qualifications

  • Degree or diploma in Computer Science, Software Engineering, Information Technology, or a related field.
  • Hands-on experience developing data engineering solutions using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure Databricks.
  • Strong programming skills in Python, SQL, PySpark, and Apache Spark for data processing and transformation.
  • Experience developing and maintaining ETL/ELT pipelines, data ingestion frameworks, and scalable batch or near real-time data processing solutions.
  • Hands-on knowledge of Delta Lake, Lakehouse Architecture, and Medallion Architecture (Bronze, Silver, Gold).
  • Experience developing Databricks notebooks, workflows, data processing jobs, and optimizing Delta Lake tables.
  • Strong understanding of data validation, data quality, reconciliation, monitoring, and troubleshooting of data pipelines.
  • Experience with Azure DevOps, Git, CI/CD pipelines, automated deployments, and version control.
  • Knowledge of REST APIs, data integration patterns, automation frameworks, and reusable development utilities.
  • Understanding of data governance, metadata management, data cataloguing, security, privacy, and access control.
  • Experience with software development best practices, including code reviews, automated testing, documentation, and secure coding.
  • Strong communication and collaboration skills, with experience working in Agile/Scrum teams alongside architects, data engineers, analysts, and business stakeholders.

Similar jobs

  • Data Engineer

    Toronto, ON

    Scotiabank

    3+ YOECandidates need 3 to 5 years of data engineering experience, strong SQL and data modeling skills, and experience owning production pipelines on enterprise platforms in Google or Azure cloud. Experience with Spark, Python, NiFi, Trino, Autosys or Cloud Composer, and Power BI is expected.

    Spark, NiFi, Trino, Autosys, Cloud Composer, Power BI

  • Data Engineer - MS Fabric & Azure Data Platform

    Toronto, ON
    Contract

    Akkodis

    5+ YOECandidates need 5+ years of data engineering experience, including hands-on Microsoft Fabric work in production and strong Azure Data Factory and advanced T-SQL skills. Experience designing dimensional and enterprise warehouse models and knowledge of data governance and cloud architectures are also required.

    Microsoft Fabric, Azure Data Factory, T-SQL, Dynamics 365, Microsoft Dataverse, Power BI

  • Senior Data Engineer

    Toronto, ON
    Full Time

    Exchange Solutions

    5+ YOEExchange Solutions needs expert SQL, strong Python, deep dbt and data modelling experience, plus cloud data warehouse skills. A degree in data engineering, 5+ years of production pipeline ownership and experience with data quality and observability are required.

    dbt, SQL, Python, Snowflake, BigQuery, Databricks

  • Contract Data Engineer

    Toronto, ON
    Contract

    SapienX Inc.

    Candidates need hands-on experience with Azure Data Factory, Azure Databricks, PySpark, Python, SQL and Azure Logic Apps. They must be able to troubleshoot unfamiliar pipelines, write clean maintainable code and follow CI/CD and DEV to QA to PROD deployment practices.

    Azure Data Factory, Azure Databricks, Azure Logic Apps, PySpark, Python, SQL

  • Data Engineer

    Toronto, ON
    Contract

    Aarorn Technologies Inc

    Candidates need hands-on Snowflake and DBT experience, strong SQL, and a solid grasp of ETL/ELT and data quality. Analytical problem-solving and teamwork skills are needed. Python and P&C insurance knowledge are assets.

    Snowflake, DBT, SQL, Python

  • Data Engineer - Databricks

    Toronto, ON
    Contract

    Teqfocus

    5+ YOECandidates need 5+ years of data engineering experience, ideally on enterprise integration projects. They must be proficient in Databricks and SQL, and understand data modelling, data quality and reconciliation.

    Databricks, SQL, Delta Lake

  • Senior Data Engineer

    Toronto, ON

    Bank of Montreal

    5+ YOECandidates need 5 to 7 years of relevant experience and hands-on skills in ETL/ELT, data warehousing, SQL, Python, Spark and Scala. Experience with cloud services, Agile delivery in JIRA and AI concepts such as RAG is also required.

    SSIS, AWS Glue, Hadoop, Netezza, JIRA, Spark

  • Data Engineer

    Toronto, ON
    Full Time

    Cyber Space Technologies LLC

    5+ YOECandidates need five years of data engineering experience, three of them in Azure Synapse, plus strong T-SQL skills and experience migrating ETL systems such as Alteryx, SSIS or Databricks. Hands-on CI/CD experience in Azure DevOps or Git is also required.

    Azure Synapse, Azure DevOps, GitHub, ADLS Gen2, Alteryx, SSIS

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.