Apply now

Posted yesterday

Senior Data Engineer

@ MPA Recruitment

Halifax, Nova Scotia

Full-time
Apply now
SIGNALS

Overview

MPA Recruitment is hiring a Senior Data Engineer, a full-time role building data processing and persistence software for large-scale, production data solutions. The work covers the full software lifecycle in agile teams, primarily on Big Data technologies.

Responsibilities:

  • Design and develop large-scale data processing software
  • Lead development and own significant technical components
  • Ensure code quality, testing and defect resolution
  • Work with operations teams on production readiness
  • Advise on effort estimates and technical implications

Requirements summary:

  • Strong experience in Java, Scala or Python
  • Experience with AWS, Azure, GCP or Databricks
  • Proficient in SQL and analytical queries
  • Deployed large-scale data processing components to production
  • Experience with automated testing and CI/CD

Tools & skills

Source and dates

Source type not verified · apify-linkedin

Employer posting date
2026-11-14
First seen by our source
2026-11-15
Source record updated
2026-11-15

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SenioritySenior
DepartmentSoftware development
Hours per week40 (estimated)
Work settingOffice
PositionMostly sitting
Physical demandsphysical low · computer high

Summary and details written by AI from the posting; the employer’s posting is the authority.

MPA Recruitment

FieldValue
Open jobs on Jobsy8
Job description

As a Senior Data Engineer, you will be responsible or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems. You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments.

Your responsibilities will include working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution. Working with Architects and Lead Engineers to ensure the software supports non-functional needs. Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality. Working with operations teams to ensure operational readiness. Advising customers and managers on the estimated effort and technical implications of user stories and user journeys. Coaching and mentoring team members

MINIMUM (ESSENTIAL) REQUIREMENTS:

• Strong software development experience in one of Java, Scala, or Python

• Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.

• Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment

• Proficient in SQL and SQL extensions for analytical queries

• Solid understanding of ETL/ELT data processing pipelines and design patterns

• Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats

• Able to write quality, testable code and has experience of automated testing

• Experience with Continuous Integration and Continuous Deployment techniques

DESIRABLE:

• Experience of data pipeline development

• Experience of Docker and Kubernetes

• Experience of performance tuning

• Experience of data visualisation and complex data transformations

• Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products

• Expertise in continuous improvement and sharing input on data best practice

Similar jobs

  • Sr Data Engineer

    Toronto, ON
    Full Time

    MPA Recruitment

    Candidates need strong software development experience in Java, Scala or Python, experience with cloud data platforms such as AWS, Azure, GCP or Databricks, and proven delivery of large-scale data processing components into production. Strong SQL, ETL/ELT pipeline knowledge and automated testing with CI/CD are also required.

    Databricks, AWS, Azure, GCP, Kafka, Docker

  • Data Engineer - Clinical Data Experience

    Toronto, ON
    Contract

    Kaizen Technologies

    15+ YOECandidates need strong hands-on Python and PySpark skills, experience parsing CCD/C-CDA XML, and solid SQL and healthcare data knowledge. Experience with clinical terminologies such as LOINC, SNOMED CT and ICD-10, and with AWS services, is also sought.

    Python, PySpark, SQL, AWS Glue, AWS Lambda, AWS S3

  • Data Engineer

    Markham, ON
    Full Time

    Amphenol Communications Solutions

    5+ YOECandidates need 5+ years of data or software engineering experience, advanced SQL and strong Python, hands-on Azure Data Factory and cloud data platform work, and experience with ETL, ELT and API integration. A bachelor's degree or equivalent experience is also required.

    Azure Data Factory, Microsoft Fabric, Git, QAD, Plex

  • Senior Data Engineer

    Winnipeg, MB
    Full Time

    Michael Page

    5+ YOECandidates need 5+ years of data engineering experience and a degree or diploma in computer science or a related field. They should be strong in Python, PySpark, SQL, ETL and Azure data services, with Power BI and CI/CD experience an asset.

    Azure Data Factory, Databricks, Synapse, Fabric, Purview, Power BI

  • Senior Data Engineer - Partnership Intelligence

    Vancouver, BC
    Full Time

    Two Circles

    7+ YOECandidates need 7+ years of data-focused software engineering, database querying, object-oriented programming (Python and C#), and cloud work, preferably on AWS. Proficiency in Snowflake, MS SQL, Airflow and Docker, plus unit testing and API experience, is needed.

    Airflow, Snowflake, MS SQL Server, AWS, Docker, New Relic

  • Senior Data Engineer

    Ontario
    Full Time

    LTM

    3+ YOELTM needs candidates with 3 to 5 years of Scala experience and hands-on work with Hadoop and Spark for large data sets. Strong SparkSQL skills, testing discipline and a habit of keeping up with big data technology are expected.

    Scala, Spark, Hadoop, SparkSQL

  • Data Engineer

    Toronto, ON
    Full Time

    Grand Challenges Canada

    3+ YOECandidates need 3+ years in data or analytics engineering, with hands-on Microsoft Fabric experience of at least one year. Strong SQL and Python (PySpark) skills and experience delivering a medallion or lakehouse architecture are required, along with familiarity with Microsoft Purview or similar governance tools.

    Microsoft Fabric, OneLake, Data Factory, Spark Notebooks, Microsoft Purview, Azure Synapse Analytics

  • Data Engineer

    Calgary, AB +7
    Full Time

    Canadian Cancer Society

    3+ YOECandidates need a degree in computer science or a related field, 3 to 5 years of progressively senior data engineering experience, and strong skills in Microsoft Fabric, Apache Spark, SQL and Python. French is highly preferred.

    Microsoft Fabric, Apache Spark, Azure DevOps, Microsoft Purview, Salesforce, Python

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.