Apply now

Posted last month

Senior Data Engineer (AI Systems & ML)

@ GuruLink

Toronto, Ontario

RemoteFull-time5+ years experience
Apply now
SIGNALS

Overview

GuruLink is hiring a Senior Data Engineer to build the data infrastructure behind large-scale machine learning and recommendation systems. The role owns Spark-based pipelines feeding production ML models, on a remote or Toronto basis, full time, with a base salary of $144K to $188K CAD.

Responsibilities:

  • Design and optimize production data pipelines for AI and ML workloads
  • Develop and tune Apache Spark batch processing on Google Cloud
  • Build a centralized data platform for ML training and inference
  • Provide reliable datasets to ML engineers and data scientists
  • Monitor and improve reliability and scalability of data systems

Requirements summary:

  • 5+ years of professional data engineering experience
  • Strong Apache Spark and PySpark DataFrame API expertise
  • Strong Python development with unit testing and CI/CD
  • Experience with Parquet, Delta Lake and Kafka
  • Hands-on cloud infrastructure experience, preferably Google Cloud

Tools & skills

Source and dates

Source type not verified · jsonld

Employer posting date
2026-09-23
First seen by our source
2026-10-27
Source record updated
2026-11-05

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SenioritySenior
DepartmentSoftware development
Experience5+ years
Hours per week40 (estimated)
Travelair: none · ground: none
Work settingHome, Office
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish

Summary and details written by AI from the posting; the employer’s posting is the authority.

GuruLink

FieldValue
Open jobs on Jobsy14
Job description

Location: REMOTE / Toronto, Ontario
This job allows you to work remotely.

We're looking for a Senior Data Engineer to join a team responsible for building the data infrastructure that powers large-scale machine learning and recommendation systems. You'll help design, develop, and optimize the data platform behind billions of intelligent decisions each day, supporting enterprise customers across a wide range of digital experiences.

In this role, you'll own the Spark-based data pipelines that feed production machine learning models, working closely with ML engineers, data scientists, and software engineers to build reliable, scalable, and high-performance data systems. You'll play a key role in developing the infrastructure that enables advanced AI-driven products and personalization capabilities, with the opportunity to influence architecture and solve complex data engineering challenges at scale.

What You'll Do

- Design, build, maintain, and optimize production data pipelines supporting AI and machine learning workloads at enterprise scale.
- Develop and scale Apache Spark batch processing pipelines, including cluster configuration, performance tuning, and optimization within Google Cloud.
- Build and maintain a centralized data platform that supports machine learning training, experimentation, and production inference.
- Partner closely with Machine Learning Engineers and Data Scientists to provide high-quality, reliable datasets for model development and evaluation.
- Monitor, troubleshoot, and improve the performance, reliability, and scalability of data processing systems.
- Collaborate with platform and distributed systems engineers to evolve the overall data architecture.
- Continuously improve the efficiency, reliability, and maintainability of the data infrastructure.
- Deliver data solutions and platform enhancements that provide measurable business impact.

Must Have Skills:

What We're Looking For

- 5+ years of professional experience in Data Engineering.
- Strong expertise with Apache Spark, including extensive experience using the PySpark DataFrame API to solve large-scale data processing challenges.
- Experience designing, optimizing, and operating distributed data processing pipelines.
- Strong Python development skills, including unit testing, version control, code reviews, and CI/CD practices.
- Experience working with modern data storage formats such as Parquet and Delta Lake.
- Experience building or consuming streaming data pipelines using technologies such as Kafka.
- Hands-on experience with cloud infrastructure, preferably Google Cloud Platform.
- Strong understanding of query optimization and data processing performance tuning.
- Experience working with modern software development practices, including Docker, Kubernetes, GitHub Actions, and automated deployment pipelines.
- Excellent collaboration skills with cross-functional engineering teams, including Machine Learning Engineers, Data Scientists, and Platform Engineers.
- Comfortable working in a fast-moving, highly collaborative environment where ownership and continuous improvement are valued.

The base pay range for this position is $144K CAD - 188K CAD

Similar jobs

  • Senior Data Engineer

    Mississauga, ON

    Capgemini

    8+ YOECandidates need 8+ years in data engineering and warehousing, with advanced Python, PySpark and SQL skills and strong Microsoft Azure experience. Proven leadership of technical teams and experience with Spark-based big data solutions are required.

    Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Databricks, Azure Data Lake Storage, Snowflake

  • Senior Data Engineer

    Toronto, ON
    Full Time

    Canadian Imperial Bank of Commerce (Canada): C'est aussi pourquoi une carrière à la Banque CIBC est plus qu'un emploi : c'est une occasion de grandir et de travailler aux côtés de certaines des…

    5+ YOE3+ MgmtCandidates need 5+ years of data engineering experience and 3+ years of technical leadership, with strong SQL, Python and Azure skills and experience with Databricks. Azure Data Factory, Power BI or Microsoft Fabric experience is an asset.

    SQL, Python, Microsoft Azure, Databricks, Azure Data Factory, Power BI

  • Data Engineer II

    Brampton, ON
    Full Time

    Loblaw

    3+ YOECandidates need 3+ years in data, software or cloud engineering with production experience. They should know Python, SQL, Git, GCP, Kubernetes, Docker, Helm, CI/CD and Apache Airflow.

    GCP, BigQuery, Google Cloud Storage, GKE, Docker, Helm

  • Senior Data Engineer (Technology Advisory)

    Toronto, ON
    Contract

    Jarvis Consulting Group

    7+ YOECandidates need 7+ years of data engineering experience, solid Databricks and Spark development skills, and experience with Hadoop, streaming tools and cloud platforms. A university degree in a relevant STEM field and strong communication skills are also needed.

    Databricks, Spark, Hadoop, Hive, HDFS, Kafka

    Data Engineer

    Toronto, ON

    Jarvis Consulting Group

    1+ YOECandidates need a bachelor's degree in business or a similar field and about one year of compliance or similar work. Strong attention to detail, communication skills and the ability to work under pressure are also required.

  • Data Engineer

    Guelph, ON

    Royal Distributing

    2+ YOECandidates need 2 to 4 years in data engineering, analytics engineering or a strong BI role with pipeline work, plus strong SQL, Python and cloud warehouse experience, Snowflake preferred. They must have production ETL or orchestration experience and a disciplined approach to validating data.

    Snowflake, Python, Git

  • Data Engineer (Sports & Prediction Markets)

    Toronto, ON
    Full Time

    Betstamp Ventures

    Candidates need strong backend programming fundamentals (Go, Java, C#, Rust, C++, Kotlin or server-side TypeScript), comfort with SQL and query performance, some Linux and container experience, and thoughtful use of AI coding tools. Based in Toronto or willing to relocate.

    Go, PostgreSQL, ClickHouse, Redis Streams, Dragonfly, RabbitMQ

  • Data Engineer - Snowflake, dbtCore/Cloud, AWS

    Markham, ON

    Aviva Canada Inc: Leading insurer for home, auto, lifestyle and Business / Assurance automobile, habitation, mode de vie et entreprise

    6+ YOECandidates need 6+ years of data engineering experience, including 3+ years with Snowflake, dbt and AWS. Strong coding skills in SQL and Python and experience with orchestration tools are required, and insurance domain knowledge is an asset.

    Snowflake, dbt Core, dbt Cloud, AWS, Terraform, Airflow

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.