Posted 8 months ago
Staff Software Engineer - Open Source Data Platform (ODP)
@ Acceldata
Kitchener, Ontario
Overview
Acceldata is hiring a Staff Software Engineer for its Open Data Platform (ODP) team to architect and lead critical distributed data infrastructure components. The role requires 9+ years of experience, with at least 5 in distributed systems or big data platforms, and involves technical leadership and open-source contribution.
Responsibilities:
- Own architecture of major platform components
- Architect distributed data storage and query optimization systems
- Lead Apache and open-source contributions
- Mentor senior engineers and enforce coding standards
- Lead root cause analysis for production issues
Requirements summary:
- 9+ years software development, 5+ in distributed or big data systems
- Expert Java or Scala, strong Python
- Deep distributed computing knowledge
- Hands-on big data stack experience (Hadoop, Spark, Kafka, Flink)
- Expert Linux and Kubernetes experience
Tools & skills
Source and dates
Employer career site / ATS feed · lever
- Employer posting date
- 2026-03-15
- First seen by our source
- 2026-10-08
- Source record updated
- 2026-10-09
These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.
Job details
| Seniority | Senior |
| Department | Software development |
| Experience | 9+ years |
| Hours per week | 40 (estimated) |
| Work setting | Office, Home |
| Position | Mostly sitting |
| Physical demands | physical low · computer high |
| Languages | English |
Summary and details written by AI from the posting; the employer’s posting is the authority.
Acceldata
Saved company profile
Historical company information from a saved The Jobs API profile (LinkedIn/Crunchbase fields). It is not live-verified; figures may have changed. Missing values remain unknown.
Full company description
Acceldata provides an Agentic Data Management platform that simplifies and speeds the ability for enterprises to deliver trusted data for AI and other initiatives. Founded in 2018, Campbell, CA-based Acceldata developed the world's first enterprise data observability platform to help enterprises build and operate great data products. Built on that foundation, Acceldata's xLake Reasoning Engine now powers the Agentic Data Management platform. Acceldata's solutions have been embraced by global enterprises such as Nestle, Dun & Bradstreet, Hershey, Pubmatic, HCSC, PhonePe (Walmart), TPG Telecom (Australia), Jenius Bank, Merkle, Pubmatic, and many more. Acceldata investors include Insight Partners, March Capital, Industry Ventures, Lightspeed, Sorenson Ventures, Sanabil, and Emergent Ventures.
- LinkedIn followers
- 80,192
- People associated on LinkedIn
- 289
- Reported office locations
- 2105 S Bascom Ave, Campbell, California 95008, US
- 18th Cross Road, HSR Layout, 3rd Sector, Vault No 1090/A, Bengaluru, Karnataka 560102, IN
- Business categories
- Infrastructure
- Artificial Intelligence
- Data Management
- Enterprise Software
- Artificial Intelligence (AI)
- Big Data
- Machine Learning
- Other recorded names
- Acceldata
- Specialties
- Data observability
- Data reliability
- Data discovery
- Data pipeline monitoring
- Data quality monitoring
- Compute performance monitoring
- Data pipeline observability
- Data quality management
- Agentic Data Management
- Agentic AI
- Data Quality
- Hybrid Cloud
- Snowflake
- Databricks
- AWS
- Azure
- and Google Cloud
- Profile identifies a recruitment agency
- No
- Reported total investment
- 105,560,000
Currency and observation date were not supplied; this is not a current valuation or a funding round.
Acceldata provides an Agentic Data Management platform that simplifies and speeds the ability for enterprises to deliver trusted data for AI and other initiatives. Founded in 2018, Campbell, CA-based Acceldata developed the world's first enterprise data observability platform to help enterprises build and operate great data products. Built on that foundation, Acceldata's xLake Reasoning Engine now powers the…
| Field | Value |
|---|---|
| Industry | Software Development |
| Company size | 201-500 employees |
| Headquarters | Campbell, California |
| Organization type | Privately Held |
| Specialties | Data observabilityData reliabilityData discoveryData pipeline monitoringData quality monitoringCompute performance monitoringData pipeline observabilityData quality managementAgentic Data ManagementAgentic AI |
| Open jobs on Jobsy | 10 |
| View page |
ABOUT THE ROLE
We are seeking a Staff Engineer with at least 9 years of experience in distributed systems or data platform development. In this role, you will be a technical leader responsible for architecting and driving the technical direction of critical components within the Acceldata Open Data Platform (ODP). You will work on solving the most challenging distributed systems problems, contribute to open-source communities, and mentor senior engineers while shaping the future of large-scale data infrastructure.
You'll lead high-impact initiatives that directly influence how petabyte-scale data is managed, observed, and optimized across hybrid and cloud ecosystems. You'll collaborate with industry experts, Apache committers, and seasoned engineers who share your passion for distributed systems and open-source innovation.
WHY JOIN US
At Acceldata, you won't just be writing code; you'll be defining the architecture and technical vision for modern data platforms used by some of the world's largest enterprises.
Your technical decisions will shape mission-critical systems, and your contributions will be visible across the global data ecosystem. If you're ready to take ownership of complex technical challenges and drive innovation at scale, Acceldata is where you belong.
RESPONSIBILITIES
- Own the end-to-end architecture of major platform components, driving design decisions that impact scalability, reliability, and performance.
- Architect and implement next-generation distributed data storage, processing, and query optimization systems.
- Partner with product, engineering leadership, and stakeholders to define technical roadmaps and translate business requirements into scalable solutions.
- Lead contributions to Apache projects and open-source communities, establishing Acceldata's presence and technical reputation.
- Identify and resolve complex performance bottlenecks across distributed systems, optimizing for cost, latency, and throughput.
- Mentor and guide Senior Software Engineers, fostering technical excellence and a culture of continuous learning.
- Establish and enforce coding standards, perform thorough code reviews, and ensure architectural consistency across the platform.
- Evaluate and recommend emerging technologies, tools, and frameworks that align with platform goals.
- Lead root cause analysis for critical production issues and drive systemic improvements to prevent recurrence.
- Work across diverse environments: Bare Metals, VM, Kubernetes, and multi-cloud architectures.
REQUIREMENTS
- 9+ years of hands-on software development experience with at least 5 years focused on distributed systems or big data platforms.
- Expert-level proficiency in Java or Scala, with strong Python skills. Experience with systems languages is a plus.
- Deep understanding of distributed computing principles, including consensus algorithms, data partitioning, replication, fault tolerance, and consistency models.
- Extensive hands-on experience with multiple components of the big data stack (Hadoop, Spark, Hive, Trino, Kafka, Flink, NiFi or similar).
- Expert-level Linux proficiency, including kernel tuning, performance analysis, and debugging at the system level.
- Strong experience with Kubernetes, Docker, and cloud platforms (AWS, GCP, or Azure).
- Deep expertise with Maven, Gradle, or SBT; experienced in CI/CD pipelines, GitHub, and artifact management (Nexus).
- Proven ability to diagnose and resolve complex issues, including memory leaks, deadlocks, GC tuning, and distributed system failures.
- Strong understanding of architectural patterns for scalable, fault-tolerant distributed systems.
- Excellent written and verbal communication skills; ability to articulate complex technical concepts to diverse audiences, including senior leadership.
- Demonstrated ability to work effectively with cross-functional teams, external contributors, and the open-source community.
- History of significant contributions or committer status in Apache projects (e.g., Spark, Kafka, Hive, Iceberg, Flink, etc.).
- Experience with modern table formats (Apache Iceberg, Delta Lake, Hudi) and data lake architectures.
- Experience developing or optimizing query engines, query planners, or execution frameworks.
- Familiarity with data governance, security, lineage, and compliance frameworks.
- Experience leading large-scale data platform migrations or Hadoop distribution upgrades.
- Published technical blogs, papers, or conference presentations on distributed systems topics.
- Experience leading or maintaining open-source projects.
PREFERRED SKILLS
Journal
Only you can see this. Kept on this device, and in your account when you sign in.