Posted 24 days ago
Software Engineer - AI Code Evaluation
@ Gramian Consulting Group
Remote in Canada
Overview
Gramian Consulting Group is hiring a contract Software Engineer to train and evaluate next-generation AI models on real-world software engineering tasks. The work involves reviewing AI-generated code, writing challenging programming problems with reference solutions, and giving detailed technical feedback. The posting states a contract arrangement and a requirement for strong written English, but gives no pay, location or schedule.
Responsibilities:
- Evaluate AI-generated code for correctness, quality and design
- Create challenging coding problems with verified reference solutions
- Review AI reasoning on architecture, debugging and system design
- Provide detailed technical feedback to improve AI performance
Requirements summary:
- At least 3 years of professional experience in software engineering or data science
- At least 1 year at a leading technology, finance or research company
- Bachelor's degree from a university in the US, Canada, Australia, NZ or UK
- Strong programming and software engineering fundamentals
- Excellent written English
Tools & skills
Source and dates
Employer career site / ATS feed · workable
- Employer posting date
- 2026-10-13
- First seen by our source
- 2026-10-14
- Source record updated
- 2026-10-14
These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.
Job details
| Seniority | Mid level |
| Department | Software development |
| Experience | 3+ years |
| Travel | air: none · ground: none |
| Work setting | Home |
| Position | Mostly sitting |
| Physical demands | physical low · computer high |
| Languages | English |
| Education | Bachelor’s degree (required) |
| Fields of study | Data Science, Software Engineering, Computer Science |
Summary and details written by AI from the posting; the employer’s posting is the authority.
Gramian Consulting Group
Saved company profile
Historical company information from a saved The Jobs API profile (LinkedIn/Crunchbase fields). It is not live-verified; figures may have changed. Missing values remain unknown.
We get talents. You get results.
Full company description
Gramian Consulting is your partner for accessing the engineering capabilities you need—delivered in the model that fits your business, from staff augmentation and talent recruiting to Build-Operate-Transfer (BOT). We combine the perspective of a software engineer, the rigor of a technical recruiter, and the vision of a business builder, so you get experts who understand your challenges and deliver results the right way. This blend is our signature advantage in providing top-quality services, fast and reliably.
- LinkedIn followers
- 27,283
- People associated on LinkedIn
- 7
- Reported office locations
- Kumanovo, MK
- Other recorded names
- Gramian Consulting Group
- Gramian Consulting
- Specialties
- Talent Solutions
- Technical Recruiting
- Staff Augmentation
- AI & Data Solutions
- and BOT
- Profile identifies a recruitment agency
- No
Gramian Consulting is your partner for accessing the engineering capabilities you need—delivered in the model that fits your business, from staff augmentation and talent recruiting to Build-Operate-Transfer (BOT). We combine the perspective of a software engineer, the rigor of a technical recruiter, and the vision of a business builder, so you get experts who understand your challenges and deliver results the right…
| Field | Value |
|---|---|
| Industry | IT Services and IT Consulting |
| Company size | 2-10 employees |
| Headquarters | Kumanovo |
| Organization type | Partnership |
| Year founded | 2025 |
| Specialties | Talent SolutionsTechnical RecruitingStaff AugmentationAI & Data Solutionsand BOT |
| Open jobs on Jobsy | 46 |
| View page |
About Gramian
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
About the Role
We are looking for Software Engineers to help train and evaluate next-generation AI models on real-world software engineering tasks. You will assess AI-generated code for correctness, quality, and design, create challenging programming problems with verified reference solutions, and evaluate model reasoning across architecture, debugging, and system design. This role is ideal for technically strong professionals who can identify engineering flaws and provide clear, actionable feedback to improve AI performance.
SENIORITY: Mid-Senior
LANGUAGE: Strong written English
Key Responsibilities
- Evaluate AI-generated code for functional correctness, code quality, maintainability, and sound software design.
- Create challenging coding problems, verified reference solutions, and comprehensive test cases.
- Review AI reasoning on software architecture, debugging, algorithms, and system design.
- Identify logical errors, inefficient implementations, edge cases, and architectural weaknesses.
- Provide detailed technical feedback and explanations to help improve AI model performance.
- Apply consistent evaluation criteria to ensure accurate and reliable assessments.
At least 3 years of overall professional experience in Data Science or Software Engineering.
At least 1 year of professional experience at a leading technology, finance, or research company.
A bachelor’s degree in Data Science, Software Engineering, Computer Science, or a related field from a university in the United States, Canada, Australia, New Zealand, or the United Kingdom.
Strong programming and software engineering fundamentals.
Ability to evaluate code correctness, identify bugs, and assess software design decisions.
Strong analytical thinking and the ability to solve complex technical problems.
Excellent written English and the ability to communicate technical feedback clearly.
Journal
Only you can see this. Kept on this device, and in your account when you sign in.