Senior Machine Learning Engineer- AIOS
Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments.
Our portfolio includes Zafin AIOS, an agent orchestration platform for governed AI work; the Zafin Banking Platform, which helps banks modernize product, pricing, offers, billing, loyalty, and relationship management; and Zafin IO, an integration platform that connects data, systems, and workflows across complex enterprise environments.
Headquartered in Toronto, Canada, Zafin partners with leading financial institutions across North America, Europe, the Middle East, Africa, and Asia-Pacific. As AI transforms the future of financial services, we're building the platforms that help regulated organizations adopt AI responsibly and at scale.
What is the Opportunity?
As a Machine Learning Engineer, part of Zafin's AIOS Product team, you will build the machine learning and AI systems that power the AIOS Knowledge Fabric and help agents reason over enterprise knowledge with accuracy, traceability, and control.
You will work on practical production systems, including retrieval, ranking, embeddings, model integration, evaluation, data pipelines, model serving, observability, and the workflows that make AI outputs reliable for regulated banking environments. This is a hands-on engineering role focused on turning ML and LLM capabilities into dependable product infrastructure.
This role is critical for high-quality knowledge, strong evaluation, and reliable model behavior. You will help build the foundation that allows customers to use AI agents with confidence, accountability, and measurable business value.
What Will You Do?
- Design, build, test, and maintain ML and AI capabilities for AIOS, with a focus on knowledge retrieval, model integration, and production reliability.
- Develop systems for embeddings, vector search, ranking, retrieval-augmented generation, knowledge ingestion, and knowledge quality improvement.
- Build and improve model evaluation workflows, test sets, scoring approaches, quality metrics, and monitoring for AI and LLM-based systems.
- Partner with AI engineers, data engineers, product managers, architects, and domain experts to translate product needs into ML system designs and working software.
- Write production-quality Python or equivalent code, including services, pipelines, automation, tests, and integration points with product systems.
- Improve ML system performance, latency, cost, reliability, and observability in production and pre-production environments.
- Work with structured and unstructured enterprise data, including documents, metadata, knowledge sources, customer data, and operational signals.
- Support responsible AI practices by improving traceability, explainability, governance, auditability, privacy, and human review workflows.
- Create technical documentation, model cards or evaluation notes where useful, implementation guidance, and operational runbooks.
- Stay current with ML, LLM, RAG, evaluation, and MLOps practices and bring practical improvements into the AIOS product.
What Do You Need to Succeed?
Must haves
- 5+ years of software engineering, machine learning engineering, data science engineering, or applied ML experience building production systems.
- 2+ years of hands-on experience with production ML, LLM applications, retrieval-augmented generation, NLP, search, recommendation, or AI-powered automation.
- Strong programming skills in Python and experience building maintainable, tested, production-quality code.
- Practical experience with ML frameworks, LLM APIs or open-source models, embeddings, vector databases, retrieval systems, or model-serving patterns.
- Strong understanding of data pipelines, feature or knowledge preparation, model evaluation, experiment tracking, and performance measurement.
- Solid software engineering fundamentals, including APIs, databases, testing, debugging, version control, and system design.
- Ability to analyze model behavior, diagnose quality issues, and improve systems using both quantitative metrics and qualitative reviews.
- Strong communication skills, with the ability to explain ML trade-offs, model behavior, and technical recommendations to product and engineering stakeholders.
- Bachelor's degree in Computer Science, Engineering, Machine Learning, Statistics, Mathematics, or a related technical field, or equivalent practical experience.
Nice to have
- Experience building RAG systems, knowledge graphs, document understanding systems, semantic search, or enterprise knowledge platforms.
- Experience with MLOps practices, model monitoring, model registries, CI/CD for ML, or deployment of ML services in cloud environments.
- Experience with Azure, Kubernetes, Docker, distributed data processing, or scalable data infrastructure. Experience with banking, financial services, compliance, risk, or other regulated industry data.
- Experience with AI evaluation, safety testing, hallucination mitigation, prompt testing, or governance controls for LLM systems.
- Experience collaborating with product teams to turn ambiguous AI capabilities into usable product features.
- Experience with security, privacy, data access controls, audit trails, and responsible AI requirements.
- Published research, open-source contributions, patents, or technical writing related to ML, NLP, search, or AI systems.
Additional Job Details
At Zafin, we invest in our people. Our comprehensive rewards program is designed to support your health, financial well-being, and work-life balance, including:
- * Fully company-paid health benefits
- Annual bonus opportunities
- Generous vacation and holidays
- RRSP matching
- Employer-paid insurance coverage
- Wellness resources
- Extensive paramedical benefits, and more
- Vacancy Status: Open Position to be filled
- Expected Salary range: Hiring for multiple levels depending on candidate's experience and competence
- Mode of Work: Hybrid
- Use of AI: Zafin may use Artificial Intelligence (AI) and/or other forms of automated technology to screen and/or assess applicants for this position. Zafin will not utilize AI for conducting interviews and/or making hiring decisions.
What’s in it for you
Joining our team means being part of a culture that values diversity, teamwork, and high-quality work. We offer competitive salaries, annual bonus potential, generous paid time off, paid volunteering days, wellness benefits, and robust opportunities for professional growth and career advancement. Want to learn more about what you can look forward to during your career with us? Visit our careers site and our openings: zafin.com/careers
Zafin welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.
Zafin is committed to protecting the privacy and security of the personal information collected from all applicants throughout the recruitment process. The methods by which Zafin contains uses, stores, handles, retains, or discloses applicant information can be accessed by reviewing Zafin’s privacy policy at https://zafin.com/privacy-notice/. By submitting a job application, you confirm that you agree to the processing of your personal data by Zafin described in the candidate privacy notice.
About Zafin
Zafin is a global enterprise software banking company that enables banks to optimize multiple revenue streams across retail/corporate banks.