EvolutionToronto
Principal Team Lead Machine Learning Engineer
Toronto, CA
Hybrid (2 days onsite)
$150,000-$200,000 (DOE)
Evolution is partnering with a world class company specializing in research and development aiding advancement within the HealthTech...
Apex SystemsCanada
Are you fascinated by machine learning and building robust machine learning pipelines which process massive amounts of data at scale and speed to provide crucial insights to the end consumers?. Good understanding of machine learning pipelines and machine learning frameworks such as TensorFlow and Py...
Pyramid Consulting, IncToronto
Software Engineer, Machine Learning. ...
Empire LifeCanada
Empire life is looking to hire a Machine Learning Engineer to join our Data Science team! The Machine Learning Engineer plays a pivotal role in integrating Machine Learning (ML) models and Generative AI (GenAI) solutions into complex systems and applications.
Your expertise in AI technologies, machi...
Bank of MontrealToronto
Machine Learning Engineer page is loaded Machine Learning Engineer Apply locations Toronto, ON, CAN posted on Posted Yesterday job requisition id R
Application Deadline:
06/27/2024
Address:
100 King Street West
Job Family Group:
Data Analytics...
AdventInfotechOntario
This vacancy is to work onsite in US with the TN VISAResponsibilities:Lead the design, development, and deployment of complex machine learning models and algorithms to address business challenges and opportunities.Provide technical leadership...
RibbonToronto
Machine Learning Internship at Ribbon
Welcome to the Machine Learning Internship opportunity at Ribbon! Are you passionate about machine learning, data science, and playing a pivotal role in driving innovation through analytics and algorithm...
Diversis Capital LLCToronto
About the Role: As a Senior Engineering Manager of Machine Learning, you will lead a talented team of machine learning and data engineers to develop cutting-edge machine learning solutions.
You will be responsible for driving innovation, shaping...
Get new jobs by email!
Get email updates for the latest Machine Learning jobs in Toronto
It's free, and you can cancel email updates at any time
Machine Learning Engineer (LLM Infrastructure) - Toronto
Prodigy Labs | Toronto | Full-time | apply.workable.com |
We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high performance and reusable APIs and can also apply them in real production settings.
Please Note: This is a hybrid position and will require at least 2 days in the office per week. Successful candidates will need to complete a background check.
Responsibilities
• Architect/Enable distributed compute aligning workloads to Small/Mid/High end GPUs
• Leverage appropriate storage hardware and data formats to improve read/re-read efficiency
• Identify and remediate latency contributors especially IO bottlenecks, inefficient data shuffling, under/over utilized compute
• Scale models by employing distributed training using Data / Model Parallelism techniques
• Parallelize inference processing to improve prediction latency.
• Provide Subject Matter Expertise in Graph and Vector databases for various use cases including Knowledge Graphs, RAG etc.
• Implement LLM observability and monitoring solutions
• Manage infrastructure and large-scale system design and diagnose both model and system failures
• Mitigate reputation risk through AI driven Data Quality to ensure highest quality data and services are offered to clients
Requirements
• 5-6 years of AI, Big Data and cloud expertise
• 3-4 years of Alternative data experience
• 2+ years of experience building machine learning training pipelines or inference services in a production setting
• Experience with LLM deployment, fine tuning, training, prompt engineering, etc
• Experience with LLM inference latency optimization techniques, e.g. kernel fusion, quantization, dynamic batching, etc.
• Experience with CUDA, model compilers, and other model-specific optimizations
• Experience building, deploying, and monitoring complex microservice architectures.
• Degree in Computer Science or Engineering
• Prior Experience with: -Docker, Kubernetes, Infrastrure as code (Terraform)and containerization, Agile Methodology, Distributed systems, Databricks ML, Cloud (Azure (preferred) or AWS)
• Expert level – Python, SQL
• Experience (or knowledge of) Mosaic ML, Ray Framework
• Experience with Lang Chain or LlamaIndex
• Experience with any vector database
Nice to have
• Experience building front to back data pipelines comprising of data ingestion, enrichment, data quality, Analytics and reporting
• Experience with company KPIs and back testing of alternative data factors against company KPIs
• Experience with NLP techniques and transfer learning frameworks like BERT
• Experience with using HuggingFace Model Artifacts
Benefits
Why You'll Love Working at Prodigy
• We are a collective group of people and collaboration is key to our process
• We don’t work for our clients, we work with them
• A Flexible Hybrid Working Environment
• Easily accessible downtown location
• Competitive compensation commensurate with experience
• Everyone brings something valuable to the table in our supportive, challenging, and collaborative, diverse work environment
All Employees Can Participate in:
• Company paid health benefits: 100% medical, dental and vision coverage
• Corporate-discounted Gym Membership through GoodLife
• Company discount program including Travel, Shopping, Attractions, Wellness, & Sporting events, just to name a few
• Access to an Employee & Family Assistance program (EAP)
• Employee Referral Program
• Employee Opportunity Program
• Professional Development Program
• Town Halls
• Philanthropic Events
• Social Events
Accessibility
Prodigy is committed to providing equitable treatment and accommodation to ensure a barrier-free recruitment process and workplace. If you require accommodation at any stage during the recruitment process, please contact us at accessibility@prodigylabs.net or call 416-488-7700 ext. 4
Inclusion & Diversity
At Prodigy we foster an inclusive and diverse workforce, believing our strength stems from our individual differences. Our employees, partners, and clients continuously benefit from the innovation and creativity grounded in these values. We strive to be a company that attracts a diverse group of highly skilled people who know that their contributions will be valued and that they will be heard.
We are committed to building a corporate culture with people who are excited to join our team, do their best work, and grow with us!
Please Note: This is a hybrid position and will require at least 2 days in the office per week. Successful candidates will need to complete a background check.
Responsibilities
• Architect/Enable distributed compute aligning workloads to Small/Mid/High end GPUs
• Leverage appropriate storage hardware and data formats to improve read/re-read efficiency
• Identify and remediate latency contributors especially IO bottlenecks, inefficient data shuffling, under/over utilized compute
• Scale models by employing distributed training using Data / Model Parallelism techniques
• Parallelize inference processing to improve prediction latency.
• Provide Subject Matter Expertise in Graph and Vector databases for various use cases including Knowledge Graphs, RAG etc.
• Implement LLM observability and monitoring solutions
• Manage infrastructure and large-scale system design and diagnose both model and system failures
• Mitigate reputation risk through AI driven Data Quality to ensure highest quality data and services are offered to clients
Requirements
• 5-6 years of AI, Big Data and cloud expertise
• 3-4 years of Alternative data experience
• 2+ years of experience building machine learning training pipelines or inference services in a production setting
• Experience with LLM deployment, fine tuning, training, prompt engineering, etc
• Experience with LLM inference latency optimization techniques, e.g. kernel fusion, quantization, dynamic batching, etc.
• Experience with CUDA, model compilers, and other model-specific optimizations
• Experience building, deploying, and monitoring complex microservice architectures.
• Degree in Computer Science or Engineering
• Prior Experience with: -Docker, Kubernetes, Infrastrure as code (Terraform)and containerization, Agile Methodology, Distributed systems, Databricks ML, Cloud (Azure (preferred) or AWS)
• Expert level – Python, SQL
• Experience (or knowledge of) Mosaic ML, Ray Framework
• Experience with Lang Chain or LlamaIndex
• Experience with any vector database
Nice to have
• Experience building front to back data pipelines comprising of data ingestion, enrichment, data quality, Analytics and reporting
• Experience with company KPIs and back testing of alternative data factors against company KPIs
• Experience with NLP techniques and transfer learning frameworks like BERT
• Experience with using HuggingFace Model Artifacts
Benefits
Why You'll Love Working at Prodigy
• We are a collective group of people and collaboration is key to our process
• We don’t work for our clients, we work with them
• A Flexible Hybrid Working Environment
• Easily accessible downtown location
• Competitive compensation commensurate with experience
• Everyone brings something valuable to the table in our supportive, challenging, and collaborative, diverse work environment
All Employees Can Participate in:
• Company paid health benefits: 100% medical, dental and vision coverage
• Corporate-discounted Gym Membership through GoodLife
• Company discount program including Travel, Shopping, Attractions, Wellness, & Sporting events, just to name a few
• Access to an Employee & Family Assistance program (EAP)
• Employee Referral Program
• Employee Opportunity Program
• Professional Development Program
• Town Halls
• Philanthropic Events
• Social Events
Accessibility
Prodigy is committed to providing equitable treatment and accommodation to ensure a barrier-free recruitment process and workplace. If you require accommodation at any stage during the recruitment process, please contact us at accessibility@prodigylabs.net or call 416-488-7700 ext. 4
Inclusion & Diversity
At Prodigy we foster an inclusive and diverse workforce, believing our strength stems from our individual differences. Our employees, partners, and clients continuously benefit from the innovation and creativity grounded in these values. We strive to be a company that attracts a diverse group of highly skilled people who know that their contributions will be valued and that they will be heard.
We are committed to building a corporate culture with people who are excited to join our team, do their best work, and grow with us!
Recommended jobs: