What you'll do at Jamf:
The AI Quality and Safety Engineer is a specialized role dedicated to ensuring the highest standards of quality, effectiveness, safety, and reliability in our Large Language Model applications and features. This position involves creating and implementing robust testing frameworks, evaluating the performance and safety of AI-driven designs, and ensuring our products adhere to ethical AI practices. The role is central to our commitment to delivering innovative, user-centric, and responsible AI solutions.

What you can expect to do in this role:

• Develop and implement comprehensive testing strategies and frameworks for LLM features, focusing on functionality, performance, user experience, and safety.
• Design and conduct comparative analyses to evaluate different LLM designs, prompt strategies, and user interactions, ensuring the most effective and user-friendly implementations are identified.
• Take the lead on AI safety and responsibility initiatives, ensuring all LLM applications comply with ethical AI principles, data privacy standards, and regulatory requirements.
• Collaborate with AI researchers, product teams, and UX designers to integrate quality and safety considerations into the product development lifecycle from inception through deployment.
• Identify, document, and mitigate risks associated with LLM features, including bias, fairness, transparency, and potential misuse.
• Develop metrics and monitoring systems to continually assess the quality and safety of LLM applications in real-world scenarios, facilitating ongoing improvement.
• Stay abreast of the latest developments in AI ethics, safety research, and quality assurance methodologies, integrating cutting-edge practices into our QA processes.
• Serve as an internal advocate for responsible AI, educating and advising the team on best practices for ethical AI development and deployment.

What we are looking for:

• Proven experience in QA engineering, with a strong understanding of software testing methodologies and frameworks.
• Familiarity with AI and machine learning technologies, especially Large Language Models, including their design, capabilities, and limitations.
• Knowledge of AI ethics and safety principles, with the ability to translate these into practical testing and evaluation strategies.
• Excellent analytical and problem-solving skills, with a detail-oriented approach to identifying and addressing quality and safety issues.
• Strong communication skills, capable of effectively collaborating with cross-functional teams and articulating technical concepts to non-technical stakeholders.
• A commitment to lifelong learning, with a keen interest in staying updated on AI advancements, QA best practices, and ethical AI discussions.
• 2 year / Associates (Required)
• 4 year / Bachelors Degree (Preferred)
• A combination of relevant experience andeducation may be considered

Why Jamf?

• We constantly push the boundaries of technology, our developers support new innovations and OS releases the moment they are made available by Apple.

• Several Jamf engineers are named in patents and with team names like CatDog, ThunderSnow and Dalek you can expect to have some fun while building cutting-edge software.

• You will have the opportunity to work with a small and empowered team where the culture is based on trust, ownership, and respect.

• We offer a clear career path that enables you to grow under supportive leadership and management

• Visit our Jamf Engineering blog to learn more about the innovative projects our team is working on and what we learn from each challenge we solve. A blog written by engineers, for engineers atmedium.com/jamf-engineering

JAMF is an equal opportunity employer and does not discriminate with regard to race, color, national origin, age, religion, disability, gender, sexual orientation, gender identity, genetic information, familial status, marital status, military status, or any other characteristics protected by federal, state, and local applicable fair employment practices laws.

The requirements and demands in this description represent those that must be met by an employee to successfully perform the functions of this job. This is not intended to be an exhaustive list of all responsibilities, skills, efforts, or working conditions associated with the job, rather it is intended to be a reflection of those essential for recruitment and selection, for making fair job evaluations and for establishing performance expectations. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Nothing in this job description restricts management's right to assign or reassign duties and responsibilities to this job at any time. This document does not create an employment contract, implied or otherwise. It does not alter the "at will" employment relationship between the company and the employee.