סקירה כללית
Straive is a global leader in enterprise-grade data analytics and AI solutions, committed to empowering businesses across various industries with cutting-edge technology and expert insights. Backed by EQT, a top private equity firm, we are uniquely positioned to drive innovation through significant investments and an entrepreneurial spirit. Our core focus is on delivering advanced Data Analytics & AI Solutions. By combining sophisticated technology with subject matter expertise, we deliver material impact on our clients’ topline and streamline their operations. We specialize in providing tailored solutions across financial services, CPG, legal, pharma, life sciences, retail and logistics, helping them build robust data analytics and AI capabilities. With a client base spanning 30 countries, Straive’s strategically located teams operate from eight countries and is headquartered in Singapore. This global presence enables us to offer localized expertise with a worldwide perspective. Join Straive to be part of a dynamic team at the forefront of data analytics and AI innovation. Here, you’ll have the opportunity to contribute to transformative projects, supported by significant investments and an entrepreneurial drive fueled by our partnership with EQT. Website: https://www.straive.com/ Linkedin Job Title: Evaluator
– Biotechnology Location: Remote (USA) Job Type: Contract Key Responsibilities: 1. Review and Validate AI Responses: a) Evaluators will work via our online platform. b) All decisions of the Evaluators must be guided towards evaluating this central theme: usefulness of the AI response. This is the primary metric for measuring AI response quality: Is the AI response useful in addressing the question posed in the user prompt c) The goal is to assess the quality, safety, and utility of AI-generated content- particularly in use cases like literature summarization, clinical question answering, and decision support. Each AI generated response should be scored across 10 key criteria. d) Evaluators must use a Likert scale (4=Great, 3=Good, 2=Fair, 1=Poor) on the first six criterion, and pass’ or ‘fail’ on the remaining four. e) A commentary must be provided on the AI response, and flag critical issues (e.g., hallucinations, or, ethical/safety concerns). f) Commentaries must be error-free, concise and consistent with established medical guidelines, evidence-based practices, and current clinical standards. Rewriting the commentary and revisiting the evaluation may also be within scope based on feedback from quality checks. 2. Stay Current with latest in their domain: Stay up-to-date with the latest research, guidelines, and advancements in your area of expertise, ensuring that their validation and feedback are informed by the most current and accurate information. 3.Maintain Confidentiality: Adhere to strict confidentiality of the data received for processing and comply with data protection protocols and other relevant laws and guidelines. Requirements: 1. PhD or Masters in Biotechnology. 2. Research Experience: Have a minimum of 2 years of research experience in a reputed institution or laboratory. 3. Strong subject matter expertise. 4. Excellent Communication Skills: Possess excellent written skills, with the ability to clearly articulate complex clinical concepts and provide concise commentaries on shortcomings of AI response. 5. Familiarity with AI and Technology: Have a basic understanding of Generative AI usage pertaining to healthcare information processing. This job description is not intended to cover or contain a comprehensive listing of all responsibilities, duties, or activities that are required. Responsibilities, duties, and/or activities may change, or new ones may be added at any time with or without notice. If you are a motivated professional with a passion for delivering impactful solutions, we’d love to hear from you. Apply today to be part of a dynamic and forward-thinking team at Straive. “Straive is an Equal Opportunity Employer. Our policy is clear: there shall be no discrimination based on age, disability, sex, race, religion or belief, gender reassignment, marriage/civil partnership, pregnancy/maternity, or sexual orientation. We are an inclusive organization and actively promote equality of opportunity for all with the right mix of talent, skills and potential. We welcome all applications from a wide range of candidates. Selection for roles will be based on individual merit alone.”
דרישות המשרה
1. Review and Validate AI Responses: a) Evaluators will work via our online platform. b) All decisions of the Evaluators must be guided towards evaluating this central theme: usefulness of the AI response. This is the primary metric for measuring AI response quality: Is the AI response useful in addressing the question posed in the user prompt c) The goal is to assess the quality, safety, and util
