Upwork has partnered with an Enterprise client, a global Data Engineering company delivering AI to many of the world’s most prestigious companies. They provide AI-enabled software platforms and managed services for AI data collection/annotation, AI digital transformation, and industry-specific business processes.
They are seeking freelancers with a PhD in Computer Science, Machine Learning, or Statistics to participate in a survey aimed at evaluating academic abstracts and improving the effectiveness and trustworthiness of AI-generated summaries. As a participant, you will act as an abstract reviewer, critically assessing content based on provided project guidelines. Your contribution will help advance responsible AI (RAI) and cutting-edge research involving large language models (LLMs).
This project may take up to 2.5 hours to complete (including a 30-min orientation session, plus 2 hours for the survey), and there’s a potential for ongoing work beyond this initial contract. The survey must be completed in one sitting, and can be completed at any time of your choosing.
Participants will receive credentials with a unique identifier for completing the survey, ensuring anonymity. The client will also provide a point of contact to address any technical difficulties.
The task consists of three components:
1. Orientation
A live 30-minute session for reviewing project guidelines, answering preliminary questions (such as"What’s your field of study?"), and discussing any questions about the project. The date and time haven’t yet been determined, but the client will provide documents for you to review on your own time as well in case you’re unavailable to join.
2. Abstract Evaluation
Reviewing three short abstracts and answering five questions per abstract using a Likert Scale. No need to read or reference the full paper provided —only the abstract.
3. Abstract Comparison
Comparing three abstracts side by side and answering four related questions.
The maximum budget for this one-time, fixed-price project is $175-200. You’ll be asked via screening questions to provide your bid.
Next steps:
There is no test task or assessment required for this project.
This Enterprise client utilizes Upwork Compliance. If you receive a contract offer, you may be asked via email to provide documentation in order for the worker classification review to be completed.
If an employer mentions a salary or salary range on their job, we display it as an "Employer Estimate". If a job has no salary data, Rise displays an estimate if available.
Are you a detail-oriented individual with a PhD in Computer Science, Machine Learning, or Statistics? If so, Upwork has an incredible opportunity for you as an Academic Abstract Reviewer with a prestigious global Data Engineering company. This forward-thinking organization specializes in delivering AI solutions to some of the world's top companies, and they’re looking for experts like you to contribute to a groundbreaking project aimed at enhancing the trustworthiness of AI-generated summaries. As an abstract reviewer, you'll dive deep into evaluating academic abstracts based on specific guidelines, and every bit of your insight will further the field of responsible AI (RAI). The task involves participating in a brief 30-minute orientation, followed by a survey where you'll review three abstracts and provide your assessments. This is a flexible job, allowing you to complete the survey whenever it suits you, and it has the potential for more work in the future! Plus, you'll be fully supported with technical assistance and provided with all the necessary credentials to ensure your anonymity throughout the project. If you thrive on intellectual challenges and want to make a meaningful contribution to cutting-edge research in large language models (LLMs), continue your journey with us at this innovative company in Toronto, ON!
Our vision is independent talent at the heart of every business. Our mission is to create economic opportunities so people have better lives.
3203 jobsSubscribe to Rise newsletter