Evaluate and audit AI-generated chatbot conversations based on naturalness, engagement, utility, and audio quality following specific guidelines.
Project Overview:
Are you a professional linguist or do you hold an academic degree in translation?
We are hiring professional linguists (or people who have an academic degree in translation) to join a fascinating project focused on auditing and evaluating the quality of conversations generated by two different AI models. As a linguist on this project, you will assess chatbot conversations based on a set of core dimensions, thus helping to improve the quality of AI-driven communication.
Job Type: Freelance
Location: Remote
Work Schedule: Part-time - 10+ hours per week. Flexible - work whenever you want.
Start Date: Immediately
Rate: 13 USD / hour
What We Offer:
- Flexible Schedule: You have the freedom to complete your daily hours at any time that suits you, day or night.
- Competitive Rates: We offer competitive compensation for your expertise.
- Future Opportunities: Successful linguists may be invited to join our vetted pool for similar exciting projects in the future.
- Cutting-Edge Project: Be part of a project that's at the forefront of AI development and conversational technology.
Responsibilities:
- Audit and evaluate chatbot conversations based on three core dimensions: Naturalness/Engagement, Utility, and Audio Quality.
- Follow project-specific guidelines to ensure consistent and accurate evaluations.
- Use a proprietary client platform to complete your tasks.
- Preferably, meet a daily workload of approximately 4 hours per business day.
Requirements:
- A degree in Translation/Linguistics or a related field OR experience as a professional linguist.
- Native-level fluency in Bengali (India).
- Available to start on or around June 1st.
- Full availability for the entire 2-month project duration.
- Ability to commit to a workload of approximately 4 hours per business day - preferably.
- Must be a freelancer (we are not engaging with companies for this project).
- Must be willing to take a project-specific qualification test.
Recruitment Process:
- Application Review: We will review your application to ensure you meet the basic requirements.
- Language Knowledge test: You’ll complete a short assessment in English, and also in your target language .
- Onboarding: Once you pass the test, you'll go through a streamlined onboarding process to get you started.
- Qualification Test: You will be asked to complete a short, automated test based on the project guidelines to ensure you understand the task.
Vendor Type
When applying, please select the option that best describes your working status.
Are you a Freelancer or Private Individual?
A Freelancer is someone who has a business license and may have a VAT number or EIN for tax purposes. A VAT (Value Added Tax) number is a unique identifier assigned to registered businesses in many countries; an EIN (Employer Identification Number) is a similar identifier used in the US. A Private Individual does not have a business license. If you aren’t sure, you are probably a private individual.
RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.
#LI-PR15
#LI-PR15
Similar Jobs
Professional Services • Real Estate • Consulting
The Finance Manager oversees statutory compliance and financial reporting in Japan, manages a finance team, and drives the implementation of D365, ensuring financial operations align with Japanese regulations.
Top Skills:
Microsoft Dynamics 365 (D365)
Information Technology • Software • Consulting • App development
Design engaging gameplay experiences, levels, and characters for 2.5D games while collaborating with developers to implement design specifications and improve player engagement.
Top Skills:
Unity
Artificial Intelligence • Information Technology
Perform data collection, evaluation, and annotation to improve AI-generated Bengali content across audio, video, images, and text. Tasks include pairwise comparisons, counting, object tagging, and labeling. Part-time freelance remote role requiring native Bengali fluency and fluent English; AI/data experience preferred.
Top Skills:
AIData AnnotationData CollectionData EvaluationMachine Learning
What you need to know about the Manchester Tech Scene
Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.
