Writing.io Jobs

Find the best remote jobs. Answer a few questions and we'll deploy a powerful assistant to help you search, create alerts, and more.

1 What roles are you open to?

2 Experience level

3 Work style

Did you know? If memory is enabled, Writing.io can remember your job search preferences and help you to improve your resume, craft customized outreach and more.

Trainer Hospitalist / Internist - Medical AI Evaluation (Remote, Part-Time) at Mindrift

Practicing physician evaluates clinical vignettes and AI-generated medical content to improve medical AI systems through structured feedback and adjudication.

Mid Remote Posted about 21 hours ago RemoteFirstJobs Product
What this role involves

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
  • Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
  • Board certification or completed residency training, with recent direct patient care (attending-level preferred);
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $70/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Read the full description
Trainer Egyptian Arabic - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Egyptian Arabic AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Egyptian Arabic speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $10.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Arabic, as spoken in Egypt.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Hindi - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Hindi AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Hindi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $8.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Hindi, as spoken in India.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer French - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

French AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of French speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $20.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in French, as spoken in France.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Spanish (LatAm) - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots and language models through structured testing, conversations, and ratings to improve model quality and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Spanish (LatAm) AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Spanish (LatAm) speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $14.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Spanish, as spoken in Latin America.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Japanese - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model quality and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Japanese AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Japanese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $24.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Japanese, as spoken in Japan.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Indonesian - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing ratings and feedback to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Indonesian AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Indonesian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $10.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Indonesian, as spoken in Indonesia.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Indian English - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Indian English AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Indian English speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $8.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in English, as spoken in India.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Brazilian Portuguese - AI Product Evaluator at Productive Playhouse

Evaluate and test AI chatbots through structured interactions, providing feedback and ratings to improve model performance and safety.

Junior Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Brazilian Portuguese AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Brazilian Portuguese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $14.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Portuguese, as spoken in Brazil.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Egyptian Arabic - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots through structured text and voice interactions, rating their quality, safety, and helpfulness in Egyptian Arabic.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Egyptian Arabic AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Egyptian Arabic speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $10.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Arabic, as spoken in Egypt.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Hindi - AI Product Evaluator at Productive Playhouse

Evaluates Hindi AI chatbots through structured conversations, ratings, write-ups, screenshots, and recordings to improve model quality and safety.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Hindi AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Hindi speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $8.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Hindi, as spoken in India.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer French - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots through structured conversations, ratings, and written or recorded feedback to improve model quality and safety.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

French AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of French speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $20.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in French, as spoken in France.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Spanish (LatAm) - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots through structured conversations, ratings, and written or recorded feedback to improve model quality.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Spanish (LatAm) AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Spanish (LatAm) speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $14.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Spanish, as spoken in Latin America.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Japanese - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots through structured Japanese conversations, rates their quality and safety, and submits feedback, recordings, or written deliverables.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Japanese AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Japanese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $24.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Japanese, as spoken in Japan.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Indonesian - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots through structured conversations, ratings, and written or recorded feedback to improve model quality.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Indonesian AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Indonesian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $10.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Indonesian, as spoken in Indonesia.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Indian English - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots through structured conversations, ratings, written feedback, screenshots, and recorded voice interactions.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Indian English AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Indian English speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $8.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in English, as spoken in India.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Brazilian Portuguese - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots through structured conversations, ratings, recordings, and written feedback to improve model quality and safety.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Brazilian Portuguese AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Brazilian Portuguese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $14.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Portuguese, as spoken in Brazil.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Brazilian Portuguese - AI Product Evaluator at Productive Playhouse

Evaluates AI chatbots through structured conversations, ratings, and written or recorded feedback to improve model quality and safety.

Remote Posted about 23 hours ago RemoteFirstJobs Product
What this role involves

Brazilian Portuguese AI Product Evaluator

The Project

Productive Playhouse is building a talent pool of Brazilian Portuguese speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. While the project has not yet launched, we are actively reviewing applications to build a pool of qualified candidates. If selected, you’ll be among the first we contact when the project goes live. Apply today to be considered!

Open to freelancers based outside the U.S.

This is more than one job. Apply once, and we’ll keep you in mind for this project — and future ones that need your language skills.

The Details

We’re looking for independent contractor engagement (task-based - project-based).

  • Pay Rate: $14.00 USD per hour
  • 100% remote
  • You choose which tasks to take, set your own hours, and are free to work with other clients any time. You can stay flexible as the project evolves.
  • This is an iterative project, work arrives in batches (there may be pauses between them).

What You’ll Do

As an AI Evaluator, you’ll play a critical role in shaping and improving the next generation of Generative AI. You’ll participate in structured, hands-on evaluations by interacting directly with various AI models to assess their capabilities, safety, and helpfulness. Your insights and data will directly inform model development and optimization.

Exact tasks vary by project and will be spelled out in that project’s Statement of Work (SOW) before you start. Depending on the role, your work may include:

  • Testing and evaluating AI chatbots or language models through structured conversations, using assigned goals and prompts.
  • Voice-based interactions with AI models — for projects that involve this, sessions are recorded, and audio may be shared with the client as part of the evaluation deliverable.
  • Submitting deliverables (write-ups, ratings, screenshots, or recordings) in the format each task specifies.

What We’re Looking For

  • Native or expert-level fluency in Portuguese, as spoken in Brazil.
  • Strong English reading, writing, and communication skills - assessment maybe required
  • 18 years of age or older
  • Hands-on experience using AI models or large language models
  • Comfortable with both written and voice-based conversation — and good at asking sharp follow-ups
  • Your own smartphone, computer, reliable internet, and comfort with web-based tools
  • Able to pass a language proficiency and technical literacy assessment
  • Responsive communicator — quick replies move you through onboarding faster
  • Able to start within 48 hours

Why PPH?

Your language skills are the whole point — and this project pays for them

Apply once, get contacted directly when a spot opens — no chasing

Work from anywhere, on your own schedule, alongside any other work you do

Clear task specs, no ongoing oversight, no micromanagement

Real project experience with a global data and language services company

Work that actually improves how AI understands your language

About Productive Playhouse

We started by teaching kids through award-winning programming. We grew into a global data and language services company trusted by clients worldwide. But the mission never changed: keep language alive.

Transcription, translation, localization, linguistic analysis, AI evaluation — it all comes back to preserving languages and the cultures they carry.

All engagements are contingent upon successful completion of identity verification. Productive Playhouse is an equal opportunity organization headquartered in California and committed to diversity and inclusion across our global workforce. We welcome applicants of all backgrounds and abilities, regardless of location or engagement type. For accommodations or inquiries, please contact HR.

Read the full description
Trainer Assamese Language Expert - Fully Remote | Upto $20/hr Part-time

Provides Assamese language expertise to support AI research lab projects on a part-time basis.

Remote Posted about 23 hours ago Himalayas
What this role involves
About the jobMercor connects elite creative and technical talent with leading AI research labs.
Read the full description
Trainer Physicians (MD/DO) - Review Clinical Cases for Medical AI, Remote, Up to $70/hr at Mindrift

Evaluates clinical AI outputs and reasoning, scores medical benchmark cases, identifies errors, and writes rationales as a licensed physician.

Senior Remote Posted 2 days ago RemoteFirstJobs Product
What this role involves

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
  • Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
  • Board certification or completed residency training, with recent direct patient care (attending-level preferred);
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $70/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Read the full description