Hindi AI Product Tester

Active Project Status: This project is now live, and we are urgently onboarding participants to begin immediately. Because we are moving quickly, we kindly ask that you keep a close eye on your communication (email and messages) after applying. It is essential that you respond promptly so we can get you cleared and ready to start without delay.

Location: 100% Remote, global

Device: Applicants must own a qualifying Google Pixel device for the duration of the project

Compensation:USD $140.00 upon successful completion of the 14 qualified submissions (each submission should take 10–15 minutes of activity per day)

Project Requirements

• Native or expert-level fluency in Hindi
• Comfortable reading and writing in English
• Must complete a language proficiency assessment as part of the application process
• Must be comfortable using a Google Pixel 9 or newer device
• Must be comfortable downloading and using common mobile applications that generate notifications (messaging apps, email apps, social media apps, etc.)
• Must be comfortable using the Google Pixel device as their primary phone for the duration of the project
• Must be willing to participate daily for 14-21 consecutive days
• Must be 18 or older to meet project eligibility requirements
• Must have access to reliable Wi-Fi/internet
• Participants must be able to read and understand instructions and company communications in English

The Project

We are seeking detail-oriented and motivated speakers to participate in an upcoming notification sorting project.

Participants will use a Google Pixel 9 or newer device throughout the project period while interacting naturally with apps that generate notifications. Participants will complete daily project tasks involving notification organization/sorting workflows and provide related feedback/documentation as instructed.

Participants will also complete a short daily feedback/check-in form throughout the duration of the pilot to assist with participation tracking and troubleshooting support.

This project is part of an ongoing effort to improve emerging mobile AI and notification-management technologies for international users.

Workload

• Participants will engage with the project daily until 14 qualified submissions have been submitted.
• Expected daily participation time may vary slightly depending on notification volume and project tasks, but participants should expect approximately 10–15 minutes of activity per day.
• This is project-based work, and there is no guarantee of additional work beyond the pilot period. However, participants who perform well may be considered for future related projects.

Duties

• Use a Google Pixel 9 or newer device throughout the project duration
• Interact naturally with apps that generate notifications
• Complete assigned notification sorting / organization tasks
• Submit required daily feedback and documentation
• Follow all provided project instructions carefully
• Communicate promptly regarding technical issues or project blockers
• Perform all work with attention to quality, completeness, and detail

Engagement Requirements

All participants must have, or be willing to create, an Upwork account. The project will be managed via the Upwork platform.

While participating in this project, adherence to the confidentiality terms outlined in the Upwork User Agreement is required. Any information accessed or received related to this project is confidential and may not be shared or disclosed to third parties.

Participants must:

Use their own qualifying Google Pixel device.

Qualifying Device Examples

Google Pixel 9

Google Pixel 9 Pro

Google Pixel 10

Google Pixel Fold (newer generation)

Please note:Google Pixel 9a and Pixel 10a devices are not compatible with project requirements.

About Us:

As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children’s language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service.

Originally founded as an educational production company, Productive Playhouse made a mark with our award winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.

Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity.  Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.

At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time.

Disclaimer:

All engagements are contingent upon successful completion of a background screening. Productive Playhouse is committed to diversity and inclusion across our global contractor network. We welcome applicants of all backgrounds and abilities.

About UsUdacity is now an Accenture company, and exciting things are happening!

Are you experienced in garment manufacturing quality control and interested in helping train the next generation of AI systems? As AI models are increasingly applied to global manufacturing, supply chain...

About the jobMercor connects elite creative and technical talent with leading AI research labs.

Role Title: Voice Recorder (Japanese + English) Role Type: ContractorLocation: Remotemicro1 is engaging Japanese bilingual experts to contribute to a customer's audio project focused on advancing machine learning.

We’re looking for experts in LATAM to record short, first-person videos of everyday manual tasks using a head-mounted smartphone. Tasks include household activities such as cleaning, organizing, and laundry, as...

Headquarters:

We are looking for experienced personal finance professionals to support the training and evaluation of AI models. You should have hands-on experience advising individual clients or households on real-world financial decisions.

Areas of Expertise

• We are seeking talent with experience in one or more of the following:
• Personal Tax: Individual tax returns (1040), tax planning, capital gains, self-employment and quarterly taxes
• Investments & Retirement: Portfolio management, asset allocation, 401(k), IRA/Roth, rebalancing and Social Security
• Financial Planning: Budgeting, cash flow, debt, financial goals and comprehensive household planning
• Estate Planning: Estate/gift tax, trusts, beneficiary planning and fiduciary accounting (non-attorney roles)
• Debt & Life Events: Student loans, mortgages, credit cards, home affordability and 529/college planning
• Equity Compensation & Self-Employed Finances: RSUs, stock options, ESPPs and freelancer/self-employed finances

Ideal Candidates

• US-based professionals with direct experience advising individuals or households
• 5+ years of relevant experience preferred
• Credentials such as CFP, CPA, EA, PFS or CTFA are a plus
• Comfortable explaining financial concepts and evaluating real-world personal finance scenarios
• Experience working with everyday/middle-income households is especially valuable

To apply: https://weworkremotely.com/remote-jobs/toptal-expert-crowd-personal-finance-consultants-for-ai-model

About the jobMercor connects elite creative and technical talent with leading AI research labs.

About the jobMercor connects elite creative and technical talent with leading AI research labs.

Senior Backend Engineer

Job Description

Role Title: Senior Backend Engineer

Role Type: Contractor (20 hrs perweek)

Location: Remote

micro1 is engaging Senior Backend Engineers to participate in an advanced project for a customer, focused on creating sophisticated Reinforcement Learning Environments for AI model training and evaluation. In this role, you’ll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

As an expert, you will create Reinforcement Learning Environments that test an AI model’s ability to design, deploy, troubleshoot, secure, scale, and recover production-grade cloud infrastructure. You will develop realistic scenarios involving distributed systems, networking, IAM, queues, durable storage, observability, rolling deployments, and disaster recovery, then build reproducible environments, deterministic validation tests, golden reference solutions, and intentionally defective variants.

Scope of Work

1. Design, develop, and implement realistic cloud infrastructure environments to evaluate AI model proficiency in systems design, deployment, and troubleshooting.
2. Create detailed and reproducible scenarios involving distributed systems, networking, Identity and Access Management (IAM), message queues, persistent storage, observability, rolling deployments, and disaster recovery.
3. Develop deterministic validation tests and golden reference solutions to ensure the reliability and accuracy of reinforcement learning environments.
4. Produce intentionally defective variants and failure scenarios to rigorously test AI model responses and recovery strategies.
5. Document the architecture, edge cases, and operational flows for all developed environments, ensuring clarity and reproducibility for future use.
6. Collaborate with technical leads and project participants to iteratively refine environment specifications and acceptance criteria.
7. Apply DevOps and infrastructure automation practices to deliver scalable, secure, and maintainable solutions for cloud-based systems evaluation.

Preferred Qualifications

1. Proven expertise with backend programming languages, such as C++, Python, Rust, GoLang, JAVA, or JavaScript.
2. Strong practical experience with DevOps, cloud infrastructure, CI/CD pipelines, and automation tools.
3. Demonstrated ability to architect, scale, and secure distributed systems in production-grade environments.
4. Deep understanding of networking, IAM, queues, durable storage, and disaster recovery concepts.

Process:

1. Apply to the role, filling out the screening questions
2. Complete AI interview (aprox. 30 minutes), reviewed by recruiters)
3. Hiring Manager review

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

micro1 – Company Profile

micro1 is a US-based technology company focused on AI-powered hiring and talent solutions. It connects companies with highly skilled remote technical professionals and uses AI-driven assessments and interviews to evaluate candidates.

The company works across areas such as software engineering, AI/ML, data, cloud, DevOps, and other technical domains. For specialized projects, micro1 also engages experts to contribute to AI training and evaluation, including creating real-world technical environments and scenarios that help improve AI models.

For this particular opportunity, candidates are being engaged as remote contractors for approximately 20 hours per week, working on advanced AI projects where their backend/cloud expertise is used to create realistic environments for training and evaluating AI systems.

Senior Backend Engineer

Job Description

Role Title: Senior Backend Engineer

Role Type: Contractor (20 hrs perweek)

Location: Remote

micro1 is engaging Senior Backend Engineers to participate in an advanced project for a customer, focused on creating sophisticated Reinforcement Learning Environments for AI model training and evaluation. In this role, you’ll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

As an expert, you will create Reinforcement Learning Environments that test an AI model’s ability to design, deploy, troubleshoot, secure, scale, and recover production-grade cloud infrastructure. You will develop realistic scenarios involving distributed systems, networking, IAM, queues, durable storage, observability, rolling deployments, and disaster recovery, then build reproducible environments, deterministic validation tests, golden reference solutions, and intentionally defective variants.

Scope of Work

1. Design, develop, and implement realistic cloud infrastructure environments to evaluate AI model proficiency in systems design, deployment, and troubleshooting.
2. Create detailed and reproducible scenarios involving distributed systems, networking, Identity and Access Management (IAM), message queues, persistent storage, observability, rolling deployments, and disaster recovery.
3. Develop deterministic validation tests and golden reference solutions to ensure the reliability and accuracy of reinforcement learning environments.
4. Produce intentionally defective variants and failure scenarios to rigorously test AI model responses and recovery strategies.
5. Document the architecture, edge cases, and operational flows for all developed environments, ensuring clarity and reproducibility for future use.
6. Collaborate with technical leads and project participants to iteratively refine environment specifications and acceptance criteria.
7. Apply DevOps and infrastructure automation practices to deliver scalable, secure, and maintainable solutions for cloud-based systems evaluation.

Preferred Qualifications

1. Proven expertise with backend programming languages, such as C++, Python, Rust, GoLang, JAVA, or JavaScript.
2. Strong practical experience with DevOps, cloud infrastructure, CI/CD pipelines, and automation tools.
3. Demonstrated ability to architect, scale, and secure distributed systems in production-grade environments.
4. Deep understanding of networking, IAM, queues, durable storage, and disaster recovery concepts.

Process:

1. Apply to the role, filling out the screening questions
2. Complete AI interview (aprox. 30 minutes), reviewed by recruiters)
3. Hiring Manager review

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

micro1 – Company Profile

micro1 is a US-based technology company focused on AI-powered hiring and talent solutions. It connects companies with highly skilled remote technical professionals and uses AI-driven assessments and interviews to evaluate candidates.

The company works across areas such as software engineering, AI/ML, data, cloud, DevOps, and other technical domains. For specialized projects, micro1 also engages experts to contribute to AI training and evaluation, including creating real-world technical environments and scenarios that help improve AI models.

For this particular opportunity, candidates are being engaged as remote contractors for approximately 20 hours per week, working on advanced AI projects where their backend/cloud expertise is used to create realistic environments for training and evaluating AI systems.

Gana dinero grabando actividades de tu vida diariaBuscamos personas para grabar actividades cotidianas desde una perspectiva en primera persona utilizando una aplicación móvil.

Job PurposeApply here!RWS recherche des personnes ayant le français comme langue principale pour nous aider sur des projets de collecte de données/d’enregistrement dans le cadre du développement de l’intelligence artificielle. Cela...

Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.

Mindrift, powered by Toloka — a leading enterprise AI and machine learning data partner since 2014 — connects top domain experts with cutting-edge AI initiatives. Backed by Toloka’s deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next-generation generative models learn, reason, and perform.

We are launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. To do this credibly, we are assembling a team of strategy consultants from top-tier firms who can convert authentic project experience into end-to-end examples — from problem structuring and work planning to analysis, synthesis, and client-ready recommendations.

You will join a growing team of consultants from leading strategy firms shaping how AI learns high-level business reasoning.

Important: This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm. If you do not have hands-on project experience at one of the firms listed below, please do not apply. This requirement ensures the domain is built by practitioners trained to the highest standards of structured problem-solving and client delivery.

Eligible firms: McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte (Deloitte S&C), EY-Parthenon, Kearney, and Strategy& (PwC).

Who We’re Looking For

Consultants with 3+ years of experience at one of the firms listed above, with hands-on project experience in:

• Structuring ambiguous client problems into workable analytical plans
• Building financial models, market analyses, or synthesized findings from messy inputs
• Producing client-ready deliverables under time pressure
• Forming and defending recommendations under uncertainty

No deep technical background is required — we will onboard you on the lightweight tools involved.

What You’ll Do

• Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information.
• Design structured consulting tasks for AI agents— break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more.
• Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale.

This is a remote, project-based, individual-contributor role focused on analytical design and evaluation.

Skills & Requirements

• 3+ years at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
• Strong structured problem-solving and hypothesis-driven thinking
• Ability to translate vague problems into clear analytical steps and deliverables
• High attention to logical consistency and output quality
• Independent, self-directed working style
• Clear written English (B2+)

Compensation

On this project, contributors can earn up to $60 per hour equivalent, depending on their level and pace of contribution.

Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.

For this project, tasks are estimated to require around 25-30 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.

Mindrift, powered by Toloka — a leading enterprise AI and machine learning data partner since 2014 — connects top domain experts with cutting-edge AI initiatives. Backed by Toloka’s deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next-generation generative models learn, reason, and perform.

We are launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. To do this credibly, we are assembling a team of strategy consultants from top-tier firms who can convert authentic project experience into end-to-end examples — from problem structuring and work planning to analysis, synthesis, and client-ready recommendations.

You will join a growing team of consultants from leading strategy firms shaping how AI learns high-level business reasoning.

Important: This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm. If you do not have hands-on project experience at one of the firms listed below, please do not apply. This requirement ensures the domain is built by practitioners trained to the highest standards of structured problem-solving and client delivery.

Eligible firms: McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte (Deloitte S&C), EY-Parthenon, Kearney, and Strategy& (PwC).

Who We’re Looking For

Consultants with 3+ years of experience at one of the firms listed above, with hands-on project experience in:

• Structuring ambiguous client problems into workable analytical plans
• Building financial models, market analyses, or synthesized findings from messy inputs
• Producing client-ready deliverables under time pressure
• Forming and defending recommendations under uncertainty

No deep technical background is required — we will onboard you on the lightweight tools involved.

What You’ll Do

• Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information.
• Design structured consulting tasks for AI agents— break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more.
• Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale.

This is a remote, project-based, individual-contributor role focused on analytical design and evaluation.

Skills & Requirements

• 3+ years at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
• Strong structured problem-solving and hypothesis-driven thinking
• Ability to translate vague problems into clear analytical steps and deliverables
• High attention to logical consistency and output quality
• Independent, self-directed working style
• Clear written English (B2+)

Compensation

On this project, contributors can earn up to $60 per hour equivalent, depending on their level and pace of contribution.

Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.

For this project, tasks are estimated to require around 25-30 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.

Mindrift, powered by Toloka — a leading enterprise AI and machine learning data partner since 2014 — connects top domain experts with cutting-edge AI initiatives. Backed by Toloka’s deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next-generation generative models learn, reason, and perform.

We are launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. To do this credibly, we are assembling a team of strategy consultants from top-tier firms who can convert authentic project experience into end-to-end examples — from problem structuring and work planning to analysis, synthesis, and client-ready recommendations.

You will join a growing team of consultants from leading strategy firms shaping how AI learns high-level business reasoning.

Important: This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm. If you do not have hands-on project experience at one of the firms listed below, please do not apply. This requirement ensures the domain is built by practitioners trained to the highest standards of structured problem-solving and client delivery.

Eligible firms: McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte (Deloitte S&C), EY-Parthenon, Kearney, and Strategy& (PwC).

Who We’re Looking For

Consultants with 3+ years of experience at one of the firms listed above, with hands-on project experience in:

• Structuring ambiguous client problems into workable analytical plans
• Building financial models, market analyses, or synthesized findings from messy inputs
• Producing client-ready deliverables under time pressure
• Forming and defending recommendations under uncertainty

No deep technical background is required — we will onboard you on the lightweight tools involved.

What You’ll Do

• Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information.
• Design structured consulting tasks for AI agents— break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more.
• Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale.

This is a remote, project-based, individual-contributor role focused on analytical design and evaluation.

Skills & Requirements

• 3+ years at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
• Strong structured problem-solving and hypothesis-driven thinking
• Ability to translate vague problems into clear analytical steps and deliverables
• High attention to logical consistency and output quality
• Independent, self-directed working style
• Clear written English (B2+)

Compensation

On this project, contributors can earn up to $60 per hour equivalent, depending on their level and pace of contribution.

Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements.

For this project, tasks are estimated to require around 25-30 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Job Title: Chinese Voice Coach Job Type: Contract Location: Remote Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems.

Job Title: Video EditorJob Type: ContractorLocation: RemoteJob Summary: In this role, you'll apply your expertise to help train next-generation AI systems.

Job Title: French Voice Coach Job Type: Contract Location: Remote Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems.

Job Title: AAA Gameplay Data Capture Specialist Job Type: Contract {Pay Per Task Model} Location: Remote Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems.