AI Evaluator

2週間前

Tokyo Prefecture, Japan Sama

About the role:

We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written Japanese text, annotated and corrected by humans.

Responsibilities:

  • Respond to a set of prompts simulating realistic business or casual communication.
  • Write clear, plausible short texts (3–4 sentences for business settings, 1–2 sentences for casual chat).
  • Generate responses with intentional but realistic grammar, spelling, and structural errors.
  • Review annotated message pairs (input text + corrected/proofread version) to ensure:
  • All grammar/spelling/preposition/punctuation errors are corrected appropriately
  • Meaning is preserved between input and corrected text
  • Error types are classified correctly
  • Explanations are clear and linguistically sound

    • Qualifications:

  • Japanese as a first language - C2 Japanese proficiency 
  • English as a second language - B2 English proficiency.
  • Ability to follow linguistic and situational writing prompts.
  • Good written communication and creativity.
  • 2 years working experience in a corporate/ business environment.
  • 1 year working experience working as an AI Evaluator, data annotator, or similar role 
  • Strong computer literacy and fast, accurate typing skills are essential for navigating annotation tools and maintaining efficiency in text-based tasks.
  • Strong logic, intuitive problem-solving and critical thinking; adaptability to the needs of the task. The candidate needs to be open-minded and welcome different viewpoints or solutions.
  • Proactiveness, confidence to work independently without constant support. Reliability and being able to make good decisions on their own.
  • Be a thought partner to delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.
  • Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment. Access to your own laptop for work 

    • Preferred Qualifications:

  • C1 or C2 English preferred 
  • Experience in NLP/GenAI is a plus 

    • NB: This is a temporary, project-based position with the possibility of renewal. While this role will be on payroll, please note that benefits are not included as part of this position.

    About Sama 

    Sama provides high-quality training data that powers AI technology for Fortune 2000 companies such as Google, Walmart, Ford, Microsoft, and Marriott. We're experts in data annotation, supporting text, 2D, 3D image, video, and sensor data for machine learning algorithms and generative AI models. Sama offers the highest quality SLAs in the industry, along with cutting-edge ML-assisted annotation tools, QA processes, and security and compliance standards.

    Founded in 2008 on the belief that "talent is equally distributed, but opportunity is not", Sama is driven by the mission to expand opportunities for those who are underprivileged. As a certified B-Corp, Sama has provided worker training programs to increase economic opportunity for more than 15,000 people from underserved communities. By connecting our customers with amazing talent in East Africa, we've impacted more than 69,000 workers and their dependents.

    Today, our vision is to provide data scientists, ML engineers, and data operations teams with an indispensable, integrated platform for AI data preparation, labeling, and collection. 

    For more information, visit

    More information can be found at:

  • Featured in Forbes: How Ethical Is Your AI?
  • Sama Honored on Inc. Magazine's Annual List of America's Fastest-Growing Private Companies — the Inc. 5000
  • Reversing Poverty - Ted Talk by our founder Leila Janah

    • Our Culture:

    Sama is quite unique. We are a technology company with a social mission. People that thrive in a high-growth environment, love working on the bleeding edge of technology, and really care about having a positive impact on the world are a great fit for the Sama culture. Our core values are One Team, One Goal - Deliver. Period. - Trust & Transparency - Customer First - Humanity.

    Our Benefits:

    Sama offers competitive compensation commensurate with experience and a full benefits package, including: medical, dental, and vision insurance, long-term disability insurance, life, and AD&D insurance, employer-matching Group RRSP, generous holiday and vacation policies, a monthly fitness stipend, monthly cell phone reimbursement and professional development opportunities. Our Talent Acquisition team would be happy to discuss our benefits packages with you in more detail during the interview process.

    At Sama, we pride ourselves in being a diverse and equal opportunity employer.

    • AI Evaluator

      2週間前

      Tokyo Prefecture, Japan Sama ￥800,000 - ￥1,200,000 per year

      +Job summary · We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. · ResponsibilitiesRespond to a set of prompts simulating realistic business or casual communication. · Write clear, plausible sh ...

    • AI Evaluator

      2ヶ月前

      Tokyo Sama ￥5,000,000 - ￥7,500,000 per year

      We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. · This project focuses on creating a rich and diverse dataset of written Japanese text, · annotated and corrected by humans.Respond to a set of ...

    • AI Evaluator

      1ヶ月前

      Tokyo Sama

      We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. · This project focuses on creating a rich and diverse dataset of written Japanese text, annotated and corrected by humans. ...

    • Search Engine Evaluator for AI Models

      1週間前

      Tokyo, Japan RWS Part time￥31,200 - ￥78,000 per year

      Apply here for a flexible remote work opportunity to evaluate search engine results and improve AI models. · ...

    • Product Manager

      3時間前

      Tokyo, Japan Talisman Corporation

      An excellent opportunity for a product manager - AI in Japan. · ...

    • AI Application Engineer, Artificial Intelligence Office

      1ヶ月前

      Tokyo Rakuten

      We are looking for members who can be at the forefront of generative AI development and help shape the future of travel with innovative AI experiences. · ...

    • Japanese (Japan) Audio Evaluator

      3週間前

      Tokyo, Japan Welocalize

      We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in Japanese. · ...

    • ML Engineer【Business Level Japanese】

      2ヶ月前

      Tokyo ROYAL AGENT株式会社

      We are seeking an ML Engineer to join our R&D team responsible for data preparation and optimization for AI models. · ...

    • AI Engineer】JLPT N2

      3週間前

      Tokyo, Tokyo G Talent

      The role involves working in a cutting-edge environment on AI development leveraging generative AI. · ...

    • Project Manager

      1ヶ月前

      Tokyo Rakuten

      We are seeking Project Managers who can bridge the business and technical teams to successfully bring AI-powered solutions into real services. · ...

    • AI Trainer

      2ヶ月前

      Tokyo, Tokyo Prolific ￥1,240,000 - ￥1,560,000 per year

      We're looking for Advanced Japanese Speakers to help train and evaluate cutting-edge AI models. If you have the necessary experience, we'll send you a quick test to assess your skills and suitability for AI tasks. If successful, you'll be invited to join Prolific as a Domain Expe ...

    • Bilingual Business Analyst

      1ヶ月前

      Tokyo, Tokyo SEPIA INNOVATIONS

      Job summary · Bilingual Business Analyst for a full-time remote role at SEPIA INNOVATIONS. · Evaluate current business processes and identify opportunities for improvement. · ...

    • Member of Technical Staff

      2ヶ月前

      Tokyo, Tokyo Liquid AI

      We believe great talent powers great technology. The Liquid team is a community of world-class engineers, researchers, and builders creating the next generation of AI. · Deep understanding of the Japanese model evaluation landscape and familiarity with Japanese pre-training data ...

    • Member of Technical Staff

      24時間前

      Tokyo Liquid AI $125,000 - $175,000 per year

      We're looking for a Member of Technical Staff to join our team in Tokyo. You'll be responsible for building LLM pipelines and agents for diverse use cases and adapting foundation models to new languages. · ...

    • Senior Application Engineer

      4週間前

      Tokyo OrangeTalents

      Lead the design and development of AI product prototypes covering full lifecycle from proof-of-concept to demo-level implementations. · ...

    • Senior Software Engineer- Tokyo

      3時間前

      Tokyo, Japan Databricks

      We are passionate about enabling data teams to solve the toughest problems. · ...

    • Generative AI Engineer

      1ヶ月前

      Tokyo JAPAN AI株式会社 ￥8,000,000 - ￥14,000,000 per year

      We aim to create new value and contribute to the progress of society as a whole through the transformative power of AI. Let's lead innovation through AI and create a future where technology enables people to achieve more. · ...

    • AI Solution Architect

      4週間前

      Tokyo LTIMindtree

      We're looking for a hands‑on engineer with · 10+ years of IT experience · (including · 5+ years on Microsoft Azure) · to build and productionize Generative AI solutions. · Flexibility to work in shifts is required.Design and implement GenAI solutions across on‑prem, Azure cloud, ...

    • Bilingual Snr. AI Engineer @Global Semicon Company

      2ヶ月前

      Greater Tokyo Area Randstad Japan

      We are looking for a bilingual senior AI engineer to lead and contribute to AI solution development. · ...

    • Senior Product Manager – AI Agents

      2週間前

      Tokyo Appier $145,000 - $175,000 per year

      We are hiring a Senior Product Manager - AI Agents to own and drive the design, strategy and delivery of agentic products within marketing automation. · ...

    • AI Solution Engineer, Point Platform Group

      2ヶ月前

      Tokyo Rakuten

      We are seeking a talented and pragmatic AI Solutions Engineer to join our innovative team. · This is an exciting opportunity to directly impact a global platform processing massive transaction volumes, · by bringing the advantages of AI to bear on real-world engineering and busin ...