AI Evaluator

1週間前

Tokyo Prefecture, Japan Sama

About the role:

We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written Japanese text, annotated and corrected by humans.

Responsibilities:

  • Respond to a set of prompts simulating realistic business or casual communication.
  • Write clear, plausible short texts (3–4 sentences for business settings, 1–2 sentences for casual chat).
  • Generate responses with intentional but realistic grammar, spelling, and structural errors.
  • Review annotated message pairs (input text + corrected/proofread version) to ensure:
  • All grammar/spelling/preposition/punctuation errors are corrected appropriately
  • Meaning is preserved between input and corrected text
  • Error types are classified correctly
  • Explanations are clear and linguistically sound

    • Qualifications:

  • Japanese as a first language - C2 Japanese proficiency 
  • English as a second language - B2 English proficiency.
  • Ability to follow linguistic and situational writing prompts.
  • Good written communication and creativity.
  • 2 years working experience in a corporate/ business environment.
  • 1 year working experience working as an AI Evaluator, data annotator, or similar role 
  • Strong computer literacy and fast, accurate typing skills are essential for navigating annotation tools and maintaining efficiency in text-based tasks.
  • Strong logic, intuitive problem-solving and critical thinking; adaptability to the needs of the task. The candidate needs to be open-minded and welcome different viewpoints or solutions.
  • Proactiveness, confidence to work independently without constant support. Reliability and being able to make good decisions on their own.
  • Be a thought partner to delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.
  • Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment. Access to your own laptop for work 

    • Preferred Qualifications:

  • C1 or C2 English preferred 
  • Experience in NLP/GenAI is a plus 

    • NB: This is a temporary, project-based position with the possibility of renewal. While this role will be on payroll, please note that benefits are not included as part of this position.

    About Sama 

    Sama provides high-quality training data that powers AI technology for Fortune 2000 companies such as Google, Walmart, Ford, Microsoft, and Marriott. We're experts in data annotation, supporting text, 2D, 3D image, video, and sensor data for machine learning algorithms and generative AI models. Sama offers the highest quality SLAs in the industry, along with cutting-edge ML-assisted annotation tools, QA processes, and security and compliance standards.

    Founded in 2008 on the belief that "talent is equally distributed, but opportunity is not", Sama is driven by the mission to expand opportunities for those who are underprivileged. As a certified B-Corp, Sama has provided worker training programs to increase economic opportunity for more than 15,000 people from underserved communities. By connecting our customers with amazing talent in East Africa, we've impacted more than 69,000 workers and their dependents.

    Today, our vision is to provide data scientists, ML engineers, and data operations teams with an indispensable, integrated platform for AI data preparation, labeling, and collection. 

    For more information, visit

    More information can be found at:

  • Featured in Forbes: How Ethical Is Your AI?
  • Sama Honored on Inc. Magazine's Annual List of America's Fastest-Growing Private Companies — the Inc. 5000
  • Reversing Poverty - Ted Talk by our founder Leila Janah

    • Our Culture:

    Sama is quite unique. We are a technology company with a social mission. People that thrive in a high-growth environment, love working on the bleeding edge of technology, and really care about having a positive impact on the world are a great fit for the Sama culture. Our core values are One Team, One Goal - Deliver. Period. - Trust & Transparency - Customer First - Humanity.

    Our Benefits:

    Sama offers competitive compensation commensurate with experience and a full benefits package, including: medical, dental, and vision insurance, long-term disability insurance, life, and AD&D insurance, employer-matching Group RRSP, generous holiday and vacation policies, a monthly fitness stipend, monthly cell phone reimbursement and professional development opportunities. Our Talent Acquisition team would be happy to discuss our benefits packages with you in more detail during the interview process.

    At Sama, we pride ourselves in being a diverse and equal opportunity employer.

    • AI Evaluator

      4週間前

      Tokyo Sama ￥5,000,000 - ￥7,500,000 per year

      We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. · This project focuses on creating a rich and diverse dataset of written Japanese text, · annotated and corrected by humans.Respond to a set of ...

    • AI Evaluator

      1週間前

      Tokyo Sama

      We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. · This project focuses on creating a rich and diverse dataset of written Japanese text, annotated and corrected by humans. ...

    • Search Engine Evaluator for AI Models

      1週間前

      Tokyo, Japan RWS Part time￥31,200 - ￥78,000 per year

      We are seeking an evaluator to enhance search engine results by providing feedback on text, audio, images and videos to refine AI data used by major search engines, social media sites and more. · Languages: English and Japanese proficiency. · High-speed internet connection. · PC ...

    • Product Manager

      19時間前

      Tokyo, Japan Talisman Corporation

      + Excellent Opportunity for a Product Manager - AI in Japan · + Develop and communicate a bold product vision and roadmap for generative AI features and agent-based applications. · + Identify high-impact use cases for LLMs and define product strategies to address them. · + Lead e ...

    • AI Application Engineer, Artificial Intelligence Office

      6日前

      Tokyo Rakuten

      We are looking for members who can be at the forefront of generative AI development and help shape the future of travel with innovative AI experiences. · ...

    • ML Engineer【Business Level Japanese】

      3週間前

      Tokyo ROYAL AGENT株式会社

      We are seeking an ML Engineer to join our R&D team responsible for data preparation and optimization for AI models. · ...

    • Research Engineer

      1週間前

      Tokyo, Japan DeepMind ￥14,400,000 - ￥20,800,000 per year

      We are seeking a highly motivated and innovative Research Engineer to join our team in Tokyo, focused on building the state-of-the-art in multimodal companion agents. · Implementation & Optimization: Translate research concepts into practical implementations by developing and opt ...

    • Project Manager

      6日前

      Tokyo Rakuten

      We are seeking Project Managers who can bridge the business and technical teams to successfully bring AI-powered solutions into real services. · ...

    • AI Risk Management Specialist

      1ヶ月前

      Tokyo RAPSYS TECHNOLOGIES PTE LTD ￥4,000,000 - ￥8,000,000 per year

      We're Hiring: AI Risk Management Specialist · We are seeking a skilled and detail-oriented AI Risk Management Specialist to join our team in Tokyo,Japan. The ideal candidate will have extensive experience in identifying,assessing,and mitigating risks associated with artificial i ...

    • AI Risk Management Specialist

      1ヶ月前

      Tokyo Rakuten ￥2,720,000 - ￥5,600,000 per year

      We are seeking individuals who can collaborate with various departments to manage AI risk management programs. · Responding to AI Risk Assessment Applications. · Conducting AI Risk Assessments. · ...

    • AI Trainer

      4週間前

      Tokyo, Tokyo Prolific ￥1,240,000 - ￥1,560,000 per year

      We're looking for Advanced Japanese Speakers to help train and evaluate cutting-edge AI models. If you have the necessary experience, we'll send you a quick test to assess your skills and suitability for AI tasks. If successful, you'll be invited to join Prolific as a Domain Expe ...

    • Bilingual Business Analyst

      1週間前

      Tokyo, Tokyo SEPIA INNOVATIONS

      Job summary · Bilingual Business Analyst for a full-time remote role at SEPIA INNOVATIONS. · Evaluate current business processes and identify opportunities for improvement. · ...

    • Member of Technical Staff

      3週間前

      Tokyo, Tokyo Liquid AI

      We believe great talent powers great technology. The Liquid team is a community of world-class engineers, researchers, and builders creating the next generation of AI. · Deep understanding of the Japanese model evaluation landscape and familiarity with Japanese pre-training data ...

    • Japanese Language Expert

      1ヶ月前

      Tokyo, Tokyo SME Careers Remote job￥22,000 - ￥70,000 per year

      We are seeking Japanese language experts to join us as AI Data Trainers. In this role, you will create engaging and informative content that powers the development of cutting-edge AI models. · ...

    • Software Engineer- Fullstack- Tokyo

      1日前

      Tokyo, Japan Databricks $100,000 - $150,000 per year

      We are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. · ...

    • Senior Application Engineer

      1日前

      Tokyo OrangeTalents

      Lead the design and development of AI product prototypes covering full lifecycle from proof-of-concept to demo-level implementations. · ...

    • Member of Technical Staff

      3日前

      Tokyo Liquid AI

      We believe great talent powers great technology. · ...

    • Generative AI Engineer

      1週間前

      Tokyo JAPAN AI株式会社 ￥8,000,000 - ￥14,000,000 per year

      We aim to create new value and contribute to the progress of society as a whole through the transformative power of AI. Let's lead innovation through AI and create a future where technology enables people to achieve more. · ...

    • Bilingual Snr. AI Engineer @Global Semicon Company

      3週間前

      Greater Tokyo Area Randstad Japan

      We are looking for a bilingual senior AI engineer to lead and contribute to AI solution development. · ...

    • DX/AI promotion manager in Finance service industry

      2ヶ月前

      Tokyo Tenth Revolution Group ￥5,000,000 - ￥10,000,000 per year

      A leading financial services group is recruiting for a key role in its IT Strategy Department. This position sits within the Digital Planning & Promotion Division, driving enterprise-wide digital transformation and AI governance initiatives. · Promote generative AI utilization, i ...

    • AI Solution Engineer, Point Platform Group

      3週間前

      Tokyo Rakuten

      We are seeking a talented and pragmatic AI Solutions Engineer to join our innovative team. · This is an exciting opportunity to directly impact a global platform processing massive transaction volumes, · by bringing the advantages of AI to bear on real-world engineering and busin ...