AI Evaluator

2ヶ月前


Tokyo, Tokyo Sama Remote job¥4,320,000 - ¥6,480,000 per year

About the role:
We are looking for
highly skilled AI Evaluators
to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written Japanese text, annotated and corrected by humans.

Responsibilities:

  • Respond to a set of prompts simulating realistic business or casual communication.
  • Write clear, plausible short texts (3–4 sentences for business settings, 1–2 sentences for casual chat).
  • Generate responses with intentional but realistic grammar, spelling, and structural errors.
  • Review annotated message pairs (input text + corrected/proofread version) to ensure:

  • All grammar/spelling/preposition/punctuation errors are corrected appropriately

  • Meaning is preserved between input and corrected text
  • Error types are classified correctly
  • Explanations are clear and linguistically sound

Qualifications:

  • Japanese as a first language - C2 Japanese proficiency
  • English as a second language - B2 English proficiency.
  • Ability to follow linguistic and situational writing prompts.
  • Good written communication and creativity.
  • 2 years working experience in a corporate/ business environment.
  • 1 year working experience working as an AI Evaluator, data annotator, or similar role
  • Strong computer literacy and fast, accurate typing skills are essential for navigating annotation tools and maintaining efficiency in text-based tasks.
  • Strong logic, intuitive problem-solving and critical thinking; adaptability to the needs of the task. The candidate needs to be open-minded and welcome different viewpoints or solutions.
  • Proactiveness, confidence to work independently without constant support. Reliability and being able to make good decisions on their own.
  • Be a thought partner to delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.
  • Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment. Access to your own laptop for work

Preferred Qualifications:

  • C1 or C2 English preferred
  • Experience in GenAI is a plus

NB: This is a temporary, project-based position with the possibility of renewal. While this role will be on payroll, please note that benefits are not included as part of this position.
About Sama
Sama provides high-quality training data that powers AI technology for Fortune 2000 companies such as Google, Walmart, Ford, Microsoft, and Marriott. We're experts in data annotation, supporting text, 2D, 3D image, video, and sensor data for machine learning algorithms and generative AI models. Sama offers the highest quality SLAs in the industry, along with cutting-edge ML-assisted annotation tools, QA processes, and security and compliance standards.

Founded in 2008 on the belief that
"talent is equally distributed, but opportunity is not",
Sama is driven by the mission to expand opportunities for those who are underprivileged. As a certified B-Corp, Sama has provided worker training programs to increase economic opportunity for more than 15,000 people from underserved communities. By connecting our customers with amazing talent in East Africa, we've impacted more than 69,000 workers and their dependents.

Today, our vision is to provide data scientists, ML engineers, and data operations teams with an indispensable, integrated platform for AI data preparation, labeling, and collection.

For more information, visit

More information can be found at:

  • Featured in Forbes: How Ethical Is Your AI?
  • Sama Honored on Inc. Magazine's Annual List of America's Fastest-Growing Private Companies — the Inc. 5000
  • Reversing Poverty - Ted Talk by our founder Leila Janah

Our Culture:
Sama is quite unique. We are a technology company with a social mission. People that thrive in a high-growth environment, love working on the bleeding edge of technology, and really care about having a positive impact on the world are a great fit for the Sama culture. Our core values are One Team, One Goal - Deliver. Period. - Trust & Transparency - Customer First - Humanity.

Our Benefits:
Sama is proud to offer competitive compensation corresponding to market data & level of experience. Sama also offers benefits packages based on country of employment, including but not limited to medical, dental, vision, and life insurance, holiday and vacation policies, professional development stipends and a paid sabbatical program. Our Talent Acquisition team would be happy to discuss our benefits packages with you in more detail during the interview process.

At Sama, we pride ourselves in being a diverse and equal opportunity employer.


  • AI Evaluator

    2ヶ月前


    Tokyo, Tokyo Sama Remote job¥4,320,000 - ¥6,480,000 per year

    We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written Japanese text, annotated and corrected by humans. · Respond to a set of ...

  • AI Evaluator

    2ヶ月前


    Tokyo Sama ¥5,500,000 - ¥8,100,000 per year

    We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written Japanese text, annotated and corrected by humans. · Respond to a set of ...


  • Tokyo myGwork - LGBTQ+ Business Community Part time$31,200 - $78,000 per year

    Join RWS Group as an evaluator to enhance search engine results. Provide feedback on text, audio, images, and videos to refine AI data used by major search engines, social media sites, streaming platforms and more. · Provide feedback on text, audio, images, and videos to refine A ...


  • Tokyo Rakuten ¥900,000 - ¥1,200,000 per year

    We are seeking passionate software engineers to lead AI technology development in the Corporate IT Service Department. As platform services, we provide various IT solutions, primarily centered around AI technology, as platform services to Rakuten Group companies in order to impro ...


  • Tokyo SMALL WORLD / Work in Japan? ¥2,000,000 - ¥2,500,000 per year

    This is a Contract Position for a tech company. As the AI Engineer, you will play a pivotal role in shaping the future of AI-driven solutions, collaborating closely with a team of skilled software engineers to develop and deploy cutting-edge AI models and algorithms. · Design, de ...


  • Tokyo Sony Full time¥8,000,000 - ¥12,000,000 per year

    We aim to develop groundbreaking tools and services through the application of AI Agents (AI systems that use large language models to enable automation of tasks). On our team, you will gain hands-on experience with exploratory and challenging projects, ranging from research and ...

  • Product Manager

    2週間前


    Tokyo, Japan Talisman Corporation ¥9,000,000 - ¥12,000,000 per year

    A great opportunity for an experienced Product Manager to lead AI-driven feature development at our e-commerce fintech company. · ...


  • Tokyo, Tokyo G Talent ¥8,000,000 - ¥15,000,000 per year

    Lead Software Engineer for a fast-growing AI SaaS startup in Tokyo, Japan. The company provides a SaaS that enables intent sales, analyzing search behavior to identify and reach out to companies with a clear need for their service. The team is composed of talented individuals fro ...


  • Tokyo Sony InternshipSHIP¥900,000 - ¥1,200,000 per year

    At Sony R&D, we are pioneering the next generation of generative AI technologies that will transform how creators and audiences experience entertainment. · Conduct research and development on state-of-the-art image and video generation AI models · Design and implement datasets, p ...


  • Tokyo Sony Full time¥1,200,000 - ¥1,500,000 per year

    At Sony R&D, we are pioneering the next generation of generative AI technologies that will transform how creators and audiences experience entertainment. From anime to film, music to games, we are working across the Sony Group to build AI that doesn't just push the boundaries of ...


  • Tokyo Woven by Toyota ¥10,000,000 - ¥20,000,000 per year

    We are seeking an experienced AI/ML Quality Engineer to join the Global Safety and Quality team responsible for ensuring that technology deliveries from all Woven by Toyota lines of business meet the safety, security, and quality requirements defined by regulations, international ...


  • Tokyo Sony InternshipSHIP¥9,000,000 - ¥12,000,000 per year

    We aim to develop groundbreaking tools and services through the application of LLM Agents (AI systems that use large language models to enable automation of tasks). On our team, you will gain hands-on experience with exploratory and challenging projects, ranging from research and ...


  • Tokyo TEKsystems ¥1,200,000 - ¥1,500,000 per year

    We are seeking a Digital Twin AI / Software Developer to join the Smart City initiative - a groundbreaking smart city project powered by data, AI, and simulation. · Build and maintain AI training and evaluation datasets · Develop data transformation and model training pipelines u ...


  • Tokyo, Japan DeepMind ¥14,400,000 - ¥20,800,000 per year

    +We are seeking a highly motivated and innovative Research Engineer to join our team in Tokyo. · + · Implementation & Optimization: Translate research concepts into practical implementations by developing and optimizing multimodal AI models, · Solid understanding of deep learning ...


  • Tokyo Dataiku ¥4,500,000 - ¥9,000,000 per year

    Partner with sales leadership to support a consistent and accurate forecasting and pipeline management process. Analyze and identify efficiencies to drive sales performance; provide accurate on-time reporting/analysis to support Account Executives coaching from the VP and RVP. Cr ...


  • Tokyo TEKsystems ¥6,000,000 - ¥12,000,000 per year

    We are supporting a global innovation company in the mobility and automotive technology space to hire an AI Software Engineer. · Design, develop, and prototype AI solutions using the latest LLM/VLM technologies · Research and experiment with cutting-edge AI tools, frameworks, and ...

  • Software Engineer

    2ヶ月前


    Tokyo Cohere ¥2,000,000 - ¥2,500,000 per year

    Join us on our mission and shape the future · Own and build large new areas within our product. · Work across the backend, frontend, and interact with Large Language Models. · Experiment at a high velocity and level of quality to engage our customers and eventually deliver soluti ...

  • Solutions Architect

    2ヶ月前


    Tokyo Cohere Remote job¥10,000,000 - ¥30,000,000 per year

    We are looking for a Solutions Architect to join our team in Tokyo. As a Solutions Architect, you will play a significant role in growing our business and have a great deal of autonomy when it comes to technical pre-sales and post-sales. You will develop a deep understanding of c ...


  • Tokyo, Tokyo Infosys ¥4,000,000 - ¥8,000,000 per year

    Infosys is seeking an Associate Practice Engagement Manager for its Data & Analytics Practice. The Associate Practice Engagement Manager (APEM) is responsible for all client interfaces within the assigned account scope. · Client relationship management and business development: · ...


  • Tokyo, Tokyo Liquid AI

    Work With UsAt Liquid, we're not just building AI models—we're redefining the architecture of intelligence itself. Spun out of MIT, our mission is to build efficient AI systems at every scale. Our Liquid Foundation Models (LFMs) operate where others can't: on-device, at the edge, ...

  • AI Engineer

    2週間前


    Tokyo, Japan AheadGroup ¥120,000 - ¥180,000 per year

    Ahead Group is looking for a AI Engineer to join a Global E-Commerce company. The ideal candidate will design and implement AI-powered solutions to enhance a Cyber Threat Intelligence Platform, enabling proactive defense against evolving cyber threats. · Design and develop AI-pow ...