★【Dev】Infrastructure Engineer (LLM New Business) | AI/NLP Company

• Business Level Japanese Required (N2 Level)

◆ Flextime System & Fully Remote Work

◆ In-house Products

◆ 123 days off per year

◆ Annual salary: 6.3 million yen - 12 million yen

【About the company】

The company's mission is "to advance humanity by reinventing the mechanisms of value creation" and aims to create an environment where people can focus on creating new value through the use of natural language processing and AI technologies.

AI delivers information directly related to business operations, thereby enhancing the information sensitivity of the organization. In addition, the company offers two SaaS products: "Anews," which encourages the conception of business ideas and their development within the organization, and "Astrategy," a market research service that provides suggestions by structuring necessary information according to the organization and its operations.

Currently, its main target is major manufacturing R&D in Japan, and more than 30% of the Nikkei 225 companies have already adopted the system. In the future, starting with manufacturing R&D, the company plans to expand to domestic enterprise companies, then to Japanese companies as a whole, and even to global companies.

The company completed a Series C financing of 1.1 billion in August 2022.

In February 2024, they were selected for the "GENIAC (Generative AI Accelerator Challenge) Project" promoted by the Ministry of Economy, Trade and Industry and NEDO, and have begun to develop their own LLM with 100 billion parameters

The company has grown to 100 employees and is looking for more personnel to achieve further growth

【 Job Description】

【Company Overview】

The company operates under the mission of "Reinventing the system of value creation to advance humanity," leveraging cutting-edge generative AI technology to support transformative change across numerous businesses.

It provides the following services:

Anews: A one-stop search platform for internal and external information.

SAT (Stockmark A Technology): A solution that structures various forms of data and transforms them into valuable corporate assets.

In addition to these core offerings, the company also supports the development of enterprise-specialized generative AI and the construction of proprietary systems.

Currently, its main target market is R&D departments within large Japanese manufacturing enterprises. The company's solutions are already being adopted by over 250 corporations, including 30% of the Nikkei 225. Looking forward, the aim is to expand from manufacturing R&D into broader domestic enterprise sectors, across all of Japan's industries, and eventually to global markets.

The company is also heavily invested in the research and development of a purely domestic LLM with strengths in Japanese language and business applications. In May 2024, it released a proprietary 100-billion-parameter LLM.

As of October 2024, the company completed Series D funding of 4.5 billion yen, with total funding reaching 8.8 billion yen. With the team now surpassing 100 employees, it is actively recruiting talent to drive further growth.

【Issues】

In 2024, a new business was launched, and multiple PoC projects targeting enterprise clients are currently underway. While the team is striving for project success, several ongoing challenges remain:

・Verifying, developing, and operating the backend and cloud infrastructure for a new PaaS offering that provides a document analysis engine

・Defining new resource requirements and interfaces

【Responsibilities】

You will be primarily responsible for the infrastructure domain of the new business, Stockmark A Technology, which promotes the use of generative AI:

・Take the lead as the first infrastructure engineer for the new PaaS service, driving development independently from validation through to implementation

・Collaborate with machine learning engineers developing the document analysis engine to define resource requirements and interfaces, and advance development

・Work closely with the product manager to drive development aimed at solving various challenges

■Specifically

・Verification, implementation, and production operations of the API and infrastructure for the business document analysis engine

・Design, construction, and operation of infrastructure in a multi-cloud environment (including RAG data pipelines and customer data management)

・Design, construction, and production operations of data flow and network infrastructure for both the PaaS environment and customer system environments

*Scope of Change: Development-related duties

【Team composition】

• 1 front-end engineer

• 3 machine learning engineers

• 1 MLOps engineer

【Development Environment】

■Organizational Structure

• 1 product manager

• 1 MLOps engineer

• 2 machine learning engineers

■Languages/Frameworks

TypeScript, , , Python

■Containers

Docker

■IaC

Terraform

■Cloud

AWS, Azure

【Position Hightlights】

・As the first infrastructure engineer in a new business, you will be deeply involved in making decisions on technology selection and architecture design.

・Opportunity to take on the challenge of turning business document analysis into a service, something that general-purpose LLMs and major cloud providers' document analysis services have yet to achieve.

・Gain hands-on experience in launching real-world services using LLM and multimodal AI.

【 Requirements】

【Required】

*Meet all of the folloing

-3+ years of infrastructure engineering experience

-Experience developing with Python

-Experience developing/operating services using AWS, Azure

【Preferred】

・Master's or Doctoral degree in a technical field related to computer science

・Experience in developing and operating in-house services for end customers

・Experience with AWS for machine learning experiments, model management, data management, and building training/inference pipelines

・Experience in development and operations using Terraform

・Experience in a leadership role where you understood business context and independently planned and executed initiatives

【Working Time 】

Flextime System

【About remote work】

■Basically, fully remote work

Residence must be in Japan (no full remote work while residing overseas)

■Flexible remote/working options (no restrictions on the number of times you can come to the office)

Each employee works while using the system according to his/her own circumstances.

【Welfare】

■Customer facing allowance (flat monthly amount of 20,000 yen *included in monthly salary)

Free use for self-improvement and customer value improvement

(purchase of books/attendance at seminars/equipment, etc.)

■Lump-sum allowance for preparation for remote work (flat rate of 50,000 yen in the first paycheck)

Provided as an expense for preparation for remote work

【Others】

■Periodic health checkups (all paid by company)

■Influenza vaccination

■PC of your choice provided

■Free drinks such as water/coffee/carbonated drinks/alcohol provided at the office

■Office Glico installed

【Education and Skill Development】

■Onboarding for 5 days after employment is available

■Monthly study day system (for own skill improvement and learning purpose)

【Internal Communication】

■Weekly company-wide online meeting

■Monthly social gathering (offline, some online)

■Semi-annual kick-off (hybrid of online and offline meetings)

【Holidays】

■123 days off per year

■Saturdays, Sundays and national holidays (2 days off per week)

■Year-end and New Year vacations

■Paid leave (granted at the time of employment *Number of days granted depends on the month of employment)

■Prenatal leave

■Childcare leave