Data Acquisition Engineering

2週間前

Tokyo Woven
About Woven by Toyota Woven by Toyota is enabling Toyota's once-in-a-century transformation into a mobility company. Inspired by a legacy of innovating for the benefit of others, our mission is to challenge the current state of mobility through human-centric innovation — expanding what "mobility" means and how it serves society.
Our work centers on four pillars: AD/ADAS, our autonomous driving and advanced driver assist technologies; Arene, our software development platform for software-defined vehicles; Woven City, a test course for mobility; and Cloud & AI, the digital infrastructure powering our collaborative foundation. Business-critical functions empower these teams to execute, and together, we're working toward one bold goal: a world with zero accidents and enhanced well-being for all.
=========================================================================
TEAM Our Cloud and Data Engineering organization is working on accelerating autonomous driving by providing access to petabytes of data collected from our large fleet of autonomous and non-autonomous vehicles. Efficient, fast and cost-effective access to data at large scale is key to tackle the hardest problems in AD/ADAS, from developing the Machine Learning (ML) models for perception and prediction of human driving patterns, to increasing the sophistication of our validation and simulation by identifying rare and interesting real-world driving situations. The Lakehouse ingestion platform developed by the Data Acquisition Engineering team is a fundamental building block for developing and testing modern AD/ADAS products that will impact millions of customers. 
The primary goal of our Lakehouse system and Fleetnik mobile app is to seamlessly ingest, enrich, and monitor fleet vehicle data as it flows into the cloud. Our pipelines are based on industry standard frameworks deployed to AWS. We engineer large-scale data acquisition pipelines that process hundreds of terabytes daily from numerous global ingestion sites. Our data acquisition products leverage industry-standard frameworks deployed on AWS, utilizing Java, Golang, Python, and JavaScript. We believe strongly in automation and testing to ensure delivery of robust and correct systems.  We are a distributed team, working in Japan, the UK and the US.
WHO ARE WE LOOKING FOR? The Data Acquisition team is looking for engineers who are passionate about and enable the next generation of automotive software development. The right candidate will have excellent communication skills, solid coding skills, broad knowledge of software engineering in areas such as Data Infrastructure and Warehouses, Data Ingestion, Distributed Databases, Compute Frameworks, Stream Processing, Observability and Build Infrastructure.

RESPONSIBILITIES

  • Design, build, maintain, optimize and support large scale, cloud-native data ingestion, data storage, data processing and data serving systems
  • Understand the complex data requirements of modern ML development and tailor our data ecosystem to these needs
  • Work closely with other Data Infrastructure engineers, Site Reliability engineers, ML Platform engineers, Computer Vision and ML engineers on high-impact projects to create innovative solutions to problems in the self-drive space
  • Mentor junior engineers in their day to day work and drive best practices across the organization
  • Contribute to the long term strategy for several of our systems and products

MINIMUM QUALIFICATIONS

  • Bachelor's degree in Computer Science, a related field, or equivalent practical experience
  • 5+ years of experience with data structures/algorithms and professional software engineering in one or more programming languages (e.g., Python, Go, Java)
  • 3+ years designing and building data-intensive, concurrent, scalable applications
  • 3+ years of experience with data platforms, data pipelines, workflow orchestration, batch processing, and/or distributed databases
  • Experience with cloud-based (e.g. AWS, GCP) microservice architecture, event-driven, distributed architectures
  • Business-level proficiency in English speaking, reading and writing (e.g. technical documents, software documentation)
  • Business-level proficiency in Japanese

NICE TO HAVES

  • 2+ years writing testable, modular code in Python
  • 2+ years writing testable, modular code in Golang
  • 2+ years writing testable, modular code in Java
  • Experience working as a Site Reliability Engineer
  • Experience with Terraform, Docker, cloud-native technologies, networking and Kubernetes in production
  • Experience designing, deploying, and maintaining multi-region and/or multi-cloud systems
  • Experience working in a fast-paced environment, collaborating across teams and disciplines
  • Experience with data governance, data privacy and security
========================================================================= Important Points ・All interviews will be arranged via Google Meet, unless otherwise stated. ・The same job descriptions are available in both English and Japanese; therefore, we kindly ask that you apply to only one version. ・We kindly request that you submit your resume in English, if possible. However, Japanese resumes are also acceptable. Please note that, depending on the English proficiency requirements of the role, we may request an English version of your resume later in the process.
WHAT WE OFFER ・Competitive Salary - Based on experience ・Work Hours - Flexible working time ・Paid Holiday - 20 days per year (prorated) ・Sick Leave - 6 days per year (prorated) ・Holiday - Sat & Sun, Japanese National Holidays, and other days defined by our company ・Japanese Social Insurance - Health Insurance, Pension, Workers' Comp, and Unemployment Insurance, Long-term care insurance ・Housing Allowance ・Retirement Benefits ・Rental Cars Support ・In-house Training Program (software study/language study)
Our Commitment ・We are an equal opportunity employer and value diversity. ・Any information we receive from you will be used only in the hiring and onboarding process. Please see our privacy notice for more details.

  • Associate Manager, Data Engineering

    3週間前

    Tokyo, Tokyo Avanade ￥2,000,000 - ￥6,000,000 per year

    · Associate Manager,（Data Engineering） · 쳳4소세요 · 안좋을 Data Warehouse/Data Mart/Delta/Data Lake 채이 uc640  uc624 소정 uf865 섰레로 · ...

  • Associate Manager, Data Engineering

    2ヶ月前

    Tokyo, Tokyo Avanade ￥9,000,000 - ￥12,000,000 per year

    データエンジニアリングにおける先進的な分析技術を駆使し、クライアントのビジネスを支援します。Come join usデータエンジニアリングの専門知識を活かし、ビジネス要件をテクノロジーソリューションに変換する。クライアントのビジネス目標の達成をデータの洞察で支えます。アバナードで、あなたのキャリアを次のステージへと進めましょう。 Together we do what matters. · データプラットフォームの構築経験 · データパイプラインまたはデータストリームの構築経験 · データ操作言語の使用経験 · プロジェクトにおいて自身の考えが最適解とな ...

  • Data Acquisition Engineering

    2週間前

    Tokyo Woven ￥4,500,000 - ￥9,000,000 per year

    The Data Acquisition Engineering team is working on accelerating autonomous driving by providing access to petabytes of data collected from our large fleet of autonomous and non-autonomous vehicles. The team is looking for engineers who are passionate about and enable the next ge ...

  • 学生インターン】(機械学習エンジニア)Sports x Data Science × Engineering

    4時間前

    Tokyo 株式会社 サイバーエージェント ￥2,500,000 - ￥6,500,000 per year

    学生インターン】(機械学習エンジニア)Sports x Data Science × Engineeringポジションでは、データを駆使するスキルを武器に、ユーザー体験をアップデートするための一気通貫の業務経験ができます。 · WINTICKETは、プロダクトに関わる誰もが事業責任者に提案できるカルチャーがあります。 · ...

  • Data Engineer

    2週間前

    Tokyo, Japan AheadGroup ￥120,000 - ￥180,000 per year

    Ahead Group is looking for a skilled and motivated Mid-Level Data Engineer to join a globally recognized tech platform team. · Design, develop, and maintain scalable data pipelines and cloud-based data warehouse solutions. · Lead architecture discussions and implement robust data ...

  • Data Engineer

    6日前

    Tokyo Talisman Corporation ￥500,000 - ￥1,500,000 per year

    Data Engineer for Fastest Growing SaaS Company. · We are working to make the data collection system available. · ...

  • Data Engineer

    1ヶ月前

    Tokyo, Tokyo iWill Capital G.K. ￥4,000,000 - ￥8,000,000 per year

    You will act as a bridge between the business departments and the engineering team. You are expected to proactively engage with internal business stakeholders, deeply understand business goals and context, independently elicit requirements, and collaborate with engineers to deliv ...

  • Data Engineer

    5日前

    Tokyo Globallogic Japan ￥800,000 - ￥2,000,000 per year

    We are seeking a Data Engineer to join our team in Tokyo, Japan. The successful candidate will have 3+ years of experience in Data Engineering, strong SQL and Python skills, and experience with Airflow, Spark, AWS/GCP. · ...

  • Data Engineer

    1ヶ月前

    Tokyo Amazon Web Services (AWS) ￥120,000 - ￥544,000 per year

    AWS is looking for technical architects to collaborate with customers and partners on key engagements, while helping partners to develop technical expertise and capacity. The individual requires a strong combination of technical experience, hands-on keyboard capacity, technical l ...

  • Data Engineer

    2週間前

    Greater Tokyo Area Randstad Japan ￥7,000,000 - ￥10,000,000 per year

    Data engineer with strong background in data engineering with scala and spark or java python or other back end languages wanted. · ...

  • Data Engineer

    4週間前

    Tokyo LongWave ￥12,000,000 per year

    We're hiring a Data Engineer to join a fast-growing Japanese SaaS company building next-generation management and cloud-based data platforms. · Design and scale the core data infrastructure that powers analytics, business decision-making, and future AI-agent systems. · Work end-t ...

  • Data Engineer

    1ヶ月前

    Tokyo myGwork - LGBTQ+ Business Community ￥6,000,000 - ￥12,000,000 per year

    At AWS, we're looking for technical architects to collaborate with our customers and partners on key engagements, while helping our partners to develop technical expertise and capacity. · Expertise - Collaborate with AWS field sales, pre-sales, training and support teams to help ...

  • Data Engineer

    2週間前

    Tokyo, Japan Gigantes Group ￥4,000,000 - ￥8,000,000 per year

    We are supporting a leading player in the autonomous mobility sector as they expand their data engineering team. This role focuses on building and operating large-scale data infrastructure that collects, processes, analyzes, and visualizes data generated by autonomous systems. · ...

  • Data Engineer

    1ヶ月前

    Tokyo SPOTTED ￥900,000 - ￥1,200,000 per year

    Design, build, and operate data pipelines that ingest, process, and store data from various sources. Develop and maintain data infrastructure for analytics and machine learning, including ETL/ELT processes, data warehouses (DWH), and data lakes. · Design, build, and operate data ...

  • Data Engineer

    1ヶ月前

    Tokyo SMALL WORLD / Work in Japan? ￥4,000,000 - ￥8,000,000 per year

    We use a tool called DOMO to create reports used by the Corporate Sales Department in their daily work. You will mainly be investigating and correcting report-related issues and creating new reports. · ...

  • Senior Data Engineer

    2ヶ月前

    Tokyo, Tokyo Kaigen ￥2,000,000 - ￥2,500,000 per year

    Design and implement scalable, production-grade data platform infrastructure components using AWS, Databricks, and modern data stack architecture patterns. Lead the development of critical data pipeline components and ensure they meet performance, security, reliability, and segre ...

  • Senior Data Engineer

    18時間前

    Tokyo Ideal Folks LLC ￥8,000,000 - ￥12,000,000 per year

    The Senior Data Engineer will design, build, and maintain core data pipelines using Kafka, Apache Spark, and BigQuery. · ...

  • Data Infrastructure Engineer

    2週間前

    Tokyo, Japan AheadGroup ￥120,000 - ￥180,000 per year

    Ahead Staffing is seeking a Data Infrastructure Engineer that will be responsible for ensuring the reliability, availability, and performance of the data platform infrastructure, systems, and storage. · ...

  • AGI Data Engineer

    4週間前

    Tokyo Meta Sensing Remote job￥6,000,000 - ￥12,000,000 per year

    You will play a core role in shaping the intelligence of MetaSensing's AGI models by curating, structuring, and labeling multimodal scientific data. · Curate and structure multimodal datasets (spectra, images, text, lab logs, parameters, etc.) · Design and apply labeling schemas ...

  • Senior Data Engineer

    2週間前

    Tokyo, Tokyo, Japan Source Edge KK ￥7,500 - ￥15,000 per year

    We are looking for an experienced Senior Data Engineer in Japan. · The team is diverse and predominantly English speaking. As a member of this team, you will work with modern technology to provide technical service around the company's business data, information, and derivatives. ...

  • Data Centre Engineer

    2週間前

    Tokyo Pico ￥40,000 - ￥80,000 per year

    As a Data Centre Engineer, you will be responsible for the physical build and maintenance of our environment in Tokyo. You will work closely with our Network and Systems engineering teams and our Project Management and client Service Delivery functions to ensure prompt delivery o ...