Require English】Senior Big Data Engineer

1週間前

Tokyo Talisman Corporation

Job Description


Big data engineer for Technology Innovation Group for a Global Finance Firm

■ Job Title

Big data engineer

■ Company Overview

Top global finance firm

It is an excellent opportunity for a strong, intelligent programmer to gain exposure to a front-office environment and work closely with the business. Additionally, given the relatively lean and fast-moving organization, the person will gain responsibility and a broad range of experience very quickly.

■ Your Role and Responsibilities 

(Upon Employment)

Architect, develop, and enhance large-scale data processing systems using Scala and Apache Spark on Hadoop clusters.

Design and maintain efficient ETL workflows to ingest, clean, and transform financial data from multiple sources in compliance with Basel III, LCR/NSFR/PRA, and other regulatory requirements.

Manage and optimize object storage architectures using MinIO for scalable data lakes.

Utilize Dremio or Denodo for data virtualization and integration, enabling unified access for risk, regulatory, and business teams.

Partner with business users to deliver accurate, reliable, and timely data for regulatory and liquidity reporting.

Implement best practices for data quality, governance, security, and compliance (Basel III, LCR, NSFR, PRA, SOX, FINRA).

Monitor and tune cluster resources to achieve high performance, reliability, and cost efficiency.

Provide technical leadership, conduct code reviews, and mentor junior engineers.

Maintain detailed technical documentation of architectures, data flows, and processes, particularly for regulatory reporting.

Stay updated on emerging data technologies, financial regulations, and industry trends in data management and compliance.

(Scope of any potential changes) Duties as defined by the company

■ Experience and Qualifications

Mandatory Requirements:

Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline.

Minimum 6 years of experience in Big Data or Data Engineering roles, preferably in the financial industry.

Expert-level proficiency in Scala and advanced Apache Spark for large-scale data processing.

Deep knowledge and hands-on experience with Hadoop (HDFS) and related ecosystem tools.

Practical experience with MinIO for scalable object storage management.

Strong experience with Dremio and/or Denodo for data federation and integration.

Proficiency in SQL and familiarity with BI/reporting platforms such as Tableau.

Solid understanding of data security, governance, and compliance in financial data management.

Direct involvement in Basel III, LCR, NSFR, or other liquidity and regulatory reporting projects.

Proven ability to optimize data pipelines for reliability and performance.

Experience handling sensitive or regulated financial data.

Excellent communication, analytical, and problem-solving skills.

Preferred Qualifications:

Familiarity with data modeling and data warehouse concepts.

Experience supporting regulatory frameworks within financial organizations.

Exposure to cloud data platforms (AWS, Azure, or GCP).

Understanding of financial regulations (Basel III, GDPR, SOX, FINRA, etc.).

Experience working in Agile/Scrum environments.

■ Work Location

(Upon Employment) Tokyo
(Scope of change) Location as specified by the company  

Details will be provided during the meeting.

  • Require English】Senior Big Data Engineer

    1週間前

    Tokyo Talisman Corporation

    Excellent opportunity for a strong programmer to gain exposure to a front-office environment and work closely with the business. · ...

  • Require English】Data Engineer

    6日前

    Tokyo Talisman Corporation ￥6,000,000 - ￥12,000,000 per year

    We are looking for a highly skilled Data Engineer to join our team in Tokyo. The successful candidate will design, develop and maintain cross-functional data infrastructure across the company. · ...

  • Require English】Data engineer

    2週間前

    Tokyo Talisman Corporation

    Lead data engineer position available in Tokyo at a top insurance company with global working environment. · ...

  • Require English】Senior Frontend Engineer

    2日前

    Tokyo Talisman Corporation

    We are seeking a Senior Frontend Engineer to develop reporting features in our cloud-based accounting solution for mid-sized enterprises using React and TypeScript. · Bachelor's degree in Computer Science, Engineering, or a related technical field. · 7+ years of experience in sof ...

  • Require English】Senior Frontend Engineer

    5日前

    Tokyo Talisman Corporation

    Leading company in the financial industry. English working environment/ Welcome Japanese who can speak English. · Design and implement reporting features in our cloud-based accounting solution for mid-sized enterprises using JavaScript and TypeScript · ...

  • Require only English】Senior Mobile Engineer

    15時間前

    Tokyo Talisman Corporation

    A tech-driven company in the financial industry is seeking a Senior Mobile Engineer to develop and maintain iOS applications for end users. · ...

  • トラベル開発部:バックエンドエンジニア (tdd)

    2週間前

    Tokyo Rakuten ￥6,000,000 - ￥12,000,000 per year

    楽天トラベルは「旅に関わるすべての人が、もっと幸せになる未来をつくる」国内最大級のオンライン旅行予約サービスです。私たちは1996年の創業から今日に至るまで、業界をリードし常識をくつがえすイノベーションを生み出し続けてきました。また楽天トラベルは日本国内でトップクラスのオンライン旅行サイトであり、その大規模トランザクション処理を支える開発スキルが必要とされます。特に、このポジションではJavaとSpringでアプリ開発と運用を行います。このポジションでは技術力を磨きつつ、チームと協力して成果を出す機会が豊富にあります。また自身が次世代のエンジニアのロール ...

  • Bilingual Cyber Security Specialist

    2日前

    Tokyo Skillhouse Staffing Solutions K.K.

    +グローバルで知名度の高い小売ブランドが、サイバーセキュリティスペシャリストを募集しています。チームは少人数で運営されているため、SOCやインフラセキュリティ、アプリケーションセキュリティなどの役割が分かれていないため、複数のセキュリティ領域に対応できるサイバーセキュリティのゼネラリストを求めています。 · 社内IT環境(クラウドプラットフォーム、アプリケーション、ネットワーク、エンドポイント)を理解し、グローバルSOCと連携してインシデント分析を支援することです。 · , ...

  • IT Development

    15時間前

    Tokyo, Kantō, Japan Lan Thit Staffing Co.

    The IT Development role involves working on various projects including application systems, infrastructure engineering and industrial services. · Information system major or programming experience. · ...

  • Senior Data Engineer, Mandarin Speaker

    2週間前

    Tokyo A5 Labs ￥5,000,000 - ￥10,000,000 per year

    +Job summary · A5 Labs is redefining the boundaries of AI-driven security in competitive online environments. · +ResponsibilitiesBuild and maintain optimal data pipeline architecture. · Develop large, complex data sets that meet functional and business requirements. · ...

  • Senior Technical Solutions Engineer

    1週間前

    Tokyo, Japan Databricks

    As a Senior Technical Solutions Engineer, you will provide technical support for Databricks Platform related issues and resolve any challenges involving the Databricks unified analytics platform. · ...

  • Resident Solutions Architect

    4日前

    Tokyo, Japan Databricks

    +As Resident Solutions Architect (RSA) you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. · +You will work on a variety of impactful customer technical projects which may include building reference a ...

  • Sr. Solutions Architect

    4日前

    Tokyo, Japan Databricks

    As a Pre-sales, Sr. Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. · ...

  • Senior Software Engineer

    1週間前

    Tokyo Rakuten

    We are seeking a Senior Software Engineer to lead our core ecosystem platforms. · The Marketing Cloud Platform Department (MCPD) is continually expanding its scope, · and we are actively seeking senior-level engineering talent to collaborate on upcoming company-wide strategic pro ...

  • Senior Data Management Specialist

    2日前

    Tokyo, Tokyo Kaigen

    The Data Management Team serves as the central hub for expertise and best practices in managing and developing data assets. · ...

  • Senior Software Engineer-

    4日前

    Tokyo, Japan Talisman Corporation

    Hiring Senior Software Engineer in Japan · We are seeking a highly skilled and dynamic full-stack engineer with extensive technical expertise and proven team leadership experience to take ownership of technical responsibilities throughout the entire product development lifecycle ...

  • Senior Data Engineer

    15時間前

    Tokyo, Tokyo, Japan Source Edge KK

    The Senior Data Platform Engineer should be able to understand our client’s business, · and technical requirements and implement solutions accordingly. · Supporting the well-being of deployed data services. · Enhancing the operation and monitoring facilities. · ...

  • Technical Solutions Engineer, Data and AI

    2日前

    Tokyo Google

    The Google Cloud team helps companies schools and government seamlessly make the switch to Google products supports them along the way You solve the technical issues to show how our products can make businesses more collaborative · Develop an understanding of Google Cloud's Data ...

  • Technical Solutions Engineer, Data and AI

    5日前

    Tokyo, Japan Google $100,000 - $150,000 per year

    The Google Cloud team helps companies seamlessly make the switch to Google products and supports them along the way · You solve technical issues to show how our products can make businesses more collaborativeDevelop an understanding of Google Cloud's Data Analytics (e.g., BigQuer ...

  • DATA 部門

    3日前

    Tokyo, Tokyo Capgemini Invent

    Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world. · ...

  • Technical Escalation Manager

    2日前

    Tokyo, Japan Databricks

    At Databricks, we are passionate about empowering data teams to tackle the world's most challenging problems — from bringing the next mode of transportation to reality to accelerating the development of medical breakthroughs. · Manage support escalation in partnership with engine ...