Data Engineer

2日前

Tokyo Octopus Energy Full time
About Octopus Energy Since 2015, Octopus has been on a mission to bring affordable, green energy to the world. With the help of our in-house developed technology platform, Kraken, we've become the 4th largest energy supplier in the UK, opened retailers in 7 other countries, and licensed our software to retail giants including in the UK, Origin Energy in Australia, and Tokyo Gas in Japan. We've reinvented energy products with smart, data-driven tariffs to balance customer demand with renewable generation - and we're the biggest investor in renewable generation in the UK.Since we have expanded our tentacles to Japan we are looking to hire a Data Engineer. This role is based in Tokyo primarily to support Octopus Energy Japan and Kraken deployments for Japanese customers, but will be part of the wider APAC data platform engineering team.Working with Octopus Energy is a chance to join an exciting scale-up business within the energy supply sector, one that's at the forefront of changing the landscape of the energy industry worldwide. A role with us offers you the chance to contribute to building world-class operations that will catapult you into a fantastic career. About the team At Octopus we have developed a platform to provide data services to our retail businesses and clients across 17 deployments globally.The data platform engineering team develops and manages the back-end systems and processes supporting this platform, predominantly working with time-series data fed into the system by our customers' smart meters. We have developed a suite of applications to process, transform, and make this data available to downstream services.To process the volume of data we typically see, our applications run PySpark or dbt jobs using Databricks as our Spark engine. We leverage Airflow and Kubernetes heavily. We also employ software engineering best practices to design, test, and deploy our data platform and services. About the role This is a fantastic opportunity to work on data problems that genuinely move us closer to Net Zero with a company that is passionate about building great technology to change the way customers use energy.As a data engineer, you will be responsible for maintaining and supporting the constant improvement of our data platform. As well as working on our core datalake transformations you may be developing custom applications to process third-party data, managing infrastructure in our AWS deployment, or working to expand our presence across our APAC (Australia, New Zealand, Japan) deployments.Key responsibilities:- Developing and deploying dbt pipelines to support internal analytics teams- Maintaining and managing data platform infrastructure - Supporting our core PySpark data pipeline to feed data to downstream applications- Responding to internal requests

About you

  • We are looking for a hire who will self-manage, adapt to our changing business requirements, and proactively work to scope problems and deliver pragmatic solutions.
  • You have experience:
  • Working with Terraform and Kubernetes
  • Building applications in Python
  • Developing data transformation pipelines in SQL or dbt
  • Working in a Spark or Databricks environment
  • Working in a software or data engineering environment
  • Business level English and Japanese skills for interacting with the global Kraken team and Japanese clients
  • We also want our data engineers to be great software engineers with a passion for writing quality code, so it would be helpful to have experience in at least some of the following:
  • Cloud data platforms (Ideally AWS)
  • Airflow
  • Version control and DevOps best practices

    • What you'll love about us

  • Our company culture - we won in 2019 and our Group CEO, Greg has recorded and how we empower our people
  • Flexible working environment - genuine work life balance here, we are, we treat you as a human, and do our best to make work and life merge smoothly together
  • Relaxation - we don't count your holidays here, we work hard, and so we know you need to play hard as well (within reason of course)
  • Equity Options Scheme - you own your own part of the business, share options in the whole Octopus Energy Group so we all work together towards success
  • Office culture - have a certain tech requirement? We'll do our best to get it. Our offices are also stocked with fruit, breakfast, great coffee and soft drinks. Weekly on a Friday we all get together (this happens virtually too) for company updates and drinks - we call it Family Dinner
  • Your development is important - we support and help with development including internal and external courses, learning, study support etc, all bespoke to you

    • Data Engineer

      4時間前

      Tokyo Denodo

      Job Description Denodoでは、カスタマーサクセス組織の一員として、グローバルオフィスチームの一員としてDenodoの学習と採用を次のレベルへと引き上げる意欲のある、技術的で情熱的、実践的なデータアドボケイトを募集しています。 · Denodoの顧客、パートナー、そしてDenodo Platformのすべてのユーザーが、データ管理ソリューションを成功させるために必要なすべての資料を利用できるようにすることがあなたのミッションです。 · 高度な技術的専門知識、データエコシステムの知識、顧客対応スキルを組み合わせて、データ、顧客(社内外)、 ...

    • Data Engineer

      4時間前

      Tokyo DENODO SL

      Denodoはデータマネジメントのリーダーです。受賞歴のあるDenodo Platformは、業界をリードするセルフサービスBI、データサイエンス、ハイブリッド/マルチクラウドデータ統合、エンタープライズデータサービスを可能にする論理的アプローチを用いたデータ統合・管理・配信プラットフォームです。ROI(投資収益率)400%以上、数百万ドルの利益を実現しているDenodoの30以上の業界にわたる大企業および中堅企業のお客様は、6ヶ月未満で投資回収を実現しています。詳しくは、をご確認ください。 · 私たちは、4つの大陸にチームを持つ急成長中のグローバルな組 ...

    • Data Engineer

      2日前

      Tokyo TEKsystems

      Job Summary · 日本を代表する某金融会社にてデータエンジニアを募集しています · 日本最大級の金融会社としてクレジットカードのデータを扱うチームに参画できます。 · 必須要件 · 5年以上のJavaもしくはPythonでの開発経験 · アーキテクチャの作成経験は必須ですが、モノリタルのアーキテクチャ経験のみ、または小規模なアプリの経験のみでも可能です · SparkもしくはHadoopでのAPI作成経験 · ビジネスレベルの日本語力(N2以上)又はネイティブレベルの日本語力 · *社内では日本語を使用しています · ...

    • New grads Recruitment 2025(Data Center Critical Facilities Engineer)

      7日前

      Tokyo Equinix フルタイム

      Who are we? · Equinix is the world's digital infrastructure company, operatingover 250 data centers across the globe.Digital leaders harness Equinix's trusted platform to bring together and interconnect foundational infrastructure at software speed. Equinix enables organizations ...

    • Data Engineer

      4時間前

      Tokyo Amaris Consulting

      Job description · Mission Descriptions : · Designing, constructing, installing, testing and maintaining highly scalable data management systems. · Ensuring systems meet business requirements and industry practices. · Building high-performance algorithms, prototypes, predictive m ...

    • Data Engineer

      2日前

      Tokyo Teradata

      Data Engineer · Location: Tokyo, Japan · Requisition Number: · External Description: · What you'll do: · データ分析基盤/データウェアハウス・システム(Teradata)の設計・構築 · データ分析基盤/データウェアハウス・システムの移行(オンプレ→クラウド等) · データ抽出、データ転送、データロード、データ加工等、各種データを扱うプログラムの設計・開発(Teradataユーティリティ、シェル、SQL等を使用) · ETLツール、BIツール、分析 ...

    • Data Engineer

      6日前

      Tokyo Teradata

      Data Engineer - Finance Industry · Location: Tokyo, Japan · Requisition Number: · External Description: · What you'll do: · データ分析基盤/データウェアハウス・システム(Teradata)の設計・構築 · データ分析基盤/データウェアハウス・システムの移行(オンプレ→クラウド等) · データ抽出、データ転送、データロード、データ加工等、各種データを扱うプログラムの設計・開発(Teradataユーティリティ、シェル、SQL等を使用 ...

    • Data Engineer

      4日前

      Japan TERADATA INDIA PVT LTD Full time

      Apply for Data Engineer, Career Progress Consultants in Japan for 3 - 5 Year of Experience on ...

    • Data Engineer

      4日前

      Japan TERADATA INDIA PVT LTD Full time

      Apply for Data Engineer, Career Progress Consultants in Japan for 3 - 7 Year of Experience on ...

    • Analytics Data Engineer

      4時間前

      Tokyo Rakuten Full time

      Description · : Department Overview · We are responsible for Rakuten Travel's analytical data platform. · As you may know, Rakuten Travel is one of the core services in Rakuten. We have a variety of data related to Rakuten Travel services, such as booking data, hotel data (inv ...

    • Data Science Engineer

      4時間前

      Tokyo Rakuten Full time

      Description · : Department Overview · Rakuten Institute of Technology (RIT) , the core AI research wing of Rakuten, is spread across six geographical locations including Tokyo, Singapore, Boston, San Mateo, Bengaluru, and Paris. This division consists of AI research scientists ...

    • Senior Data Engineer

      3日前

      Tokyo Quantexa

      Founded in 2016 with only a handful of individuals, Quantexa was built with a purpose that through a greater understanding of context, better decisions can be made. 8 years, 15 locations and 700+ employees later we still believe that today. We connect the dots within our Customer ...

    • Associate Data Engineer

      1日前

      Tokyo Denodo

      Job Description Are you looking to kick-start your career within an international software product company? Then our Data Engineer role for fresh graduates will be a fantastic opportunity for you. · Denodo is a fantastic place to begin your career. We are the leader in Data Virtu ...

    • Principal - Data Engineering

      4時間前

      Tokyo Slalom

      *This is a position based in Tokyo, Japan, and requires a valid working visa and living within a commutable distance to the city.* · Data Engineering Consultant · Who You'll Work With · As a modernized technology company, our Slalom Technologists are disrupting the market and br ...

    • Principal - Data Engineering

      5日前

      Tokyo Slalom

      *This is a position based in Tokyo, Japan, and requires a valid working visa and living within a commutable distance to the city.* · Data Engineering Consultant · Who You'll Work With · As a modernized technology company, our Slalom Technologists are disrupting the market and br ...

    • Principal - Data Engineering

      3日前

      Tokyo Slalom

      *This is a position based in Tokyo, Japan, and requires a valid working visa and living within a commutable distance to the city.* · Data Engineering Consultant · Who You'll Work With · As a modernized technology company, our Slalom Technologists are disrupting the market and br ...

    • Fukuoka Data Engineer

      4日前

      Japan TERADATA INDIA PVT LTD Full time

      Apply for Fukuoka Data Engineer, Career Progress Consultants in Japan for 3 - 6 Year of Experience on ...

    • Digital and Data Engineers

      3日前

      Chiyoda-ku Nomura Securities CO., LTD.

      IT: Developer · Digital and Data Engineers · Associate / Senior Associate 職務内容 · Job Description Job/Group Overview: · Nomura is a global financial services group with an integrated global network spanning over 30 countries. Japan IT (Information Technology) is a diverse environ ...

    • エンジニアリングオペレーションズエンジニア / Data Center Engineering Operations Engineer

      1週間前

      Tokyo Amazon Data Services Japan G.K. Full time

      ■企業紹介 · 弊社は2006年より企業向け IT インフラストラクチャサービス(クラウドコンピューティング)の提供を開始しました。これまで信頼性が高く、スケーラブルで低コストなクラウドサービスを提供しており、現在、190 か国で数十万社の企業に利用いただいています。地球上で最もお客様を大切にする企業として、日々、お客様のビジネスの成長を支えています。 · ■ポジション · データセンター エンジニアリング・オペレーションズ(DCEO)チームは、弊社の大規模・高密度なデータセンター内で、ファシリティ(電気・機械設備、制御系・消防関連設備など)の導入から ...

    • Senior Analyst II Data Engineering

      16時間前

      Tokyo JPES DXC Technology Japan, Ltd. Full time

      Job Description: · 職務内容 Essential Job Functions: · • Participate in basic data engineering tasks and projects. · • Support data pipeline development and maintenance under the guidance of senior team members. · • Collaborate with colleagues on data-related initiatives and proje ...