Data Engineer

---

Job details

Company overview

Around the world, our client offers insurance, retirement and savings products. They work directly with customers as well as offer our products through agents, third party distributors, and brokers.

Responsibilities

The team is a multinational team, including members from offshore sites. We strive to create an environment that embraces diversity and values each individual's differences.We offer flexible work hours and a hybrid work from home and office structure. We look forward to hearing from you!
Main responsibilities:

• Data Ingestion Development - Develop pipelines to bring in various data, both internal and external, into data lakes and various data systems in the cloud, according to the business case. Data can be structured/semi/unstructured data with a frequency of batch/real-time ingestion.
• BI / Data Warehouse Development - As an owner of the company-wide BI platform, with large amount of data that is ingested into the data hub, transform the data on the data warehouse into data marts that can be consumed by business analysts and create reports and visualizations using BI tools. In addition, the candidate will be responsible for promoting "data self-service," which enables business users to retrieve the data by themselves at any time, from the perspective of promoting data utilization.
• The individual will be responsible for either of the above two, taking into consideration their experience and tech-background
• The followings are common to the above two roles.
• The individual will work closely with related parties within the IT organization to contribute to the success of the delivery. E.g.
  • Closely working with data analysts for business cases
  • Work with application development teams that use the data to sort out dependencies and interfaces, support them do testing, etc.
  • Work with cloud infrastructure teams to provision necessary PaaS services
  • Under the Agile delivery model, work with the Scrum Master to execute agile and sustained delivery
• Project managements (schedule, vendor, budget management for assigned areas, etc.)
• Solution Definition - Design solutions and architectures for the tech-area that the individual will be in-charge of
• Manage the system currency of owned systems and ensure that the IT security risks of the systems are properly controlled.

Requirements

Minimum requirements:

• Cloud Platform (Azure, AWS, GCP)
• PaaS Services (Azure is a plus. ADLS, ADF, SQL Database, Synapse Pipeline / Dedicated Pool / Synapse Spark, Cosmos DB, Cognitive Search, Azure ML, AKS etc.)
• Spark
• PL SQL / Transact SQL. RDBMS (Oracle, SQL Server)
• BI (Power BI is plus)
• ETL (Informatica)

Salary

8 - 11.5 million yen

Location

Tokyo