Product Lifecycle Management

---

Job details

Company overview

We are a major IT services company operating in over 70 countries worldwide. Our consulting and digital solution services for enterprises can support the global IT challenges faced by large-scale clients. We are active in various sectors, including finance, insurance, healthcare, manufacturing, travel, energy, retail, telecommunications, aerospace, and the public sector. With 50 years of experience, we are one of the world's largest independent IT services companies dedicated to serving government agencies at all levels.

Responsibilities

Main responsibilities:

• Lead the global team and the Japanese technical team in a large-scale project to handle migration to AWS cloud.
• Architect candidate should have solid experience in design and development of scalable implementations in AWS cloud.

Requirements

Minimum requirements:

• 5+ years direct experience in analyzing and deriving source systems, data governance, metadata management, data architecture, data quality and metadata related output.
• Strong experience in different type of “Data Analysis” covering business data, metadata, master data, analytical data.
• 3+ years hands-on experience with Databricks
• Hands on experience in installing, Configuring and using MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.
• In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
• Hands on experience in Scripting languages like Scala & Python.
• Hands on experience in Analysis, Design, Coding & Testing phases of SDLC with best practices.
• Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair.
• Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Scala.

Salary

8 - 12 million yen

Location

Tokyo