Data - RR (CP)

---

Job details

Company overview

We are a global IT consulting and technology services firm that helps clients with their digital transformation. We provide services from strategy development to implementation and create innovative solutions for a wide range of industries. We help our clients gain a competitive edge by leveraging our expertise in areas such as data analytics, cloud technology, and cybersecurity. With a focus on sustainability and digital innovation, we provide solutions for business environments around the world.

Responsibilities

Main responsibilities:

• Lead the global team and the Japanese technical team in a large-scale project to handle migration to AWS cloud.
• Architect candidate should have solid experience in design and development of scalable implementations in AWS cloud.

Requirements

Minimum requirements:

• 5+ years direct experience in analyzing and deriving source systems, data governance, metadata management, data architecture, data quality and metadata related output.
• Strong experience in different type of “Data Analysis” covering business data, metadata, master data, analytical data.
• 3+ years hands-on experience with Databricks
• Hands on experience in installing, configuring and using MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.
• In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
• Hands on experience in Scripting languages like Scala & Python.
• Hands on experience in Analysis, Design, Coding & Testing phases of SDLC with best practices.
• Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair.
• Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Scala.

Salary

8 - 12 million yen

Location

Tokyo