Job number: Job-00260298 Posted: 2024-04-05

Guidewire Role

Top global IT consulting firm
8 - 12 million yen Tokyo Information Technology IT Management

Job details

Company overview
Our client is a leading global consulting firm that provides consulting, technology, and outsourcing services to its clientele.
Responsibilities
Main responsibilities:
  • Lead the global team and the Japanese technical team in a large-scale project to handle migration to AWS cloud.
  • Architect candidate should have solid experience in design and development of scalable implementations in AWS cloud.
Requirements
Minimum requirements:
  • 5+ years direct experience in analyzing and deriving source systems, data governance, metadata management, data architecture, data quality and metadata related output.
  • Strong experience in different type of “Data Analysis” covering business data, metadata, master data, analytical data.
  • 3+ years hands-on experience with Databricks
  • Hands on experience in installing, configuring and using MS Azure Data bricks and Hadoop ecosystem components like DBFS, Parquet, Delta Tables, HDFS, Map Reduce programming, Kafka, Spark & Event Hub.
  • In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
  • Hands on experience in Scripting languages like Scala & Python.
  • Hands on experience in Analysis, Design, Coding & Testing phases of SDLC with best practices.
  • Expertise in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair.
  • Experience in creating tables, partitioning, bucketing, loading and aggregating data using Spark SQL/Scala.
Salary
8 - 12 million yen
Location
Tokyo
Rubaiyyat Rafi
BRS Consultant
Rubaiyyat Rafi
Tech Services
Email me directly

Recommended jobs