Data Engineer (Remote Set Up)

Job Summary:

This position will be responsible for the company-wide management and operation of data from all services operated by the company, as well as the construction and operation of data infrastructure to promote data utilization. Development, maintenance and operation of data utilization infrastructure on GCP Development, maintenance, and operation of ETL processing using workflow engines Development of business automation tools using Python Review of database design and table design from the viewpoint of data storage Data processing, extraction, tabulation, and creation of reports and lists using SQL and Python Support for data marketing measures in each business Support for data marketing measures in each business Establishment of MLOps system for machine learning products IaC and infrastructure management of data base infrastructure using Terraform. Technologies used GCP (GCE, GCS, Cloud Functions, BigQuery, LookerStudio, Dataform, Dataplex) AWS (EC2, ECS, Lambda, S3, RDS, Sagemaker) Workflow engines (Digdag, Airflow) Python - SQL - Git - Terraform - dbt

Required

Must be a JPL Level N1, N2 or N3.

Must be a foreigner currently residing in Japan

Experience in data processing, extraction, and aggregation using SQL and Python

Experience in design/development/operation using public clouds such as AWS and GCP Data to be handled Access log data (views, clicks, scrolls) of the company's website Customer attribute data, customer time-series information Employee behavior data (telephone call history, etc.) Web advertisement (mainly google) delivery results data, etc. Text data (QA site data, job posting data, career data, etc.) Voice data (telephone calls)