Post Job Free
Sign in

SME (Subject Matter Expert) Data Architect / Microsoft Azure Data

Company:
Avance Consulting
Location:
Nenagh, Tipperary, E45, Ireland
Posted:
June 27, 2024
Apply

Description:

The Role

TCS seek a Subject Matter Expert: Data Architect to support a key project in the utilities sector.

Key responsibilities:

Understanding business requirements relating to business data sources with the ability to integrate it and/ or transform it effectively in accordance with business needs.

Defining data architecture principles in Azure.

Developing reference data architectures that align a modern approach to business need.

Advocating for modern and effective data architecture in ESB using Azure aligned with business needs.

Designing ETL flows according to reference data architectures in Azure.

Design, develop and deploy the migration of existing on premises solutions to Azure environments.

Setting the standard for data modelling in ESB and applying it to data warehouse design in Azure.

Establishing processes and procedures for a Data Architecture discipline in ESB.

Facilitating Data Architecture training in ESB.

Your Profile

Key skills/knowledge/experience:

Significant experience in Software Development and Agile

Experience in data engineering solutions development.

Extensive experience of data architecture design patterns for Descriptive, Predictive and Prescriptive Analytics.

Excellent knowledge of Data Engineering best practices.

Excellent data modelling knowledge including relational modelling (Inmon) and dimensional modelling (Kimball).

Practical experience of data pipelines for Dimension and Fact data structures including SCD I and SCD II.

Extensive knowledge in designing best in class data pipelines balancing performance and cost.

Extensive knowledge and experience of working in Modern Data Architectures including Data Lakes, Delta Lakes, Data Warehouses, Data Marts, Dimensional Data Stores & Lake Houses.

Knowledge of setting up Azure Synapse connectors (On-prem file shares, SFTP, SQL database, HTTP, etc.) in real world enterprise environment.

Significant experience in Database and Data Storage Platforms including Azure Data Lake.

Extensive experience in data migration planning and implementation.

Extensive knowledge of data modelling techniques and structures.

Extensive Data Architecture experience in the following:

Designing & implementing Conceptual, Logical, and Physical data models

Designing & implementing Relational data models with normalisation

Designing & implementing Dimensional Data Models (Dimensions, Facts, SCD I, SCD II, SCD III)

Designing & implementing Lakehouse and Delta Lake architectures

Reporting, documentation/writing.

Excellent Organisational skills.

Experience with a wide range of IT environments, platforms and applications

IT Qualification - Degree or equivalent work experience.

Professional certifications e.g. MCSE

The Role

TCS seeks a Subject Matter Expert: Microsoft Azure Data Engineering to support a key project in the Utilities sector.

Key responsibilities:

Understanding business requirements relating to business data sources with the ability to integrate it and/ or transform it effectively in accordance with business needs.

Development of Extract Transform and Load routines, modelling, queries, reports and analysis.

Support of existing data marts, warehouse process chains and associated models and queries.

Ensuring the successful delivery of all assigned Data Engineering work on projects across all ESB business units and their successful deployment to production, including use cases developed by our Data Science & Analytics team.

Implement changes (CR’s) or new developments relating to existing or new solutions.

Troubleshooting and resolving issues with any of our Azure data repositories.

Design, develop and deploy the migration of existing on premises solutions to Azure environments.

Implementing and ensuring compliance with Data Engineering best practice.

Your Profile

Key skills/knowledge/experience:

Excellent knowledge of Data Engineering best practices.

Proven data modelling knowledge including relational modelling (Inmon) and dimensional modelling (Kimball).

Ability to create best in class data pipelines balancing performance and cost.

Practical experience in developing solutions using Azure Synapse Pipelines, Synapse pySpark Notebooks, Azure Data Lake, Synapse Dedicated SQL Pool and Serverless Pool.

Practical experience of creating data pipelines for Dimension and Fact data structures including SCD I and SCD II.

Expert knowledge of Azure Synapse Data Connectors

Practical hands-on experience in successfully configuring Azure Data Connectors within Synapse in an Enterprise environment.

Practical experience of good housekeeping and structuring data engineering artifacts and objects in the Azure Synapse and Data Lake environment.

Practical experience in creating CI/CD pipelines in Azure Synapse.

Excellent knowledge of security configuration and access for Azure Data Lakes and Azure Synapse workspaces. Significant advisory and consultancy experience in Emerging Technology.

Ability to manage, co-ordinate and present to stakeholders at all levels of the organisation.

Extensive experience in data migration planning and implementation.

Excellent Reporting, documentation/writing, and presentation skills

Excellent Organisational skills.

Experience with a wide range of IT environments, platforms and applications

IT Qualification - Degree or equivalent work experience.

Professional certifications e.g. MCSE

Please send your resume to

Apply