Post Job Free
Sign in

Azure Data Factory

Location:
Henrico, VA
Salary:
125000
Posted:
June 19, 2024

Contact this candidate

Resume:

Naveen Kumar Pittala

Azure Data Engineer

ad6kps@r.postjobfree.com

201-***-****

Professional Summary

•12+ years of experience with expertise in Microsoft BI Technologies (MS SQL, Azure data factory (ADF), Azure Data Lake (ADL), Azure Data bricks (ADB), Azure SQL, Logic Apps, Power Apps, Power Automate, Data Warehouse and RPA (Robotic Process Automation) implementation using Blue Prism and UiPath in different domains like Banking, Insurance, Data Center Providers and Vehicle Retailer.

Proficient in the use of T-SQL for developing database objects like complex stored procedures, triggers, tables, user functions, user profiles, relational database models and data integrity, SQL joins, Sub queries, correlated sub-queries and query writing.

Involved in Database Design, Data modeling, Development, Implementation, ELTL in Azure SQL Server 2016.

Proficiency in Performance Tuning, Query Optimization, Client/Server connectivity.

Good knowledge of Data Marts, Data warehousing, OLAP, OLTP, Dimensional Data Modeling, Star Schema Modeling, Snow-Flake Modeling, FACT and Dimensions Tables.

Experience with Azure transformation projects, Azure architecture decision-making, and implemented ELTL and data movement solutions using Azure Data Factory (ADF).

Hands on experience working with Logging, Error handling in Azure Data Factory.

Worked on data extraction, data integration and loading from different data sources using Azure Data Factory (ADF).

Worked on creating Data Pipelines for Copy Activity, moving and transforming the data with Custom Azure Data Factory Pipeline Activities for On-cloud ELTL processing.

Recreating existing application logic and functionality in the Azure Data Factory (ADF), Azure SQL Database and Azure SQL Data warehouse environment.

Experience with Data Marts, Data warehousing, OLAP, Star Schema Modeling, Snowflake Modeling, facts, dimensions, partitions, and Tables using MS Analysis Services.

Proficient in Azure Data Warehousing Solutions, ETL & ELTL Tools, Data Ingestion, Cleansing, Staging, Loading and Transforming. Gather and understand client requirements.

Build data pipelines and perform testing, Perform Data analysis as needed.

Good hands on using the Python and Scala.

Having experience in transforming and loading data into delta tables in Azure Data bricks.

Experience in developing overall 10 Proof of Concepts (POC’s) and 25 processes for Client using RPA tools, Business Analysis and Automation skills.

Collaborative and high-performance culture within the Data bricks practice team.

Provide mentorship, guidance, and support to team members, promoting continuous learning and development.

•Created RPA structure and team along with production support, designed and developed RPA solutions to accelerate Business processes.

•Extensively used Blue Prism's process studio and object studio to develop and test the robot based on given business process model.

•Extensively used UiPath's studio and studioX to develop and test the robot based on given business process model.

•Automated Web Based, Java Based, Mainframe, Desktop based applications using automation tools (Blue Prism & UiPath).

•Automated numerous routine tasks using Blue Prism & UiPath thereby reducing manual intervention also helpful in Error Handling and maintenance of robots.

•Worked on Process Definition Document (PDD) step by step keystroke level and Technical Design Document (TDD).

•Lead testing teams to generate test scripts for testing robots and handling exceptions.

•Created reusable automation frameworks and reusable libraries for RPA implementation.

•Created solid models by spying through Application Modeller and UiExplorer.

•Able to interact effectively with other members of the back end, Business Engineering, Quality Assurance, and other teams involved with the Software Development Life cycle and Designed End to End Automation Solution for clients.

•Knowledge on managing robot’s workloads using blue prism work queue and UiPath Queues.

•Experience in implementing User authentication by defining user roles, creating users, and setting password policies.

•Excellent communication skills, both written and verbal. I can work in team or independent and always keen to learn new things.

Education & Professional Certifications

Bachelor of Engineering in Information Technology – JNTU University – 2010.

•Microsoft Certified .Net Framework 4, Web Applications (Exam Code: 70-515).

•Blue Prism Developer Certification (AD01) Exam.

•Blue Prism Professional Developer Certification (APD01) Exam.

•UiPath-ADAv1 - UiPath Automation Developer Associate v1 Exam - English (ENU).

Technical Skills

Programming Languages:

T-SQL(Transact-SQL), C# .Net, Python, Scala, JavaScript, JSON, JQuery, Pyspark

Automation Tools:

Blue Prism & UiPath

Database:

MS SQL Server, MySQL, Oracle, Teradata

Web Service Technologies:

SOAP UI, REST

Bug Tools:

JIRA

Azure's cloud ETL service:

Azure Data Factory, Azure Data Lake, Azure Data bricks, AWS.

Workflows:

Logics Apps, Power Apps, Power Automate.

Cloud Database:

Azure SQL.

Design Modeling:

ER Modeling, Dimensional Modeling

IDE & Tools:

Visual Studio

Source Repositories:

TFS, GIT

Working Methodologies:

Agile, Waterfall

Professional Experience

CarMax – Richmond, VA Jul 2019 to Till Date

Lead Azure Data Engineer

Responsibilities:

Designed and implemented data pipelines and processes to support data integration and analysis.

Create Notebooks using Data bricks, Python and spark and capturing the data from Delta tables in Delta lakes.

Created Azure Data Factory and managing policies for Data Factory and Utilized Blob storage for storage and backup on Azure.

Designed and implemented Azure Data Factory pipelines and Azure Data Bricks notebooks to extract, transform, and load data from various sources.

Wrote SQL, Python, T-SQL to query and manipulate data stored in Azure SQL DW and other data stores.

Designing and maintaining ADF pipelines with activities – Copy, Lookup, For Each, Get Metadata, Execute Pipeline, Stored Procedure, if condition, Web, Wait, Delete etc.

Extensive knowledge in migrating applications from internal data storage to Azure. Experience in building streaming applications in Azure Notebooks using Kafka and Spark.

Created and maintained conceptual, logical, and physical data models.

Troubleshoot and debug issues that arose during the development and maintenance of data models and systems.

Designed, developed, and deployed Power Automate workflows to automate manual processes, resulting in a 70% increase in efficiency.

Captured SCD2 and updated or inserted or deleted based on Business requirements using Data bricks.

Develop up the Framework for creating new snapshots and deleting old snapshots in Azure Blob Storage and worked on setting up the life cycle policies to back the data from delta lakes.

Expert in building the Azure Notebooks functions by using Python, Scala, and Spark.

Implemented data de-duplication and data filtering in the ELTL process, resulting in a 50% reduction in data volume and a corresponding reduction in storage and processing costs. This allowed the company to allocate resources more efficiently and better use data for decision-making.

Data extraction from various sources, Transformation and Loading into the target SQL Server Database. Implemented Copy activity, Custom Azure Data Factory Pipeline Activities for On-cloud ELTL processing.

Automize the Azure Data Factory (ADF) pipelines when source data updated.

Involved in developing the end-to-end ELTL pipelines for migrating the on-premises Oracle database to Azure SQL Data warehouse.

•Worked on reading and writing multiple data formats like JSON, ORC, and Parquet using Python.

•Architecting, Designing, and developing complex SSAS databases and constantly monitoring the daily schedules and provides data to the ad-hoc requests from the business users.

Environment: GIT, MS SQL Server, Azure Data Factory (ADF), JIRA, Data bricks, Azure SQL Database, Python.

EQUINIX – Dallas, TX Jul 2018 – Jul 2019

RPA Lead Developer & Solution Designer (Blue Prism)

Responsibilities:

•Implemented End to End Robotic Process Automation (RPA) using Blue Prism.

•Developed the object and workflow for client requirement.

•Performed tool evaluation and feasibility to help in selecting suitable Automation tool for RPA implementation.

•Designed, Developed, and tested Bot tasks using Blue Prism.

•Involved in process automation collaborations with business users globally to analyze business processes, recommend RPA based solutions for the processes, and developed Automation using Blue Prism software.

•Participate online meetings to demonstrate the capabilities of RPA for the Clients.

•Involved in creation of UI components like Sections, Flow Actions, and Portals.

•Created individual objects for the Window based application in the object studio and ran and created as a package in the process studio.

•Broke down processes into reusable objects using Object studio and utilized them to build processes in Process Studio efficiently.

•Provided Exception handling at every possible scenario for a robust error-free development.

•Solid design, coding, testing, and maintaining the bot' s.

•Worked closely with Process SME' s to translate process in to Process Definition Document (PDD) and Solution Design Document (SDD) and educated SME' s to work with Bots in production.

•Created Object Design Instruction for clear understanding of the activities performed during development. Made sure every small step is document to remove ambiguity.

•Created external scripts using VBO’s and integrated with Blue Prism to achieve process automation.

•Involved in Unit Testing and Integration testing. Involved in Code reviews to check for efficiency and coding standards.

•Guided the Testing team for the User Acceptance Testing.

Environment: Blue Prism 5.0, .Net, SQL server 2012, windows, excel, Outlook, Agile Scrum, HTML, CSS, J Query, Visual Studio 2015.

Virtusa Corporation Pvt Ltd - New York City, NY Feb 2018 - Jun 2018

RPA Lead Developer (Blue Prism)

Client: Scor Reinsurance Co, New York City, NY

Responsibilities:

•Implemented End to End Robotic Process Automation (RPA) using Blue Prism.

•Developed the object and workflow for client requirement.

•Performed tool evaluation and feasibility to help in selecting suitable Automation tool for RPA implementation.

•Designed, Developed, and tested Bot tasks using Blue Prism.

•Involved in process automation collaborations with business users globally to analyze business processes, recommend RPA based solutions for the processes, and developed Automation using Blue Prism software.

•Participate online meetings to demonstrate the capabilities of RPA for the Clients.

•Involved in creation of UI components like Sections, Flow Actions, and Portals.

•Created individual objects for the Window based application in the object studio and ran and created as a package in the process studio.

•Broke down processes into reusable objects using Object studio and utilized them to build processes in Process Studio efficiently.

•Provided Exception handling at every possible scenario for a robust error-free development.

•Solid design, coding, testing, and maintaining the bot' s.

•Created Object Design Instruction for clear understanding of the activities performed during development. Made sure every small step is document to remove ambiguity.

•Created external scripts using VBO’s and integrated with Blue Prism to achieve process automation.

•Involved in Unit Testing and Integration testing. Involved in Code reviews to check for efficiency and coding standards.

•Guided the Testing team for the User Acceptance Testing.

Environment: Blue Prism 5.0, VB, C#, HTML, CSS, Java Script, .Net, MS Visual studio, SQL Server, Excel, Omega Application.

Synechron – Hyderabad, India May 2017-October 2017

RPA Lead Developer (Blue Prism)

Client: Wells Fargo Bank Ltd, Lawrence Township, NJ

Responsibilities:

Implemented End to End Robotic Process Automation (RPA) using Blue Prism.

Developed the object and workflow for client requirement.

Performed tool evaluation and feasibility to help in selecting suitable Automation tool for RPA implementation.

Designed, Developed, and tested Bot tasks using Blue Prism.

Involved in process automation collaborations with business users globally to analyze business processes, recommend RPA based solutions for the processes, and developed Automation using Blue Prism software.

Participate online meetings to demonstrate the capabilities of RPA for the Clients.

Involved in creation of UI components like Sections, Flow Actions, and Portals.

Created individual objects for the Window based application in the object studio and ran and created as a package in the process studio.

Broke down processes into reusable objects using Object studio and utilized them to build processes in Process Studio efficiently.

Provided Exception handling at every possible scenario for a robust error-free development.

Solid design, coding, testing, and maintaining the bot' s.

Created Object Design Instruction for clear understanding of the activities performed during development. Made sure every small step is document to remove ambiguity.

Created external scripts using VBO’s and integrated with Blue Prism to achieve process automation.

Involved in Unit Testing and Integration testing. Involved in Code reviews to check for efficiency and coding standards.

Guided the Testing team for the User Acceptance Testing.

Environment: Blue Prism 5.0, VB, HTML, CSS, .Net, MS Visual studio, SQL Server, Excel.

Cap Gemini – Hyderabad, India Nov 2015 - May 2017

RPA Developer (Blue Prism)

Client: ZURICH Insurance Group, USA

Responsibilities:

•Implemented End to End Robotic Process Automation (RPA) using Blue Prism.

•Developed the object and workflow for client requirement.

•Performed tool evaluation and feasibility to help in selecting suitable Automation tool for RPA implementation.

•Designed, Developed, and tested Bot tasks using Blue Prism.

•Involved in process automation collaborations with business users globally to analyze business processes, recommend RPA based solutions for the processes, and developed Automation using Blue Prism software.

•Participate online meetings to demonstrate the capabilities of RPA for the Clients.

•Involved in creation of UI components like Sections, Flow Actions, and Portals.

•Created individual objects for the Window based application in the object studio and ran and created as a package in the process studio.

•Broke down processes into reusable objects using Object studio and utilized them to build processes in Process Studio efficiently.

•Provided Exception handling at every possible scenario for a robust error-free development.

•Solid design, coding, testing, and maintaining the bot' s.

•Created Object Design Instruction for clear understanding of the activities performed during development. Made sure every small step is document to remove ambiguity.

•Created external scripts using VBO’s and integrated with Blue Prism to achieve process automation.

•Involved in Unit Testing and Integration testing. Involved in Code reviews to check for efficiency and coding standards.

•Guided the Testing team for the User Acceptance Testing.

Environment: Blue Prism 5.0, VB, HTML, .Net, MS Visual studio, SQL Server, Excel.

Cap Gemini – Hyderabad, India

Client: SELECTIVE Insurance Group, USA Jan 2015 to Nov 2015

.Net Developer

Project: SELECTIVE - Commercial Line Automation System (CLAS)

Responsibilities:

•Understand the client requirements (RTS) and providing solution.

• Maintain transparency with the client.

• Implementing requirements and bug fixing.

• Create/Update project documents as and when needed.

• Participating in code reviews and given major contribution in application performance improvement.

•Unit Test case, Test Results, Review Logs preparation and unit testing the requirement.

Environment: ASP.Net, VB.Net, Web Services, SQL-Server 2008, WCF, Visual Studio 2012, SIGI controls.

Altruistra – Hyderabad, India

Client: Affinity, USA. Oct 2014 to Dec 2014

.Net Developer

Project: Guiding Care Management (GC)

Responsibilities:

•Understand the client requirements and providing design solution.

•Maintain transparency with the client.

•Implementing requirements, change request and bug fixing

•Create/Update project documents as and when needed.

•Unit Test the requirements.

Environment: ASP.Net, C#, Web Services, SQL-Server 2008, Visual Studio 2010, TFS and Devx controls.

Yash – Hyderabad, India Feb 2012 to Oct 2014

Clients: Yamaha Corporation, Stanley Black and Decker

.Net Developer

Responsibilities:

•Understand the client requirements and providing design solution.

•Maintain transparency with the client.

•Implementing requirements, change request and bug fixing

•Taken up challenging bugs and provide solutions.

•Create/Update project documents as and when needed.

•Participating in code reviews and given major contribution in application performance improvement.

•Unit Test case preparation and unit testing.

Environment: ASP.Net, C#, Web Services, MS Commerce Server, SQL-Server 2008, Visual

Studio 2008, SVN and Devx controls.



Contact this candidate