BIG DATA ARCHITECT Resume Profile,USA

Reference Id: 81514     Posted on Wednesday 16th September 2015      Big Data/Hadoop



Please note that this is a not a Job Board - We are an I.T Staffing Company and we provide candidates on a Contract and Full-time basis. If you need I.T.Professionals to fill a Contract or a Full-time Position, please call (800) 693-8939

 BIG DATA ARCHITECT Resume Profile,USA

                         ·  BIG DATA ARCHITECT

 

 

PROFESSIONAL SUMMARY

 

  • Over 16 (Fifteen years) of experience in Information Technology (IT) in Analysis, Design and Development of software applications.
  • Over 10 years of experience in Data Warehousing and BI applications development for Retail, Banking, Airlines, Telecommunication and Manufacturing industries
  • Over 1 year of experience on Big Data Analytics with HP Vertica
  • Over 10 years of experience in development of data warehousing/Business Intellegence(BI) applications using Teradata TD13/TD12/TD5/TD4,  Informatica Power Center 8.6.1/8.1.1/7.1.2/6.2.1, Unix, DB2, Oracle, PL/1 technologies.
  • Over 10 years of experience as a ETL Lead/Technical Lead/BI Lead
  • Experienced in development of data warehousing applications using Teradata BTEQ, Bteq Import and Export, Fastload, Multiload, Fastexport, TPUMP and TPT utilities
  • Experienced in building ETL Architecture, which includes surrogate keys management, building stage area, Change Data Capture (CDC) management, Data Archival, Data File Management, Data and Files Purging, Data reconciliation.
  • Experienced in data extraction from Flat files, Oracle and Teradata sources using Unix Shell programs and Teradata utilities
  • Experienced in writing intensive Teradata SQL Queries
  • Experienced in tuning Teradata Applications for performance through horizontal and vertical table partitioning, indexes, Statistics, best coding practices, data compression, parallel processing techniques.
  • Experienced in developing Teradata Macros, Triggers, Stored Procedures, Views, Indexes
  • Experienced in development of Data Quality Monitoring Tool using Unix shell and Teradata
  • Experienced in project DBA work, which includes Logical Data Modelling, Physical Data Modelling (3NF and Dimensional), Implementation of objects, access management, application performance monitoring, capacity planning etc.
  • Experienced in ETL Data warehousing using Informatica PowerCenter 6.x/7.x/8.x tools like Source Analyzer, Target Designer, Mapping Designer, Mapplet Designer, Transformation Developer, Workflow Manager and Workflow Monitor.
  • Experienced in Informatica Power Center Tansformations such as Source Qualifier, Joiner, Filter, Router, Expression, Lookup, Aggregator, Sorter, Normalizer, Update Strategy, Sequence Generator and Stored Procedure transformations.
  • Experienced in data extraction from Flat files, Oracle, and Teradata sources using Informatica
  • Experienced in data loading into Flat files, Oracle and Teradata targets using Informatica
  • Experienced in data loading into Teradata using Informatica Power Center and Fastload and Multiload Teradata Utilities
  • Experienced in data loading using Relational and Teradata Loader Connections
  • Experienced in ETL Performance Tuning of mappings and sessions in Informatica
  • Experienced in creating BI reports for data consumers using Business Objects and Excel
  • Experienced in Master Data Management(MDM), Data Quality Management (DQM), Business Intelligence (BI), Data Integration (DI), Metadata Management (MM),.
  • Experienced in Project Planning, Project Estimation, Team Building and Team Management, Communication Management, Quality Management, Risk Management, working with multiple teams and multiple vendors, working with onsite and offshore model.
  • Experienced in Software Development Life Cycle (SDLC), which includes Requirements collection, Design, Development, Testing, Deployment, Post Deployment Support
  • Experienced in Data Quality Management, Master Data Management and Metadata Management
  • Experienced in software development using Waterfall and Agile software development methodologies
  • Experienced in Data Warehouse Application Maintenance, which includes operational excellence, change management, application performance management, data privacy management

·         Experienced in ETL design and development of Operational Data Stores (ODS) and Enterprise Data Warehouse (EDW)

·         Experienced in application development using Informatica Power Center tools

·         Experienced in Application Performance Management

·         Star Schema dimensional modeling, which include understanding business processes, modeling dimensions, hierarchies and facts

·         Experienced in development and testing of slowly changing dimensions (SCD) using Informatica Power Center tools

·         Good experience in business requirements collection, analysis and converting the same into data warehousing applications

·         Developed and Deployed Data Quality Monitoring Tool using Unix, Teradata and Control M technologies.

·         Experienced in Pre-sales, which include Proposal writing, Proposal estimation, Proposal presentation

·         Strong communication, managerial and leadership skills

·         Experienced in Banking, Airlines and Retail domains

 

 

SKILLS

 

Databases

Teradata 12/13, DB2, ORACLE, HP Vertica

Languages

PL/1, COBOL, JCL, K Shell, Awk

Operating Systems

IBM 3090/ES 9000, AMADHL, SunOS 5.8, Windows 2000, Windows NT

BI Tools

Business Objects XI R2, Cognos 8

ETL Tools

Informatica Power Center 8.6.1

Other Tools

Erwin 7.3, Quality Center, ControlM, WinCVS

 

 

PROFESSIONAL EXPERIENCE

 

Confidential      

Title                       : DATA ARCHITECT

 

Project Description:

 

Confidential has initiated a new project to migrate part of the core data from Teradata to Confidential, which is a less expensive platform.  Also migrate the downstream applications dependent on the core data.

 

The size of the core data and its associated applications migrated is 130TB.

 

Responsibilities:

 

·         Analyze applications running on Teradata.

·         Create a design to migrate applications running on Teradata to HP Vertica.

·         Create Logical and Physical Data Models for the migrated data.

·         Perform testing to make sure that data on the Vertica platform matches with that of Teradata

·         Analyze downstream applications and user queries, and provide solutions to migrate them on to Vertica.

·         Work with DBA, Data Strategists, Operations, Downstream app teams, Testing team etc

·         Monitor performance of queries on Vertica and work with DBA team to tune them.

·         Create metadata documentation and share it with the project teams.

·         Support deployment and testing activities.

Environment:  HP Vertica, Teradata 13, Erwin 7.3, Control-M, SQL Assistant, Unix

 

 

Confidential

                                                                                                               

Title                       : DATA ARCHITECT

 

Project Description:

 

Confidential has initiated a new program to integrate all enterprise data into one place called “Enterprise Data Warehouse (EDW)”.  The EDW will be one stop shop and help AT&T to look at its business by different dimensions.

 

This project objective is to source AT&T products, orders, customers, billing and invoicing data from one of the source system and integrates the source data into EDW.

Responsibilities:

 

·         Perform Data Profiling on the source system

·         Capture Source system entities, fields and relationships

·         Create Conceptual and Physical Data Models for the source system using Erwin 7

·         Understand the EDW architecture and the existing entities

·         Create EDW conceptual, logical and physical data model for the source system

·         Create mapping document between source system and EDW showing the business rules, which is one of the key input to the ETL development

·         Create Metadata for the EDW

·         Work with project stakeholders, who include SMEs, ETL development team, Test Team, Quality Control Team, Data Strategists

·         Provide physical table definitions to DBA for implementation

·         Contribute to Requirements gathering, Solution Approach, High and Low Level Design, Data Reconciliation process, Development and Implementation effort

 

 

 

Environment:  Teradata 13, Erwin 7.3, In house metadata tool, Oracle 11g

 

Confidential                                                                                                                       

Title                       : ETL Lead/Data Analyst/Application DBA

 

Project Description: Confidential is a one stop analytical platform containing Bank data.  The database platform is Teradata.  The Business Objects tool is used as a reporting tool.  The main subject areas are Deposits, Customer etc.

 

Before building the one stop BDW, the analytical data was stored in multiple platforms, which were not able to meet growing business needs and very expensive to manage.  The BDW was a long term initiative to meet analytical needs of the organization.

 

I played ETL Lead and Data Analyst Roles in CaptialOne.


ETL Lead Responsibilities:

 

·         Create ETL architecture using Unix shell scripts and Teradata Utilities

·         Lead and Guide the development team responsible for delivering Bank Account subject area, which is a biggest module in BDW.

·         Write Technical Design for Incremental/Delta loads and Historical data loads

·         Create ETL scripts to source data from disparate systems

·         Create ETL scripts to transform and load data into BDW

·         Tune complex scripts for performance.

·         Write Unit Test Plans, System Test Plans, User Test Plans

·         Schedule ControlM jobs

·         Create Handover documentation for Support Team

·         Provide project DBA support

·         Write mapping/cross walk documents and scripts to remediate scripts from the old system to the new system.

·         Create data model for monitoring data quality in BDW – 2500 data quality checks along 6 data quality dimensions

·         Develop and deploy data quality monitoring tool

·         Build Data Quality Dashboard for Bank Data Warehouse

 

Data Analyst Responsibilities:

 

·         Understand complex data structures and create processes to meet business needs

·         Remediate processes running on old analytical platforms to the new BDW analytical platform

·         Facilitate Knowledge sharing sessions for data analyst group

·         Write Training Material for data analysts new to the team

 

Application DBA Responsibilities:

 

·         Create a new database/container for Data Analyst(DA) processes automation

·         Create database objects for DA processes and maintain them

·         Grant access on the database objects to DA group members

·         Automate DA processes using Unix, Teradata and ControlM technologies and main them.

·         Create Teradata Macros to manage reference data

·         Tune DA Teradata scripts for performance

·         Create dashboard showing load status of DA processes

 

 

Environment:  Teradata 13, Unix, Control-M, K-Shell, BOXI R2, Teradata SQL Assistant, Erwin 7.3

 

 

Confidential                                                                                                                       

Title                       : ETL Lead

 

Project Description Confidential provides transformational medical technologies and services.  Confidential employs more than 46,000 people committed to serving healthcare professionals and their patients in more than 100 countries.  The BI HR Application receives Employee headcount data and Mylearning data from GE Corporate on daily and weekly basis.  The ETL process loads summarized headcount data into HR dimensional model.  The Cognos cubes and packages are built on the model to enable headcount analysis.  The HR application gives provision to make any changes to the headcount data, through web interface.

 

The objectives of BI Application Maintenance are

 

·         Application Operational Excellence

·         Application Performance improvement

·         Application Change Management

·         Application controls deployment

 

 

Responsibilities:

 

·         Make sure the application delivers the expected data within SLA time

·         Manage Application Changes, which include understanding the changes, plan the changes and delivering them

·         Synchronize the HR application with upstream applications

·         Coordinate with support teams (Production support team, Migration team, test team etc)

·         Work with data architect team to improve application performance and to come out with a solution for any new changes

·         Execute HR data privacy requirements

·         Execute Standard Extracts project to simplify the ETL processing

 

Environment:  Teradata V2R12, Informatica PowerCenter 8.6.1, CVS, Cronacle, K-Shell, BOXI R2

Confidential                                                                                       

Title                       : ETL Lead

 

 

Project Description: Confidential provides transformational medical technologies and services.  Confidential employs more than 46,000 people committed to serving healthcare professionals and their patients in more than 100 countries.

Confidential businesses are built on many different technologies, which include ERP and Non-ERP systems.  Having so many businesses and technologies, it takes so much of time and effort to look at enterprise wide Orders, Sales and Backlog data.  To ease the effort and to enable fast reporting, GEHC has initiated a new program called “Global Orders, Sales and Backlog (GOSB), to integrate enterprise wide Orders and Sales data, and enable BI reporting on the data.

The objectives of GOSB project are

·         Integrate Orders, Sales and Backlog data from all GE Healthcare businesses to enable BI reporting 

·         Automate all manual processes built for BI reporting on Orders, Sales and Backlog data from different GE Healthcare businesses.

·         Deliver the program in agile mode

 

Responsibilities:

  • Project Manager and ETL Lead for the team responsible for building Proof of Concept (PoC) for Orders, Sales and Backlog data for two sources, using Informatica, Teradata and Business Objects
  • Create ETL strategy for the PoC and assign the related activities to the team
  • Showcase the GOSB PoC to the business users and collect their feedback
  • Create plan to formalize the GOSB tool
  • Understand AS-IS BI reporting of different GEHC businesses, on Orders, Sales and Backlog data
  • Engage Architect team for building Logical and Physical data model
  • Design ETL strategy using Informatica and Teradata, to load data from different source systems/BI applications to GOSB tool
  • Create Project Plan, which includes Activities Planning, Work Assignment to team, Resource Planning, Project Scheduling, Major Deliverables for different sources
  • Execute the project in Agile mode, which include scrum planning, organize scrum meetings, organize showcase meetings, organize retrospective meetings
  • Showcase the tool to the stake holders and Collect feedback
  • Engage Business Analyst or Users for User Acceptance Testing, and get sign-off
  • Track any issues or changes found at any time during the project and close them in time
  • Co-ordinate with different teams (Informatica, DBA, BI tools team, Migration Team, Production Support Team, Test Team) to get sign-off for software migration into different development environments.
  • Create User Training Plan, Arrange User Training, Collect User feedback
  • Make sure the team follows all the applicable processes, which include client specific Software Development Life Cycle (SDLC)
  • Manage Project Knowledge and re-use it wherever required

 

Environment:  Teradata V2R12, Informatica PowerCenter 8.1, CVS, Cronacle, K-Shell, BOXI R2

 

Confidential                                                                                                                       

Title                       : ETL Lead

 

 

Project Description: Confidential provides transformational medical technologies and services.  Confidential employs more than 46,000 people committed to serving healthcare professionals and their patients in more than 100 countries.

Confidential businesses are built on many different technologies, which include ERP and Non-ERP systems.  Having so many businesses and technologies, it takes so much of time and effort to look at enterprise wide data.  To ease the effort and to enable fast reporting, GEHC has initiated a new program called Operational Data Store (ODS), to integrate enterprise wide data and enable BI reporting on the data.

 

The objectives of Operational Data Store (ODS) development project is

 

·         To build a single data store with data from several GE Healthcare businesses. 

·         Reduce load on operational systems by re-wiring the Enterprise Data Warehouse (EDW) applications to source their data from the ODS, instead of sourcing it from the source systems

·         Re-design General Ledger application for functionality and performance

 

Responsibilities:

·         As part of Database platform evaluation, create test plan to test Oracle and Teradata database with respect to ETL operations.  Get the test plan executed by the team.  Review the test results.  Present the results to the DBA teams and management team.

·         Part of the ETL team responsible for creating various assets for the project, which include ETL standards, Teradata standards, ETL Specification template, CDC approach

·         Understand requirements to populate ODS database and EDW database

·         Re-design the existing General Ledger application for new functionality and performance

·         Create Project Plan, which includes Activities Planning, Work Assignment to team, Resource Planning, Project Scheduling, Major Deliverables for different sources

·         Engage Business Analyst or Users for User Acceptance Testing, and get sign-off

·         Track any issues or changes found at any time and close them in time

·         Co-ordinate with different  teams (Informatica, DBA, BI tools team, Migration Team, Production Support Team, Test Team) to get sign-off for software migration into different development environments.

·         Create User Training Plan, Arrange User Training, Collect User feedback

·         Make sure the team follows all the applicable processes, which include client specific Software Development Life Cycle (SDLC)

·         Manage Project Knowledge and re-use it wherever required

·         Plan Knowledge transition to Production Team and Maintenance Team and execute the same

 

Environment: Teradata VR6, Informatica 7.1.2, CVS, Cronacle, K-Shell, BOXI R2

 

 

Confidential

                                                                                                               

Title                       : Technical Lead

 

Project Description:

Confidential created an enterprise data warehouse for analytical purposes.  The database is built on Teradata platform and stores large amount of data from disparate source systems.

 

 

Responsibilities:

·         Write  Technical Design and ETL mapping documents

·         Create test plans and perform various tests like Unit testing, System Testing, Load testing, User Acceptance testing

·         Perform Teradata upgrade testing

·         Tune Applications for performance

·         Guide the team to  troubleshoot technical challenges

·         Create documentation for implementation and provide post implementation support

·         Work with project teams like DBA, Change management team etc. to complete day to day activities

·         Make sure transition of new applications happens smoothly and the maintenance team is competent enough to maintain the applications

Confidential                                                                                                       

Title                       : ETL Lead

 

Project Description: Confidential tickets processing runs on Mainframe, Teradata and DB2 technologies with so many sources and business rules.  The whole process takes long time and it is very difficult to introduce any new change and test the same.  To simplify and enhance the functionality, ICW Tickets and Partners simplification project has been initiated.

 

ICW Tickets and Partners simplification development project objective is to simplify the existing CTD tickets processing and build a new tickets database for decision making purposes.  It is a fixed price project and the scope is Development, Unit Testing and System Testing.

 

Responsibilities:

·         Create project plan, which includes Resource Planning, Activity Planning, Defining Deliverables and Timelines, Quality Control, Team Building

·         Create ETL design strategy for loading data from different sources, using Informatica and Teradata

·         Develop and test all code related to mainframe, which use JCL, PL/1

·         Change Management and Defect Management

·         Help the team to resolve any technical issues

·         Project Tracking through meetings and status reports

·         Project Knowledge Management, which includes documenting best practices, lessons learnt, creation of functional and technical assets

 

Environment: Teradata V2R5, Informatica 6, CVS, Control-M, K-Shell, DB2, JCL, AMADHL Mainframe

 

Confidential                                                                                                                                       

Title                       : ETL Developer

 

Project Description Confidential program is to provide a single cross-departmental view of all commercial data of Airways for Marketing, Sales, Revenue Management, Customer Services & Operations, Strategy and Finance.  The ICW system sources its data from various systems which include Bookings system, Ticketing system, Customer transaction database, Operational Customer Datastore etc. Teradata Customer Relationship Tool (TCRM) is deployed to manage campaigns.

 

Responsibilities:

·         Develop Forward Bookings Summary using Teradata BTEQ and K Shell scripts

·         Develop Corporate Customer Rating application using Teradata BTEQ

·         Re-wire Campaign data feed from Customer database to Teradata CRM tool

·         Design and Develop Flight Operations database and Customer Campaign application using FASTEXPORT, FASTLOAD, FASTEXPORT, BTEQ and UNIX.

·         Teradata Queries Performance tuning

·         Develop ETL scripts using K-shell, Oracle Sql and Teradata utilities FASTLOAD and BTEQ

·         Load data from different source systems, which include oracle and flat files

·         Develop code for transferring files using XCOM and FTP

·         Create technical documentation, which include ETL design documentation, migration documentation, Unit Test Plan and System Test Plan, Unit Test Results and System Test Results

·         Follow the client specific Software Development Life Cycle process

 

                                                                                                                               

Title                       : Mainframe Designer

 

Project Description: The objective of Mortgage pathway system is to migrate the current mortgage functionality residing on a third party package to HSBC proprietary Retail Processing System (RPS) and enhance the current system.  The project objective is to reduce the costs incurred towards maintenance of the third party package, to utilize some of the functions already built on RPS, to migrate the current functionality onto RPS and enhance the same.

 

Responsibilities:

·         Understand AS-IS transactional process that loads data from user screens to the third party package

·         Understand the new data model created on Bank own retail processing system

·         Create mapping document between third party package and the new data model

·         Create High Level Design documents for data migration using COBOL, DB2, CICS

·         Create Low Level Design documents for data migration using COBOL, DB2, CICS

·         Understand the new transactional process, which loads mortgage data into the new tables

·         Create High Level Design documents for the new process using COBOL, DB2, CICS

·         Create Low Level Design documents for the new process using COBOL, DB2, CICS

·         Organize meetings with the users and technical teams to get sign-off

 

Environment: COBOL, DB2, CICS, JCL, IBM 3090/ES 9000

 

                                                                                               

Title                       : ETL Developer

 

a data warehouse to hold Airways booking and tickets data.  The CTD was later integrated with the strategic Enterprise Data Warehouse called Integrated Commercial Warehouse (ICW).  CTD sources its data from Bookings and Ticketing systems in the form mainframe files. The files are then processed using JCL and Teradata.  The processed data is stored on Teradata and it is used as a source to build various summaries and feeds for different user community.  The summaries are stored in DB2 and the British Airway’s owned tool is used to access the DB2 summaries.

 

Responsibilities:

·         Onsite-offshore coordination. 

·         Make enhancements to application as per user requests, data issues etc.

·         Bug Fixing, Data Validation and Testing

·         Development of data marts using Mainframe, JCL, TERADATA, DB2

·         Facts and Dimensions modeling for Booking Summary, Campaign Management Summary, Passenger Count Summary

·         Create Design documents, Test Plans, Test Cases, Deployment Plan, Job Scheduling instructions, Job Operating instructions

·         Organize review meetings with users and technical teams to get sign-off for designs and migration

·         Used the TERADATA utilities BTEQ, FASTEXPORT, FASTLOAD, MULTILOAD, BULKLOAD extensively to load build various Summaries and Feeds

·         Teradata queries performance tuning

 

Environment: Teradata V2R4, Control-M, PL/1, DB2, JCL, AMADHL Mainframe, Queryman

Title                       : Mainframe Developer

 

and managing Bank facilities at the retail outlets for accepting payments through cards.

 

Responsibilities:

·         Create High Level Design documents.

·         Create Low Level Design documents.

·         Create Test Plans

·         Review software code and test plans.

·         Develop software using COBOL, DB2, and CICS etc.

·         Perform Unit Test, System Test and User Acceptance Tests

·         Post Implementation Support

 

Environment:  COBOL, DB2, CICS, JCL, QMF, IBM 3090/ES 9000

 

Search Resumes

Looking for I.T Professionals on a Contract basis?