AZURE Data Engineer

Exposure in working on DevOps /Agile operations process and tools area (Code review, unit test automation, Build & Release automation Environment, Incident and Change Management) including various tools. Developed Spark applications using Spark SQL in Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns. Extensive knowledge in dealing with RDBMS including E/R Diagrams, Normalization, Constraints, Joins, Keys and Data Import/Export. Managed large datasets using Panda data frames and MySQL. Proficient in Extraction Transformation and Loading (ETL) process by pulling large volumes of data (VLDB) from various data sources using SSIS.

Worked with Python OO Design code for manufacturing quality, monitoring, logging, and debugging code optimization.