Azure Data Engineer

Key skills

• Design and build production data pipelines from ingestion to consumption
• Experience in using Azure services and tools to ingest, egress, and transform data from multiple sources
• Experience in Perform Design, Development & Deployment using Azure Services (Azure Data Factory, Azure Data Lake Storage, Databricks, SQL)
• Develop and maintain scalable data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity
• Worked with Snowflake Data Warehouse / SSIS
• Working experience with loading multiple files from blob to SQL
• Files Processing XML, CSV, Excel, ORC, Parquet file Formats
• Develop batch processing, streaming and integration solutions and process Structured and Non-Structured Data
• Demonstrated in depth skills with Azure Data Factory, Azure Databricks, Azure Synapse, ADLS (must have) with the ability to configure and administrate all aspects of Azure SQL DB