Databricks Certified Data Engineer Associate

• Lakehouse build: Designed and built the member & eligibility domain of an Azure Databricks healthcare lakehouse, ingesting SQL Server, file and REST/SFTP sources (JSON, CSV, XML, Parquet) via Azure Data Factory into ADLS Gen2.
• Medallion pipelines: Transformed data through bronze, silver and gold Delta Lake layers with PySpark and Spark SQL; used Delta Live Tables / Lakeflow with built-in expectations for declarative, quality-checked pipelines.
• Platform modernisation: Delivered a SQL Server-to-cloud platform: ADF → ADLS Gen2 → Databricks → dbt Core models → Snowflake → Power BI, replacing legacy reporting with governed analytics.
• Robust ETL: Built metadata-driven, idempotent full, incremental and watermark-driven loads with schema evolution and failure-state handling, improving reliability and re-runnability.
• Data modelling: Designed Kimball star schemas with SCD Type 1 & 2 dimensions; tuned slow queries and pipelines using execution plans.
• Governance & security: Applied Unity Catalog RBAC, lineage and audit logging, with Azure Key Vault secrets and managed identities, to meet HIPAA and GDPR requirements.
• Leadership & mentoring: Led a 6-person team (2 data engineers, 2 analysts, BI developer, QA); mentored engineers, set delivery standards and coordinated with international stakeholders.
• Delivery & AI-assisted work: Ran CI/CD and work tracking in Azure DevOps; built Power BI semantic models with DAX and RLS; used Genie Code, Claude and Copilot to accelerate PySpark/SQL development, DAX and documentation.

• Led end-to-end delivery of complex international customer-facing IT and system transformation projects across mobility, retail, life sciences, and product development domains.

• Managed project opportunities and delivery initiatives from concept development, planning, execution, migration, validation, deployment, and final customer acceptance.

• Acted as the primary point of contact for project stakeholders, ensuring alignment between customers, business units, suppliers, and delivery teams.

• Ensured timely project execution through proactive monitoring of milestones, deliverables, dependencies, risks, and resource requirements.

• Led and coordinated global cross-functional teams of 20+ members across multiple time zones. Served as the central coordination point for project activities, ensuring accountability, milestones, progress tracking, and timely resolution of issues across multiple stakeholders. Managed status reporting with all the stakeholders, providing clear and timely updates to ensure alignment on project goals.

• Provided functional leadership, mentoring, coaching, and issue resolution support to project team members. Worked closely with senior leadership and executive stakeholders to define project charter and project scope, priorities, milestones, manage dependencies, success criteria and achieve project goals.

• Collaborated closely with senior leadership, business stakeholders, suppliers, operations teams, and external partners to define project objectives and ensure successful execution.

• Managed stakeholder communication through executive dashboards, KPIs, governance reviews, steering committee meetings, and project status reporting.

• Anticipated business needs and provided effective technical solutions in a timely manner to improve business satisfaction.

• Led and supported sub-project management structures, ensuring consistent execution, reporting, and escalation across complex initiatives.

• Managed supplier relationships and service providers to ensure compliance with contractual obligations, service levels, timelines, and quality expectations.

• Supported vendor selection processes, RFP evaluations, delivery governance, cost monitoring, and performance reviews.

• Controlled project budgets, forecasts, resource allocations, and financial tracking to ensure delivery within approved constraints.

• Scheduled workshops explaining the business requirement, prioritizing project goals and managing change.

• Oversaw cloud migrations (Azure/ AWS), database migrations/upgrades, system upgrades, infrastructure & application modernization, data management, legacy decommissioning initiatives, AI solutioning, transition plan of 2000+ applications etc.

• Coordinated execution, deployment, integration, commissioning, data migration and handover activities to ensure production readiness.

• Led a cross-functional team proactively managing dependencies and resolving project issues to closure, while maintaining delivery timelines.

• Proactively managed project risks, dependencies, issues, change requests, and escalations to ensure predictable project outcomes.

• Ensured compliance with GxP, ITIL, corporate governance standards, validation requirements, and audit controls.

• Led internal and external audit support activities, validation documentation, CAPA coordination, and regulatory compliance initiatives.

• Drove process standardization, automation, and governance improvements across project delivery functions.

• Led application rationalization initiatives resulting in the retirement of more than 50 legacy applications, improving operational efficiency and reducing maintenance costs.

• Currently driving Generative AI initiatives to automate project documentation, reporting, knowledge management, and delivery processes.

• Facilitated lessons learned workshops and implemented continuous improvement actions to enhance project execution effectiveness.

• DWH modernization
• Migration from Informatica PowerCenter to IDMC/CDI
• Migration from IBM DB2 to Databricks

Technologies: Informatica IDMC, Databricks

• Advising on the use of analytics and BI tools and services in the Microsoft Azure stack (e.g. MS Fabric, Synapse Workspaces and dedicated SQL pools, SQL Database, PostgreSQL, Snowflake, Databricks, Data Factory, SSIS, Analysis Services, Function Apps, Power BI, ML)
• Independently designing analytics solutions with Python, SQL, etc.
• Designing and implementing ETLs and data pipelines
• Creating and maintaining APIs
• Independently applying CI/CD, testing, and version control
• Data modeling
• Model development and optimization
• Anomaly detection with AI
• Predictive analytics

Used technologies:

• Snowflake
• Fabric
• Azure Synapse Analytics
• Azure DataFactory
• Azure Data Lake
• Azure DevOps
• Databricks
• Spark
• CI/CD
• SQL Database
• Python
• Power Platform