Hardeep Bhutter-Sr. Data Engineer
Check rate
Experience
Sr. Data Engineer
Charles Schwab Bank
- Designed and implemented end-to-end data pipelines (batch & streaming) using Python, SQL, and Apache Spark, Databricks on AWS reducing ETL latency by 40%.
- Developed serverless event-driven ingestion pipelines using AWS Lambda and SQS, ensuring real-time data availability for downstream analytics.
- Leveraged Google Cloud Platform (GCP) services including BigQuery and Dataflow to manage cross-cloud data warehousing and analytics integration.
- Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
- Managed and customized data pipelines using Databricks, Airflow. Automation using Docker, Kubernetes, Terraform.
- Automated data quality checks using dbt to modularize transformations and ensure production-grade data lineage, improving reliability by 30%.
- Collaborated with compliance teams to ensure GDPR and SOC2 alignment. Mentored junior engineers and contributed to architecture refactoring for scalability.
- Created and maintained dashboards in Power BI to provide actionable insights.
Sr. Data Engineer
Hamburg Commercial Bank
- Architected data lake solutions on AWS leveraging Glue, S3, and Lambda.
- Built robust serverless data processing frameworks using AWS Lambda for automated file validation and error handling.
- Developed Azure-based data solutions using Azure Data Factory (ADF) and Databricks, orchestrating complex ETL workflows in a multi-cloud environment.
- Optimized Azure Synapse Analytics performance by implementing partitioned tables and materialized views, enhancing query efficiency.
- Expertise in DMS (CDC, Full Load) and Airflow for scalable data pipeline automation and orchestration.
- Implemented CI/CD data pipeline deployment via Terraform and GitLab.
- Implemented data quality checks and observability using dbt tests to ensure structural integrity across warehouse layers.
- Led a 5-member team, scaling the data warehouse for financial reporting. Implemented fine-grained access controls ensuring GDPR compliance.
Sr. Data Engineer
Nokia
- Built scalable data ingestion frameworks with Python and Spark.
- Developed AWS-based integration components using Lambda and Kinesis for high-volume telemetry stream processing.
- Orchestrated cloud resources using AWS Step Functions to manage complex data workflows and recovery logic.
- Developed dashboards in Tableau for performance monitoring.
- Optimized SQL/Spark jobs and partitioning strategies, improving query performance by up to 5x.
- Integrated dbt for modeling raw data into presentation-ready star schemas, significantly reducing SQL complexity for end-users.
Data Engineer
MSCI
- Migrated ETL processes from Oracle to AWS Glue and Redshift. Automated metadata management for reporting pipelines.
Data Engineer
Hewlett Packard
- Designed data warehouse solutions for large enterprise clients. Introduced CI/CD pipelines for data workflows using Jenkins/Git. Managed and customized complex ETL pipelines, migration to Oracle Exadata box, Real time data with CDC.
Data Engineer
Trigyn Technologies Ltd
- Developed ETL workflows and PL/SQL scripts for analytics. Optimized queries for large datasets reducing runtime by 40%.
Sr. DBA
Hewlett Packard
- Managed Oracle databases, performed tuning and optimization. Assisted in data model design and ETL validation.
DBA
Tata Consultancy Services
- Maintained and monitored Oracle databases for banking systems. Supported data migration and performance tuning initiatives.
Industry Experience
See where this freelancer has spent most of their professional time.
Experienced in Banking and Finance, Information Technology, and Telecommunication.
Business Area Experience
See which departments and functions this freelancer has contributed to most.
Experienced in Information Technology and Business Intelligence.
Languages
Education
University of Bombay
B.sc · Electronics · Mumbai, India
University of Bombay
MBA · IT · Mumbai, India
Certifications & licenses
Oracle Certified 11g Admin and SQL Expert
Splunk
Statistics
Experience
Expertise
Qualifications
Profile
Frequently asked questions
Have questions? Find more information here.
Daily Rate Distribution
The rates shown represent the typical market range for freelancers in this position based on recent contracts on our platform.
Actual rates may vary depending on seniority level, experience, skill specialization, project complexity, and engagement length.
Average rates for similar positions
Rates are based on recent contracts and do not include FRATCH margin.
The average daily rate is the mean of all daily rates from recent contracts of comparable freelancers on our platform.
The median daily rate is the middle value of all daily rates — half of comparable freelancers charge less, half charge more. Unlike the average, it is barely affected by outliers.
Actual rates may vary depending on seniority level, experience, skill specialization, project complexity, and engagement length.
Similar Freelancers
Discover other experts with similar qualifications and experience
Experts recently working on similar projects
Freelancers with hands-on experience in comparable project as a Sr. Data Engineer
Nearby freelancers
Professionals working in or nearby Munich, Germany
