Ashkan Zadeh
Microsoft Azure Senior Data Engineer / Senior Data Scientist
Experience
Microsoft Azure Senior Data Engineer / Senior Data Scientist
Vattenfall Europe
- Advising on the use of analytics and BI tools and services in the Microsoft Azure stack (e.g., MS Fabric, Synapse Workspaces and dedicated SQL pools, SQL Database, PostgreSQL, Snowflake, Databricks, Data Factory, SSIS, Analysis Services, Function Apps, Power BI, ML)
- Independently designing analytics solutions using Python, SQL, etc.
- Designing and implementing ETLs and data pipelines
- Creating and maintaining APIs
- Independently applying CI/CD, testing, and version control
- Data modeling
- Model development and optimization
- Anomaly detection with AI
- Predictive analytics
Technologies used:
- Snowflake
- Fabric
- Azure Synapse Analytics
- Azure DataFactory
- Azure Data Lake
- Azure DevOps
- Databricks
- Spark
- CI/CD
- SQL Database
- Python
- Power Platform
Senior Data Engineer and Data Governance Manager
Federal Statistical Office
- Project design
- Designing a big data architecture for processing very large data volumes
- Designing and implementing ETLs and data pipelines
- Data governance in the CDP
- Data classification and cataloging (e.g., PII detection)
- Metadata management and data inventory
- Access controls and permissions management (Access Management)
- Supporting the department in designing and running new projects
- Onboarding and training department staff for the Cloudera Data Platform
- Developing automated reporting
Technologies used:
- Cloudera
- Spark
- Kafka
- NiFi
- Ranger
- Atlas
- Python
- SQL
- Azure
- Airflow
- CI/CD
- Power BI
- AWS
Other Senior Data Engineer & Data Governance Manager
Federal Statistical Office
- Data governance in the CDP
- Data classification and cataloging (e.g., PII detection)
- Metadata management and data inventory
- Access controls and permissions management (Access Management)
- Ensuring GDPR and data privacy compliance
- Monitoring data quality and integrity
- Conducting audits and lifecycle management (archiving/deletion)
- Planning, organizing, and executing the project
- Integrating data from HTTP clients, Azure Blob Storage, and Azure Data Lake Gen2 with Azure Data Factory
- Branching and chaining activities in Azure Data Factory pipelines using control flow activities
- Implementing data pipelines to extract data from various sources
- Transforming data with ADF
- Designing and implementing ETLs and data pipelines
Technologies used:
- Cloudera
- Hadoop
- Spark
- Airflow
- Hive
- Kafka
- NiFi
- Python
- Azure
- CI/CD
- Power BI
- AWS
Senior IoT & Data Engineer
Goethe University Frankfurt & Wölfel GmbH, Volta GmbH
- Developing an architecture for automatic data collection and processing
- Project coordination & monitoring
- Developing cloud-based data engineering and IoT solutions for real-time data
- Developing Stream Analytics jobs for real-time processing and analysis of data from IoT devices
- Designing and building ETL pipelines
- Implementing producers and consumers to send and receive data events
- Automated event classification with AI
- Developing forecasting data
- Independently applying CI/CD, testing, and version control
Technologies used:
- Azure
- Azure IoT Hub
- Azure Event Hub
- Azure Synapse
- Azure Stream Analytics
- Spark
- Python
- SQL/NoSQL
- Power BI
- scikit-learn
- TensorFlow
- Optuna
Data Engineer
Trumpf SE & Co KG
- Building an architecture using Databricks, PySpark, and Delta Lake for SAP data
- Integrating data quality rules into Delta Lake via Blob Storage using PySpark
- Developing PySpark scripts in Databricks notebooks to validate SAP data
- Implementing data quality rules with PySpark and Delta Lake
- Troubleshooting data flows with Databricks tools and Spark logs
- Creating Databricks workflows for automated data quality checks
- Monitoring data quality pipelines with alerts in Databricks
- Creating data quality reports with Databricks SQL and Power BI
- Ensuring SAP data quality with Delta Lake and governance reports
Technologies used:
- Snowflake
- Azure
- Databricks
- PySpark
- Delta Lake
- Blob Storage
- Power BI
- CI/CD
- DevOps
Data Scientist
GMT Ltd.
- Design and implementation of advanced deep learning models for automated detection and classification of breast cancer in radiological image data
- Performing feature extraction to identify relevant image features using convolutional neural networks (CNNs)
- Improving model performance by fine-tuning the loss function and hyperparameters with Optuna
Technologies used:
- Python
- TensorFlow
- PyTorch
- CNN architectures
- Optuna
Tutor
Goethe-Universität Frankfurt
- Introduction to machine learning
- Computer-based signal processing
- Mechanics and thermodynamics
- Nuclear astrophysics
- Research and lab internship
IT Administration
St. Hippolyt - Mühle Ebert GmbH
- IT administration tasks
- Monitoring of bottling lines
Industry Experience
See where this freelancer has spent most of their professional time.
Experienced in Education, Manufacturing, Agriculture, Energy, Government and Administration, and Information Technology.
Business Area Experience
See which departments and functions this freelancer has contributed to most.
Experienced in Information Technology, Business Intelligence, Research and Development, Production, Project Management, and Quality Assurance.
Summary
- PhD at Goethe University Frankfurt, Institute of Physics, working group 'Terahertz Photonics'.
- Research focus: data and signal processing and machine learning.
Skills
Microsoft Azure
- Fabric
- Data Factory
- Synapse Analytics
- Blob Storage
- Event Hub
- Cosmosdb
- Iot Hub
- Stream Analytics
- Hdinsights
- Data Lake Gen2
- Sql Database
- Devops
- Power Bi
- Power Platform
Databricks
- Pyspark
- Scala
Snowflake
AWS
- Lambda
- Kinesis
- Cloudwatch
- S3
- Redshift
- Dynamodb
- Athena
- Sns
- Sqs
- Glue
- Data Pipeline
- Emr
- Rds
- Python
Other
- Spark
- Airflow
- Kafka
- Sql
- Nosql
- Matlab
Languages
Education
Goethe University Frankfurt
PhD · Numerical and Experimental Studies on the Classification of Airborne Objects near Wind Turbines · Frankfurt, Germany
Goethe University Frankfurt
Master of Science · Physics · Frankfurt, Germany
Goethe University Frankfurt
Bachelor of Science · Physics · Frankfurt, Germany
Certifications & licenses
CDMP Practitioner (Certified Data Management Professional)
CDP Data Governance with SDX
Databricks Certified Data Engineer Associate
Databricks
Microsoft Certified: Azure Data Engineer Associate
Microsoft
Snowpro Advanced: Data Engineer
Statistics
Experience
Expertise
Qualifications
Profile
Frequently asked questions
Do you have questions? Here you can find further information.
Where is Ashkan based?
What languages does Ashkan speak?
How many years of experience does Ashkan have?
What roles would Ashkan be best suited for?
What is Ashkan's latest experience?
What companies has Ashkan worked for in recent years?
Which industries is Ashkan most experienced in?
Which business areas is Ashkan most experienced in?
Which industries has Ashkan worked in recently?
Which business areas has Ashkan worked in recently?
What is Ashkan's education?
Does Ashkan have any certificates?
What is the availability of Ashkan?
What is the rate of Ashkan?
How to hire Ashkan?
Average rates for similar positions
Rates are based on recent contracts and do not include FRATCH margin.
Similar Freelancers
Discover other experts with similar qualifications and experience
Experts recently working on similar projects
Freelancers with hands-on experience in comparable project as a Microsoft Azure Senior Data Engineer / Senior Data Scientist
Nearby freelancers
Professionals working in or nearby Kelkheim (Taunus), Germany