Vili D.-Senior Data Engineer, Data Architect, Software Developer

Check rate
Experience
Technical Lead, Data Engineer
Mercedes-Benz Consulting
Optimized the data architecture (Medallion) to better decouple processing steps and improve transparency and reproducibility
Ensured the technical quality of data processing in Databricks by introducing schema enforcement, data quality checks, and a structured data architecture
Pipeline orchestration with Azure Data Factory
Improved and automated the development and deployment process by integrating Git and GitHub Actions
Technical leadership of the Data Engineering team (3 employees)
Led workshops to optimize and stabilize the data platform and development process
Collected and prioritized new requests and maintained the product backlog
Technologies: Microsoft Azure (Data Lake, Data Factory), Databricks, Apache Spark (PySpark), Python, SQL, Git, Confluence, Power BI, Power Apps, Dataverse, MS Sharepoint, Mural
Project Manager, Solution Architect, Data Engineer
Mercedes-Benz Consulting
Technical leadership of a development team (7 employees), with responsibility for architecture design, data modeling, and backend development
Developed and optimized data processing steps in Databricks
Created and orchestrated ETL pipelines with Databricks Jobs
Performance optimization, testing, and troubleshooting
Project management, stakeholder management, and support during the go-live phase
Requirements engineering and advice on solution design
Applied agile project management methods, including creating and maintaining the product backlog
Technologies: Microsoft Azure (Data Lake, FunctionApp, WebApp), Databricks, Apache Spark (PySpark), Python, SQL, Git, Jira, Confluence, Power BI, MS Sharepoint, Mural
Data Engineering Lead, Data Engineer
Mercedes-Benz Consulting
Technical responsibility for developing new features for the company's internal AI-based Q&A system
Onboarded and processed new data formats, and optimized system integration and performance when handling large data volumes
Coordinated and integrated interfaces with the customer's external IT systems, and managed system connectivity
Technologies: AWS (EC2, S3, Glue, Lambda, Step Functions, DynamoDB, Neptune, Athena, SageMaker, OpenSearch Service, Cloud9, CLI, ECS, API Gateway, Cognito, CloudFormation, CodeCommit, CloudWatch, SNS), Microsoft Azure, Databricks, Apache Spark (PySpark), Python, SQL, REST APIs, Postman, Jira, Git, Confluence
Project Manager, Data Engineer
Mercedes-Benz Consulting
Designed and developed ETL pipelines in Databricks to process and provide production data for Process Mining analysis tools
Developed configuration logic for ETL pipelines to support different production facilities and prepare data for various aggregation levels
Agile project management, customer communication, and requirements engineering
Documented data pipelines and their configuration
Technologies: Microsoft Azure, Databricks, SQL, Python, Apache Spark (PySpark, Structured Streaming), YAML, Power BI, PAFnow, Git, OneNote
Product Owner, Solution Architect, Data Engineer
Mercedes-Benz Consulting
Technical responsibility for data engineering, including onboarding, processing, and standardizing content from documents, relational databases, and audio/video
Technical leadership of the Data Engineering team (up to 5 employees)
Managed external service providers for product development and improved system stability and quality
Designed and developed ETL pipelines with AWS Lambda, Glue, ECS, and Step Functions
Designed and developed a graph database with Amazon Neptune to store and query data and relationships using Cypher
Developed JSON, XML, and PDF parsers to extract relevant content
Integrated a speech-to-text LLM into ETL pipelines to extract content from audio and video files
Developed unit tests (PyTest, unittest) and automated testing
Designed the architecture and interfaces between product modules and external systems
Defined the product, created and prioritized the product backlog, and tracked development progress with Jira
Communicated between stakeholders and the development team, and documented work in Confluence
Technologies: AWS (EC2, S3, Glue, Lambda, Step Functions, DynamoDB, Neptune, Athena, SageMaker, OpenSearch Service, Cloud9, CLI, ECS, API Gateway, Cognito, CloudFormation, CodeCommit, CloudWatch, SNS), Python, Cypher, REST APIs, Postman, Jira, Git, Confluence
Project Manager, Solution Architect, Data Engineer
Mercedes-Benz Consulting
Technical leadership of the project team, design of the target architecture (Medallion)
Creation of the migration plan and coordination of the migration of on-prem MS SQL databases to Azure Data Lake
Analysis of existing Pentaho Data Pipelines and translation into Databricks ETL pipelines
Adaptation of Power BI dashboards and connection to Azure Data Lake
Documentation of migration steps, target architecture, and data pipelines in Confluence, handover to the maintenance team
Technologies: Microsoft Azure (ADLS Gen2, Data Factory), Databricks, Power BI, Pentaho, Git, Confluence, Apache Spark (PySpark), SQL, Python, Microsoft SQL Server
Project Manager, Power BI Dashboard Developer
Mercedes-Benz Consulting
Agile project management with KanBo, customer communication
Requirements engineering and consulting on solution design
Creation of the data model and definition of measures (DAX) to calculate KPIs
Development of the Power BI dashboard and connection of source data from MS Sharepoint
Creation of a playbook and deployment in Power BI Service
Documentation of the data model and development in Git
Technologies: Power BI, DAX, Power BI Service, MS Sharepoint, MS Office, KanBo, Git
Methods Expert, Data Engineer
Mercedes-Benz Consulting
Exploratory analysis and ML-based data analysis, including correlation analysis and feature engineering
Development of a Python algorithm to identify and handle missing or inconsistent data
Design and development of a forecasting model in Databricks to predict sales trends for digital services, assess and improve forecast accuracy
Development of a method to simulate What-If scenarios to support data-driven decision-making
Technologies: Microsoft Azure, Databricks, SQL, Python, Apache Spark (PySpark), Git, Mural, Power BI
Methods Expert, Software Developer
Lufthansa Systems
Development of a platform-independent C++ base library for calculating the Earth's magnetic field and key geodetic problems
Provision of different solutions to meet precision and performance requirements
Development of a web-based test application in JavaScript and CSS
Implementation of wrappers in Java, C# and C
Error analysis and resolution
Implementation and optimization of CI/CD processes in TeamCity
Development of unit tests and test automation
Creation and maintenance of functional and technical documentation with Doxygen
Technologies: C++, JavaScript, CSS, C#, C, Java, MS Visual Studio, .Net (Framework/Core/Standard), LiteDB, Git, Jira, Bitbucket, TeamCity, SourceTree, CMake, NuGet, Doxygen
Methods Expert, Software Developer
Lufthansa Systems
Design and implementation of a C++ library for visualizing aeronautical routes
Use of evolutionary algorithms and heuristics based on Kohonen
Development of a web-based test application in C# and .Net
Implementation of wrappers in Java, C# (.Net Framework, .Net Standard) and C
Error analysis and resolution
Implementation and optimization of CI/CD processes in TeamCity
Development of unit tests (with Catch) and test automation
Creation and maintenance of functional and technical documentation with Doxygen
Technologies: C++, C#, C, Java, MS Visual Studio, .Net (Framework/Core/Standard), Git, Jira, Bitbucket, TeamCity, SourceTree, CMake, NuGet, Doxygen
Customer Support Manager, Business Analyst
Lufthansa Systems
Functional support for a system that enables reactive and proactive pricing for a Tier 1 airline (at least 25 million passengers/year)
Specification of customer requirements and preparation of proposals for change requests
Preparation of functional specifications for new product features
Technical project management and functional leadership of the development team (6 employees)
Monitoring project progress and cost allocation
Liaison between customers and the development, maintenance, and operations teams
Incident analysis, coordination, prioritization, and monitoring of issue resolution
Conducting system and integration tests
Presentations and training for the customer's IT department
Technologies: SQL, Jira, Confluence, MS Office
Methods Expert, Software Developer
Lufthansa Systems
Time series analysis of bookings, cancellations, no-shows, etc. to identify events, seasonality, trends, anomalies, and noise
Development of decomposition and smoothing methods to handle anomalies
Modeling, implementation, and calibration of statistical and OR methods in C++ to improve demand forecasting
Development of a new generalized linear model (GLM) to improve cancellation forecasts and integration into the existing system
Comparative analysis of different modeling approaches (time series, regression models)
Generalization and restructuring of existing C++ components to improve scalability
Development of components for automated monitoring and ensuring data integrity
Measurement, analysis, and interpretation of forecast quality using large datasets
Identification and resolution of errors, as well as implementation and validation of tests
Preparation and expansion of functional and technical documentation
Technologies: C++, PL/SQL, Java, MS Visual Studio, Jenkins, MKS, Oracle DB, MS Office, Confluence
Automotive Function Developer
Berner & Mattner Systemtechnik
Research Associate
Technische Universität Berlin
Working Student
Lufthansa Systems
Industry experience
See where this freelancer has spent most of their professional time.
Experienced in Aerospace and Defense, Information Technology, Education, Automotive, and Professional Services.
Business area experience
See which departments and functions this freelancer has contributed to most.
Experienced in Information Technology, Quality Assurance, Product Development, Business Intelligence, Project Management, and Research and Development.
Summary
- Many years of hands-on experience in demanding digitalization projects, focusing on Data Analytics (from descriptive to prescriptive) and Artificial Intelligence (NLP, Generative AI), using leading cloud technologies (Azure and AWS) and Databricks
- Technical leadership of development teams, with responsibility for software architecture (layered architecture, client-server architecture), data modeling (dimensional, object-oriented, and graph models), and the development and orchestration of ETL pipelines
- Development and optimization of statistics and operations research methods (regression and time series analysis, multivariate methods, linear/nonlinear/dynamic optimization, simulation) to support data-driven decision-making
- Several years of experience in software development (with Python and C++) in international, distributed, and interdisciplinary teams
- Experience in key roles such as Product Owner, Project Manager, Data Engineer, Software Developer, and Business Analyst
Skills
- 16 Years Of Experience Developing Complex Software Solutions, With Strong Methodological Expertise
- Several Years Of Experience In Software Architecture, Data Modeling, And Etl Pipeline Development On Cloud Platforms (Azure, Aws) And Databricks
- Development And Implementation Of Forecasting Models And Optimization Methods (Python, C++, Matlab), As Well As Intelligent Q&A Systems Using Nlp And Generative Ai
- Strong Knowledge Of Agile Methodologies, Software Development Processes, And Agile Project Management
- Programming: Python, Pyspark, C/C++, Sql, C#, C++/Cli, Java, Pl/Sql, Dax, Cypher
- Databases: Oracle, Microsoft Sql Server, Amazon Dynamodb, Amazon Neptune, Mongodb, Litedb
- Cloud / Data / Ai Platforms: Microsoft Azure (Delta Lake, Data Factory, Functionapp), Aws (S3, Glue, Lambda, Step Functions, Dynamodb, Neptune, Athena, Sagemaker, Opensearch Service, Ec2, Cli, Ecs, Api Gateway, Cloudformation, Sns), Databricks (Data Intelligence Platform, Uc, Acls, Lakeflow, Dlt, Sdp, Workflows, Jobs, Pipelines, Batch, Structured Streaming, Dab, Dataops, Ci/Cd, Sdk, Cli)
- Tools / Frameworks: Apache Spark, Apache Kafka, Docker, Power Bi, .Net (Framework / Core / Standard), Git, Svn, Bitbucket, Teamcity, Jenkins, Cmake, Ms Visual Studio, Nuget, Rest Apis, Postman, Salesforce Sales & Service Cloud, Pentaho, Matlab, Ms Office, Jira, Confluence, Sharepoint, Mural, Doxygen
- Soft Skills: Analytical, Structured, And Solution-Oriented Approach
- Soft Skills: Strong Ability To Work With Abstract Concepts
- Soft Skills: Leadership, Strong Communication, And Team Orientation
Languages
Education
TU Berlin
PhD in Mathematics · Mathematics · Berlin, Germany
TU Berlin
Diploma in Mathematics · Mathematics · Berlin, Germany
Certifications & licenses
Databricks Certified Data Engineer Professional
Statistics
Experience
Expertise
Qualifications
Frequently asked questions
Have questions? Find more information here.
Vili is based in Neuenhagen, Germany and can operate in on-site, hybrid, and remote work models.
Vili speaks the following languages: Albanian (Native), German (Advanced), English (Advanced).
Vili has at least 21 years of experience. During this time, Vili has worked in at least 12 different roles and for 4 different companies. The average length of individual experience is 1 year and 5 months. Note that Vili may not have shared all experience and actually has more experience.
Based on recent experience, Vili would be well-suited for roles such as: Technical Lead, Data Engineer, Project Manager, Solution Architect, Data Engineer, Data Engineering Lead, Data Engineer.
Vili's most recent position is Technical Lead, Data Engineer at Mercedes-Benz Consulting.
In recent years, Vili has worked for Mercedes-Benz Consulting.
Vili is most experienced in industries like Aerospace and Defense, Information Technology, and Education. Vili also has some experience in Automotive and Professional Services.
Vili is most experienced in business areas like Information Technology, Quality Assurance, and Product Development. Vili also has some experience in Project Management, Business Intelligence, and Research and Development.
Vili has recently worked in industries like Automotive and Professional Services.
Vili has recently worked in business areas like Information Technology, Business Intelligence, and Project Management.
Vili holds a Doctorate in Mathematics from TU Berlin.
Vili has 3 certificates. These include: Databricks Certified Data Engineer Associate, Databricks Certified Data Engineer Professional, and Professional Scrum Product Owner I.
Vili is immediately available full-time for suitable projects.
Daily rate distribution
The rates shown represent the typical market range for freelancers in this position based on recent contracts on our platform.
Average rates for similar positions
Rates are based on recent contracts and do not include FRATCH margin.
The average daily rate is the mean of all daily rates from recent contracts of comparable freelancers on our platform.
The median daily rate is the middle value of all daily rates — half of comparable freelancers charge less, half charge more. Unlike the average, it is barely affected by outliers.
Calculated based on our freelancers’ daily rates as of 17 Nov 2026. Actual rates may vary depending on seniority level, experience, skill specialization, project complexity, and engagement length.
Similar freelancers
Discover other experts with similar qualifications and experience
Experts recently working on similar projects
Freelancers with hands-on experience in comparable project as a Technical Lead, Data Engineer
Nearby freelancers
Professionals working in or nearby Neuenhagen, Germany
