A company is looking for an experienced Data Engineer to carry out a migration from Snowflake to ClickHouse. The focus is on using Apache Spark for data processing and on managing and optimizing Kubernetes environments. The goal is to build and operate a powerful and scalable data platform.
- Executing the migration from Snowflake to ClickHouse
- Developing and optimizing data pipelines with Apache Spark
- Managing and optimizing Kubernetes clusters
- Ensuring the performance and scalability of the data platform
- Implementing solutions in Python
- Optional: Working with Snowplow for data analytics
- Solid experience with Kubernetes and Apache Spark
- Knowledge of ClickHouse and Snowflake
- Very good Python skills
- Experience with data platform migrations
- Optional: Experience with Snowplow
- Fluent English skills
Frequently asked questions
Where is the project located?
What is the expected workload for the project?
What is the remote work policy for the project?
What is the daily rate for the project?
What language skills are required for the project?
Which industries is the project related to?
Which business areas does the project cover?
Not available? Can I still benefit from the project?
How to apply for the project?
Similar Projects
Freelance Electrical Engineer with Python Experience (m/w/d)
Vibe Coding Web Scraping Expert (m/f/d)
Development of TM1 Planning Analytics and Interfaces (m/w/d)
AI Consultants - Data Science (m/w/d)
Freelance Mechanical Engineer with Python Experience (m/w/d)
AI Consultant - Machine Learning (m/w/d)
Senior Cloud Developer TypeScript (m/f/d)
Freelance Automotive Engineer (with Python) - Quality Assurance / AI Trainer
Java IT Architect (m/f/d)
Area Product Manager (m/f/d)
AI Evaluation Consultant (m/w/d)
Cyber Security Consultant – Product Security & Regulatory Compliance (m/f/d)
Project Manager (Project Control Focus) (m/f/d)
Financial Accountant (m/f/d)
Interim Accounting Lead / Head Of (m/f/d)
Construction Manager according to LBO - Civil and MEP (m/f/d)
Auditor – FSC® and PEFC Chain of Custody (m/f/d)
Social Compliance Auditor (m/f/d)
ISO 20121 Auditor (w/m/d)
Expert in Process Automation for Law Firm Environments (m/f/d)
Interim Staff Product Manager (m/w/d)
Management Consultant (Senior Level) (m/f/d)
Safety and Health Protection Coordinator (SiGeKo) and Safety Specialist (SiFa) (m/f/d)
Control Systems Engineer / Control Systems Specialist (m/f/d)
Consulting in the field of Tax Strategy
IT Project Manager ISO 27.001 - Gap Closure (m/f/d)
Freelance Product Owner for Point Of Sale App
Infor AS Consultant (m/f/d)
Evaluation Scenario Writer (m/w/d)
Commissioning & Qualification (C&Q) Engineer (m/f/d)