About
El Mehdi, also known as Mehdi, is a data engineer with a software engineering background. He is passionate about developing software, building data pipelines, and tackling challenges. With over 5 years of experience, Mehdi has had the opportunity to work on a diverse range of projects, some of which he has even led and built from the ground up.
This personal blog provides a platform for Mehdi to share his expertise and insights in the field of data engineering, as well as his personal opinions and observations.
Career
- Data Enginee @ Quandoo - 2021-2023 In August 2021, I joined Quandoo in Berlin, and embarked on a remarkable journey developing the Market Catalog project. This endeavor involved creating and contributing to data pipelines, building data warehouses, and overcoming various data challenges. From parallel ETL processing using Beam and Dataflow, to data warehousing with BigQuery, to constructing and managing CI/CD pipelines in GitLab, not to mention managing K8s and Composer clusters, this project was an experience where I developed everything nearly from scratch. Maintaining and building Scala and Python jobs, refactoring ML pipelines, and collaborating closely with Supply and Sales personnel further enriched this experience.
- Moved to Germany, 2021 Willkommen in Berlin
- Data Enginee @ IBM - 2020-2021 I joined IBM as a data engineer in 2020. I embarked on a journey of contributing to a diverse range of data engineering projects. I contributed to building data warehouse using Hive. Used PySpark and Python for developing an in-house data quality framework. PostgreSQL and SQLite were our main databases, and managed Hadoop YARN was our main resource manager for running Spark jobs. In parallel with that, I got certified as an AWS solution architect associate, got involved in developing UI of a data science model using ReactJS, and had the chance to work and deploy apps to Cloud Foundry in IBM Cloud
- Graduation, 2020: in 2020 I got my engineering degree in Business Intelligence and Data Engineer from ENSA Al Hoceima in Morocco.
- A fresh start and professional growth, 2016-2020: I delved into a diverse range of freelance projects, primarily focusing on web, backend, and mobile development. Java served as my primary programming language for backend development, particularly with JEE and Spring frameworks. In parallel, I employed PHP with Laravel 5 and MaterializeCSS framework for web platform creation. Additionally, I gained experience in mobile development, utilizing React Native for one project and native Android with Java back in 2016. Active involvement in competitive programming further honed my coding skills and problem-solving abilities.
Get in touch
Feel free to reach out to me for any inquery, collaboration, or if you just wanna say hi.