Data Engineer
And
Python Backend Developer
Who Am I ?
Experienced professional with 2+ years of expertise as a Data Engineer and software developer. Skilled in refining data processing pipelines and delivering reliable software solutions. Well-versed in Big Data tools, ETL, SQL, Python, and cloud platforms, and eager to contribute technical expertise in a dynamic work environment.!
View Resume/CVWhat are my skills ?
What's my previous experience ?
Futurense Technologies
Jul 2023 - Present
• Conducted data modeling to structure and import data into a MySQL database
• Leveraged advanced SQL techniques including Common Table Expressions (CTEs) and window functions to address diverse challenges related to loan claims and generated SQL reports using stored procedures and functions
• Enhanced data accessibility and scalability by migrating data from MySQL to Hadoop HDFS using Sqoop
• Utilized Hive data warehousing to derive actionable insights by querying, contributing to informed decision-making
• Further improved performance and efficiency by employing PySpark on Azure Databricks significantly enhancing data processing speed, making it 2x times faster
• Hands-on experience in crafting efficient data pipelines, showcasing my expertise in leveraging Azure stack services such as Azure Data Factory/Synapse from and to data lakes/Storage for data analysis to their fullest potential
Mitsogo
Nov 2022 - May 2023
Accomplished in optimizing and managing the backend server, leveraging a JSON API and Pydantic for robust data validation. Responsible for enhancing 30% speed of services and stores in the backend of a mobile device management product. Obtained hands-on experience in hexagonal architecture server sub-division and bug fixes using Git/Gitlab
Harman Connected Services
Sep 2021 - Oct 2022
Created APIs for a custom build framework utilized for automation in infotainment domain that uses objects from Squish. Gained hands-on experience in reviewing pull requests and bug fixes in production environment using Git/Gerrit. Enhanced API processes speed up to 70% and contributed to the design and development of the framework features
What're previous internships ?
The Travel Back
Aug 2020 - Dec 2020
Integrate trained models on building hybrid recommendation systems using Machine Learning in Travel domain. Transformed raw data to conform to assumptions of machine learning algorithms
Career Launcher
May 2020 - July 2020
Worked on Stock Data Analysis. Gained hands-on experience in applying ML models to stocks data. Explored time series analysis methods and visualiations on various stocks
Recent Projects?
Tech Stack: MySQL, MongoDB, Apache Airflow, DB2 on Cloud, PostgreSQL, Hadoop, Spark, IBM Cognos Analytics | May 23
Designed a data platform utilizing IBM Db2 on cloud as the data warehouse, MySQL as an OLTP database, and MongoDB as a NoSQL database for an e-commerce organization. Leveraged IBM Cognos Analytics to create reports and perform analytics on the data stored in the IBM Db2 on cloud data warehouse. Implemented automated ETL pipelines using shell commands, cron jobs, and Apache Airflow to extract, transform, and load data from MySQL and MongoDB into IBM Db2 on cloud. Integrated a Spark connection and deployed a ML model for accurate sales projections based on the data stored in IBM Db2 on cloud, enabling data-driven decision-making through comprehensive reports and analytics using IBM Cognos Analytics.
View project
Tech Stack: Python, Pandas, Webscraping | May 23
This project requires us to work as data engineers for an international financial analysis company. Our main task is to collect and track financial data, including stock prices, commodities, forex rates, and inflation rates. We will gather data from websites, APIs, and provided files (CSV, XML, JSON). After extracting and transforming the relevant information, we will save it in a ready-to-load format for data engineers to utilize. The project aims to support data-driven decision-making and generate valuable insights for the financial analysis company.
View project
Tech Stack: DJango, Jinja, SQLite, HTML, CSS | Dec 2021
Developed a Customer Relationship Management interface that acts an mediator between the clients and agents. Lead a team of 7 members by planning sprints and dividing the tasks effectively to meet the deadlines. Developed a dashboard portraying the analysis of companies growth in terms of managing clients.
View project
Tech Stack: Framework Django, MVT, Postgres | Dec 2020
Used DJango web framework to create web page that accepts previous sales auditing data to predict future backorders. Implemented XGBoost algorithm to generate future backorders and deployed on Heroku. Used Postgres database to create automatic tables in association with the input data from backend
View projectAlways feel Free to Contact & Hire me