Skip to content
View invictusaman's full-sized avatar
👋
Let's connect.
👋
Let's connect.
10 followers · 7 following

Achievements

Achievement: YOLOAchievement: Pull SharkAchievement: QuickdrawAchievement: Arctic Code Vault Contributor

Achievements

Achievement: YOLOAchievement: Pull SharkAchievement: QuickdrawAchievement: Arctic Code Vault Contributor

Block or report invictusaman

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
invictusaman/README.md

Hi there

Thanks for visiting my profile! I'm a Senior Data Engineer with 6+ years of experience building scalable data platforms across agriculture, logistics, healthcare, and financial services.

🚀 What I Do

  • 🏗️ Design and build cloud-native data platforms on Azure and AWS
  • ⚡ Develop high-performance ETL/ELT pipelines using Spark, Databricks, and Snowflake
  • 🎯 Implement modern data lakehouse architectures with Delta Lake and Medallion design
  • 📊 Create dimensional data models and analytics solutions for business intelligence
  • 🔒 Build data governance frameworks with Unity Catalog and quality validation systems

🔭 Current Focus

  • Building scalable data solutions at Bayer Canada using Azure Databricks and Delta Lake
  • Optimizing agricultural data pipelines for crop research and commercial analytics
  • Contributing to open-source data engineering projects
  • Sharing knowledge through technical blogs and tutorials

💻 Tech Stack:


Cloud Platforms
Azure AWS Databricks

Big Data & Processing
Apache Spark Apache Hadoop Apache Hive Apache Airflow

Data Warehousing
Snowflake Azure Synapse Amazon Redshift

Programming Languages
Python Scala SQL

Data Engineering Tools
Pandas NumPy Delta Lake

Databases
PostgreSQL MySQL MicrosoftSQLServer

DevOps & Version Control
Git GitHub Jenkins Azure DevOps

Data Visualization
Tableau Power BI




📫 Let's Connect!

💰 You can help me by Donating

BuyMeACoffee PayPal

⭐️ Open to collaborating on data engineering projects and contributing to open-source!

Pinned Loading

  1. my-personal-portfolio my-personal-portfolio Public

    This repo is for my personal data portfolio website! This has been in the planning phase for a really long time so I am glad that I can have this space where I can contribute my data experience, pr…

    TypeScript 11

  2. Indeed-WebScraper Indeed-WebScraper Public

    I created a webscraper tool to fetch indeed data. It will return job title, company name, url of the job, salary(if present) and many more.

    Python 3 1

  3. Azure-End-to-End-Data-Engineering-Pipeline Azure-End-to-End-Data-Engineering-Pipeline Public

    Designed and implemented a production-style data pipeline on Microsoft Azure — ingesting data from Azure SQL Server into ADLS Gen2 and processing it through a Medallion Architecture (Bronze → Silve…

    Python 1 2

  4. Ecommerce-Data-Pipeline Ecommerce-Data-Pipeline Public

    This project demonstrates an end-to-end data engineering pipeline for e-commerce data. It simulates realistic sales, customer, and product data, transforms it, and loads it into an analytics-ready …

    Python 1

  5. Glassdoor-WebScraper Glassdoor-WebScraper Public

    I designed a scraping 🕸️ tool to extract job posting data from Glassdoor. This scraping tool will return job title, company name, job id, location, salary, language and skills and many more.

    Python 1

  6. coursera-content-downloader coursera-content-downloader Public

    Forked from csyezheng/coursera-helper

    A command line tool for downloading contents from different courses from coursera.

    Python 1 1