Data Analysis Using Python: A Beginner’s Guide Featuring NYC Open Data.
-
Updated
Nov 23, 2024 - Jupyter Notebook
Data Analysis Using Python: A Beginner’s Guide Featuring NYC Open Data.
Buying a home in NYC, what Neighborhoods are the best value? This project seeks to understand the fundamental factors that explain differences in residential real estate prices across NYC.
[WIP] Building a New York City job portal using the NYC OpenData Jobs API:
Early-warning system for NYC senior-care dispatchers — flags elevator outages and heat-driven failure risk before routes go out
Conducting geodemographic classification for ethnic groups in NYC using K-means algorithm available in sklearn.cluster module.
Automated Python data cleaning pipeline using pandas to process and standardize messy NYC restaurant inspection records for analysis.
CrashLens analyzes traffic accident data through visualizations (histograms, pie charts, line plots, scatter plots) and DBSCAN clustering to identify accident hotspots. It includes data cleaning and supports datasets from various locations, with a focus on NYC crash data.
Identified data types for each distinct column value on 1900 data sets. For each column, summarized semantic types present in the column, using Fuzzy Logic, Levenshtein distance. Identified & derived inference the 3 most frequent 311 complaint types by borough.
Python ETL and data analysis project exploring Queens flooding-related 311 complaints using NYC Open Data.
Predict NYC restaurant inspection grades (A vs B/C+) with leak-safe, time-split ML baselines.
Interactive dashboard analyzing NYC affordable housing violations to identify enforcement gaps and hold repeat offenders accountable. Data-driven tool for tenant advocacy and policy analysis.
NYC 311 operations analytics project using the NYC Open Data API. Builds a Postgres pipeline (raw → core → marts) and a Streamlit dashboard to track request volume, backlog, resolution-time SLAs, top complaint types, and agency performance, with notebooks for data pull, cleaning, and insights.
ETL pipeline and Streamlit dashboard analyzing 50,000 NYPD arrest records with live weather API integration
Interactive Streamlit dashboard analyzing NYC renovation permits using NLP, clustering, time-series trends, and ML models. Includes keyword extraction, category prediction, PCA plots, and exportable visuals.
Hands-on lab analyzing 100,000+ NYC traffic collision records from 2024 with Python/SQL to identify safety patterns and temporal trends that inform city policy. It demonstrates how Oracle Cloud Infrastructure's serverless autonomous database makes large-scale civic data analysis accessible—without the complexity of managing database infrastructure.
NYC Halal Restaurant Opportunity Finder — 3-phase ML pipeline (KMeans, Cosine KNN, GMM) with Streamlit frontend
ClearLane MCP: audit-ready bus reliability investigations from MTA, NYC Open Data, 311, and optional vision evidence.
On-chain rent escrow that holds USDC while a NYC HPD housing violation is open, then settles based on the resolution. ETHGlobal NY 2026.
Reproducible SQL + data quality case study on NYC 311 Service Requests (50k Socrata sample, SQLite, 24 named queries)
EDA to find insights, trends and patterns among the NYC K-8 Public School student academic performance and population to determine which factors may have impacted educational outcomes after the Covid19 Lockdown.
Add a description, image, and links to the nyc-open-data topic page so that developers can more easily learn about it.
To associate your repository with the nyc-open-data topic, visit your repo's landing page and select "manage topics."