A modular, Object-Oriented Data Science tool designed to automate Exploratory Data Analysis (EDA) and Data Cleaning. Acting as both a "Coroner" and a "Surgeon," this application helps users diagnose data quality issues and interactively fix them without writing a single line of code.
Upload any CSV or Excel file to get an instant health check:
-
Vitals Check: Automatically detects missing values, duplicates, and memory usage.
-
Abnormality Detection: Identifies statistical outliers (using IQR method) and highly skewed distributions.
-
Leakage Detection: Scans for features that are suspiciously correlated (>95%) with your target variable, preventing model cheating.
-
ML Readiness Score: A gamified score (0-100) that tells you if your data is ready for Machine Learning.
An interactive interface to clean your data step-by-step:
-
Smart Imputation: Fill missing values with Median, Mean, Mode, or a specific custom value.
-
Outlier Capping: Apply Winsorization to cap extreme values at the 5th and 95th percentiles.
-
Skewness Correction: Automatically apply Log Transformation (np.log1p) to normalize skewed features.
-
Categorical Encoding: Convert text columns to numbers using One-Hot or Label Encoding strategies.
-
Date Conversion: Detects and converts object columns to datetime format automatically.
-
PDF Export: Generates a downloadable PDF "Autopsy Report" that documents every issue found and every cleaning action taken.
-
Change Log: Tracks your edit history (e.g., "Renamed 3 columns", "Dropped 50 rows") for full reproducibility.
-
Architecture: Modular Python (OOP) separation between Logic (autopsy_engine.py) and UI (app.py).
-
Frontend: Streamlit
-
Data Processing: Pandas, NumPy, Scikit-Learn
-
Statistics: SciPy
-
Visualization: Plotly Express
-
Reporting: FPDF
- Clone the repository
git clone [https://github.com/Samuel-K-Anim/dataset-autopsy.git](https://github.com/Samuel-K-Anim/dataset-autopsy.git)
cd dataset-autopsy- Install dependencies
pip install -r requirements.txt- Run the App
streamlit run app.py├── app.py # The Face: Handles UI, Session State, and User Interaction
├── autopsy_engine.py # The Brain: Contains DataCoroner and DataHealer classes
├── report_generator.py # The Reporter: Handles PDF generation logic
├── requirements.txt # List of Python libraries
└── .streamlit/
└── config.toml # Server configuration (Upload limits)
Built as part of a Data Science portfolio project demonstrating advanced EDA, Object-Oriented Programming, and Software Engineering principles in Data Science.
Author: Samuel K. Anim