Cleanytics

AI-Powered Data Cleaning & Analytics Platform

📊 Turn Messy Data Into Meaningful Insights

Cleanytics is an AI-powered data cleaning and analytics platform designed to transform messy CSV and Excel datasets into clean, structured, and meaningful information.

The platform combines a modern React frontend with a FastAPI backend to provide authentication, dataset management, analytics, audit logging, health monitoring, and background job tracking.

📌 About Cleanytics

Cleanytics aims to make data cleaning and analysis easier for users who work with large or messy datasets.

🎯 Main Goal

Upload your data → Clean it → Analyze it → Get better insights.

Typical Workflow

User
 │
 ▼
Login / Register
 │
 ▼
Upload CSV / Excel
 │
 ▼
Dataset Processing
 │
 ▼
Data Cleaning
 │
 ▼
Analytics & Quality
 │
 ▼
Dashboard
 │
 ▼
History / Audit / Export

✨ Key Features

🔐 Authentication User registration, login, token refresh and password recovery.	📁 Dataset Management Upload and manage CSV and Excel datasets.	📊 Analytics Dashboard statistics and dataset-level analytics.
🧹 Data Cleaning Dataset processing and quality tracking.	📝 Audit History Track user actions and application activity.	⚡ Background Jobs Track long-running dataset processing tasks.
❤️ Health Monitoring Monitor backend and database availability.	👤 User Management Manage user profiles and admin access.	📈 Dashboard View dataset statistics and quality information.

🚀 Version 2 Updates

Update	Status
Dashboard	✅
Dashboard Triggers	✅
Dashboard Interactions	✅
UI Improvements	✅
Bug Fixes	✅
Localhost Support	✅
Frontend Integration	✅
FastAPI Backend	✅
API v1 Structure	✅
Database Integration	🔄
Advanced Data Cleaning	🔄
AI Cleaning Engine	🔮

🏗️ System Architecture

┌──────────────────────────────────────┐
│          React 19 Frontend           │
│                                      │
│  Login • Dashboard • Analytics       │
│  History • Settings • Upload         │
└──────────────────┬───────────────────┘
                   │
                   │ REST API
                   ▼
┌──────────────────────────────────────┐
│          FastAPI Backend             │
│                                      │
│              /api/v1                 │
│                                      │
│  Auth • Users • Datasets             │
│  Analytics • Audit • Jobs • Health    │
└──────────────────┬───────────────────┘
                   │
          ┌────────┴────────┐
          ▼                 ▼
┌─────────────────┐  ┌─────────────────┐
│    Database     │  │ Background Jobs │
│                 │  │                 │
│ PostgreSQL      │  │ Celery          │
│ SQLite Fallback │  │ Task Tracking   │
└─────────────────┘  └─────────────────┘

⚙️ Backend API

The Cleanytics backend provides a versioned API layer located at:

Backend/app/api/v1/

API Modules

Backend/
└── app/
    └── api/
        └── v1/
            ├── __init__.py
            ├── analytics.py
            ├── audit.py
            ├── auth.py
            ├── datasets.py
            ├── health.py
            ├── jobs.py
            └── users.py

🔐 `auth.py` — Authentication

Location:

Backend/app/api/v1/auth.py

Use

Handles user authentication and account security.

Responsibilities

User registration
User login
Access token generation
Refresh token handling
Password recovery
Password reset
Authentication rate limiting

Main Routes

POST /auth/register
POST /auth/login
POST /auth/refresh
POST /auth/forgot-password
POST /auth/reset-password

View auth.py

📁 `datasets.py` — Dataset Management

Location:

Backend/app/api/v1/datasets.py

Use

Handles CSV and Excel dataset uploads and dataset management.

Responsibilities

Upload datasets
Process uploaded files
Store dataset metadata
Create dataset versions
List user datasets
Preview dataset information

Main Routes

POST /datasets/upload
GET  /datasets
GET  /datasets/{dataset_id}

Dataset Flow

CSV / Excel
     │
     ▼
Upload API
     │
     ▼
File Processing
     │
     ▼
Dataset Metadata
     │
     ▼
Dataset Version
     │
     ▼
Database

View datasets.py

📊 `analytics.py` — Analytics

Location:

Backend/app/api/v1/analytics.py

Use

Provides dashboard and dataset-level analytics.

Responsibilities

Dashboard statistics
Dataset statistics
Data quality information
Row and column counts
Storage information
Dataset summaries

Main Routes

GET /analytics/dashboard
GET /analytics/datasets/{dataset_id}

Analytics Flow

Dataset
   │
   ▼
Latest Dataset Version
   │
   ▼
Data Analysis
   │
   ├── Rows
   ├── Columns
   ├── Quality
   ├── Storage
   └── Summary
   │
   ▼
Analytics API
   │
   ▼
React Dashboard

View analytics.py

👤 `users.py` — User Management

Location:

Backend/app/api/v1/users.py

Use

Handles authenticated user profiles and admin-level user management.

Responsibilities

Get current user
Update current user
Validate access tokens
Admin authorization
List users

Main Routes

GET /users/me
PUT /users/me
GET /users

Authorization Flow

Access Token
     │
     ▼
Token Validation
     │
     ▼
Find User
     │
     ▼
Authenticated User
     │
     ├── Normal User
     │
     └── Admin User

View users.py

📝 `audit.py` — Audit Logs

Location:

Backend/app/api/v1/audit.py

Use

Provides audit and activity history for authenticated users.

Responsibilities

Retrieve audit logs
Track user actions
Track entity type
Track entity ID
Pagination support

Main Route

GET /audit/logs

Audit Flow

User Action
     │
     ▼
Audit Service
     │
     ▼
Audit Log
     │
     ▼
GET /audit/logs
     │
     ▼
History / Activity

View audit.py

❤️ `health.py` — Health Monitoring

Location:

Backend/app/api/v1/health.py

Use

Checks backend and database availability.

Main Route

GET /health

Health Flow

Health Request
      │
      ▼
Database Check
      │
      ├── PostgreSQL
      │
      └── SQLite Fallback
      │
      ▼
Health Status

This allows the application to determine whether the backend database connection is available.

View health.py

⚡ `jobs.py` — Background Jobs

Location:

Backend/app/api/v1/jobs.py

Use

Tracks background dataset-processing tasks.

Responsibilities

Track Celery tasks
Get task status
Track progress
Return processing messages
Return task results

Main Route

GET /jobs/{task_id}

Job Flow

Dataset Processing
       │
       ▼
   Celery Task
       │
       ▼
    Task ID
       │
       ▼
GET /jobs/{task_id}
       │
       ▼
┌─────────────────┐
│ Status          │
│ Progress        │
│ Message         │
│ Result          │
└─────────────────┘

View jobs.py

🧩 API Module Overview

🔐

auth.py

Authentication

👤

users.py

User Management

📁

datasets.py

Dataset Management

📊

analytics.py

Analytics

📝

audit.py

Audit Logs

❤️

health.py

Health Monitoring

⚡

jobs.py

Background Jobs

🔗

v1

API Version

🧠 Backend Request Flow

                    React Frontend
                          │
                          ▼
                   FastAPI Router
                          │
                          ▼
                     /api/v1
                          │
        ┌─────────────────┼─────────────────┐
        │                 │                 │
        ▼                 ▼                 ▼
      Auth            Datasets          Analytics
        │                 │                 │
        ▼                 ▼                 ▼
      Users            Services         Analysis
        │                 │                 │
        └─────────────────┼─────────────────┘
                          │
                          ▼
                       Database
                          │
                          ▼
                  PostgreSQL / SQLite

                          │
                          ▼
                     Celery Jobs
                          │
                          ▼
                  Background Tasks

🛠️ Tech Stack

🎨 Frontend

⚙️ Backend

🗄️ Database

⚡ Background Processing

📊 Data Processing

🔧 Development Tools

📁 Project Structure

Cleanytics/
│
├── Frontend/
│   └── LoginNew/
│       ├── src/
│       │   ├── components/
│       │   ├── screens/
│       │   ├── styles/
│       │   ├── App.jsx
│       │   └── main.jsx
│       │
│       ├── package.json
│       └── vite.config.js
│
├── Backend/
│   └── app/
│       ├── api/
│       │   └── v1/
│       │       ├── __init__.py
│       │       ├── analytics.py
│       │       ├── audit.py
│       │       ├── auth.py
│       │       ├── datasets.py
│       │       ├── health.py
│       │       ├── jobs.py
│       │       └── users.py
│       │
│       ├── core/
│       ├── models/
│       ├── schemas/
│       ├── services/
│       └── workers/
│
├── run_project.bat
│
└── README.md

💻 How to Run

🐘 PostgreSQL

Start the local PostgreSQL database included with the project:

docker compose up -d postgres

Create the backend environment file from the safe local template:

Copy-Item Backend\.env.example Backend\.env

After installing the backend dependencies, apply the database migrations:

cd Backend
python -m alembic upgrade head

The local database connection is cleanytics:cleanytics@localhost:5432/cleanytics. Check that PostgreSQL is reachable at http://localhost:8000/api/v1/health after starting the backend.

⚡ Frontend

cd Frontend/LoginNew
npm install
npm run dev

Open:

http://localhost:5173

⚙️ Backend

cd Backend

Create virtual environment:

python -m venv .venv

Activate on Windows:

.venv\Scripts\activate

Install dependencies:

pip install -r requirements.txt

Start the FastAPI server using the project's configured backend entry point.

FastAPI documentation:

http://localhost:8000/docs

Alternative documentation:

http://localhost:8000/redoc

🪟 Windows Quick Start

You can also start the project using:

run_project.bat

Double-click:

run_project.bat

Then open the localhost URL shown in the terminal.

🔗 API Base Structure

/api/v1/

Main API groups:

/api/v1/auth
/api/v1/users
/api/v1/datasets
/api/v1/analytics
/api/v1/audit
/api/v1/jobs
/health

🔐 Security

Cleanytics includes authentication and authorization features such as:

Access tokens
Refresh tokens
Bearer authentication
Authenticated user validation
Admin authorization
Password reset flow
Authentication rate limiting
Dataset upload protection

📊 Data Processing Flow

CSV / Excel File
       │
       ▼
Dataset Upload API
       │
       ▼
Upload Service
       │
       ▼
Dataset Metadata
       │
       ▼
Dataset Version
       │
       ▼
Background Processing
       │
       ▼
Data Cleaning
       │
       ▼
Quality Analysis
       │
       ▼
Analytics API
       │
       ▼
Dashboard

👥 Team Members

Janmejay Kumar Singh

Vansh Bhardwaj

Lucky Chaurasiya

🚀 Roadmap

Phase	Feature	Status
01	Frontend UI	✅
02	Dashboard	✅
03	Dashboard Triggers	✅
04	Authentication API	✅
05	Dataset API	✅
06	Analytics API	✅
07	User API	✅
08	Audit API	✅
09	Health API	✅
10	Background Jobs API	✅
11	Advanced Cleaning Engine	🔄
12	AI Data Cleaning	🔮
13	Advanced Data Quality	🔮
14	Cloud Deployment	🔮

🌟 Future Improvements

🤖 AI

AI-powered automatic data cleaning
Smart anomaly detection
Intelligent data quality suggestions
Automated data transformation
AI-generated dataset insights

📊 Analytics

Advanced charts
Real-time analytics
Data quality reports
Custom dashboards
Advanced statistical analysis

🧹 Data Cleaning

Missing-value suggestions
Duplicate detection
Outlier detection
Data normalization
Automated column type detection

☁️ Infrastructure

Cloud deployment
Scalable database
Production Redis
Distributed Celery workers
Monitoring and logging

📋 Project Information

Property	Details
Project Name	Cleanytics
Version	2.0
Frontend	React 19 + Vite
Backend	FastAPI + Python
Database	PostgreSQL / SQLite
Data Processing	Pandas
Background Processing	Celery
API Version	v1
Project Coordinator & Tester	Janmejay Kumar Singh
Backend & Database Connection	Vansh Bhardwaj
Frontend & Database	Lucky Chaurasiya

🔗 Important Links

📝 Project Status

Cleanytics is actively being developed as a complete data cleaning and analytics platform.

The project currently combines:

React Frontend
      +
FastAPI Backend
      +
Database Layer
      +
Dataset APIs
      +
Analytics APIs
      +
Authentication
      +
Audit Logs
      +
Background Jobs

The next major focus is expanding the data-cleaning engine, improving analytics, and introducing AI-powered data quality and transformation features.

Clean Data. Better Insights.

Made with React • FastAPI • Python • Data

Name		Name	Last commit message	Last commit date
Backend		Backend
Frontend		Frontend
alembic		alembic
app		app
storage/datasets		storage/datasets
tests		tests
.env.example		.env.example
.gitignore		.gitignore
Cleanytics.sql		Cleanytics.sql
Dockerfile		Dockerfile
PROJECT_REPORT.md		PROJECT_REPORT.md
README.md		README.md
alembic.ini		alembic.ini
docker-compose.yml		docker-compose.yml
requirements.txt		requirements.txt
run_project.bat		run_project.bat

Latest commit

History

Folders and files

Repository files navigation

Cleanytics

AI-Powered Data Cleaning & Analytics Platform

📊 Turn Messy Data Into Meaningful Insights

📌 About Cleanytics

🎯 Main Goal

Typical Workflow

✨ Key Features

🔐

Authentication

📁

Dataset Management

📊

Analytics

🧹

Data Cleaning

📝

Audit History

⚡

Background Jobs

❤️

Health Monitoring

👤

User Management

📈

Dashboard

🚀 Version 2 Updates

🏗️ System Architecture

⚙️ Backend API

API Modules

🔐 auth.py — Authentication

Use

Responsibilities

Main Routes

📁 datasets.py — Dataset Management

Use

Responsibilities

Main Routes

Dataset Flow

📊 analytics.py — Analytics

Use

Responsibilities

Main Routes

Analytics Flow

👤 users.py — User Management

Use

Responsibilities

Main Routes

Authorization Flow

📝 audit.py — Audit Logs

Use

Responsibilities

Main Route

Audit Flow

❤️ health.py — Health Monitoring

Use

Main Route

Health Flow

⚡ jobs.py — Background Jobs

Use

Responsibilities

Main Route

Job Flow

🧩 API Module Overview

🔐

👤

📁

📊

📝

❤️

⚡

🔗

🧠 Backend Request Flow

🛠️ Tech Stack

🎨 Frontend

⚙️ Backend

🗄️ Database

🔐 `auth.py` — Authentication

📁 `datasets.py` — Dataset Management

📊 `analytics.py` — Analytics

👤 `users.py` — User Management

📝 `audit.py` — Audit Logs

❤️ `health.py` — Health Monitoring

⚡ `jobs.py` — Background Jobs