Skip to content

swapitsneil/crypto-intelligence-platform

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

25 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿš€ Crypto Intelligence Platform

A Real-Time Cryptocurrency Analytics Platform built using Python, CoinGecko API, SQLite, Power BI, Streamlit, Plotly, and Gemini AI.

The platform collects live cryptocurrency market data, processes it through a modern Data Engineering pipeline, stores it in SQLite, visualizes insights using Power BI and Streamlit, and generates AI-powered market reports using Google Gemini.


๐ŸŒ Live Demo

Streamlit Cloud: https://kkd9lh2h9sstchadvjvbc3.streamlit.app/


๐Ÿ“Œ Project Overview

The Crypto Intelligence Platform is designed to monitor cryptocurrency markets in real time and provide actionable insights through interactive dashboards and AI-generated analysis.

The project follows a complete analytics workflow:

CoinGecko API
      โ†“
 Bronze Layer (Raw JSON)
      โ†“
 Silver Layer (Cleaned Data)
      โ†“
 SQLite Database
      โ†“
 Power BI Dashboard
      โ†“
 Streamlit Dashboard
      โ†“
 Gemini AI Market Analyst

๐ŸŽฏ Business Objectives

  • Monitor live cryptocurrency market activity
  • Identify top gainers and losers
  • Analyze market capitalization distribution
  • Track liquidity and trading volume
  • Evaluate overall market health
  • Generate AI-powered market reports
  • Create executive dashboards for decision-making

๐Ÿ—๏ธ Architecture

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚   CoinGecko API   โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
          โ”‚
          โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚ Bronze Layer      โ”‚
โ”‚ Raw JSON Storage  โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
          โ”‚
          โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚ Silver Layer      โ”‚
โ”‚ Data Cleaning     โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
          โ”‚
          โ–ผ
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚ SQLite Database   โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
          โ”‚
 โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ดโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
 โ–ผ                 โ–ผ
Power BI      Streamlit
Dashboard     Dashboard
                     โ”‚
                     โ–ผ
              Gemini AI
              Market Analyst

๐Ÿ“‚ Project Structure

crypto-intelligence-platform/
โ”‚
โ”œโ”€โ”€ data/
โ”‚   โ”œโ”€โ”€ bronze/
โ”‚   โ””โ”€โ”€ silver/
โ”‚
โ”œโ”€โ”€ database/
โ”‚   โ””โ”€โ”€ crypto.db
โ”‚
โ”œโ”€โ”€ notebook/
โ”‚   โ””โ”€โ”€ crypto_analysis.ipynb
โ”‚
โ”œโ”€โ”€ powerbi/
โ”‚   โ””โ”€โ”€ crypto_dashboard.pbix
โ”‚
โ”œโ”€โ”€ screenshots/
โ”‚
โ”œโ”€โ”€ scripts/
โ”‚   โ”œโ”€โ”€ extract.py
โ”‚   โ”œโ”€โ”€ transform.py
โ”‚   โ””โ”€โ”€ ai_analyst.py
โ”‚
โ”œโ”€โ”€ app.py
โ”œโ”€โ”€ requirements.txt
โ”œโ”€โ”€ .gitignore
โ””โ”€โ”€ README.md

โš™๏ธ Tech Stack

Programming

  • Python

Data Engineering

  • Requests
  • JSON
  • SQLite
  • Pandas

Visualization

  • Power BI
  • Streamlit
  • Plotly

AI

  • Google Gemini
  • Google AI Studio

Version Control

  • Git
  • GitHub

๐Ÿ“Š Power BI Dashboard

The Power BI solution consists of three dashboard pages.

Dashboard 1 โ€” Market Overview

Power BI Dashboard 1

Features:

  • Total Coins
  • Total Market Cap
  • Total Volume
  • Average 24H Change
  • Top 10 Gainers
  • Top 10 Losers

Dashboard 2 โ€” Market Intelligence

Power BI Dashboard 2

Features:

  • BTC Dominance
  • Positive Coins
  • Negative Coins
  • Market Health
  • Top Volume Leaders
  • Market Cap Distribution
  • Treemap Analysis

Dashboard 3 โ€” Advanced Analytics

Power BI Dashboard 3

Features:

  • Market Cap vs Price
  • Volume vs Market Cap
  • Liquidity Analysis
  • Price Change Distribution

๐ŸŒ Streamlit Dashboard

Interactive web application providing:

Overview

Overview Dashboard

  • KPI Monitoring
  • Top Gainers
  • Top Losers
  • Liquidity Leaders

Market Intelligence

Market Intelligence Dashboard

  • Volume Analysis
  • Market Cap Analysis
  • Treemap Visualization

AI Market Analyst

AI Market Analyst Dashboard

Powered by Google Gemini.

Generates:

  • Market Sentiment
  • Key Observations
  • Risk Assessment
  • Trading Opportunities

๐Ÿค– AI Market Analyst

The platform integrates Google Gemini to automatically generate market reports from live cryptocurrency data.

Example:

Market Sentiment: Bearish

Key Observation:
More coins are declining than advancing.

Risk Assessment:
Current market conditions suggest cautious positioning.

Opportunity:
Strong momentum coins may provide short-term trading opportunities.

Actual AI Report

Here's an analysis of the live crypto market data:

1. Market Sentiment

- Bearish: The market health indicator is explicitly red, with a majority of coins (51 out of 100) experiencing negative movement.
- Cautious Optimism (Selective): Despite the overall bearish tone, a positive average 24H change (0.57%) suggests some significant individual gains are occurring, preventing a deeper market-wide decline.

2. Key Observations

- Divergence: A significant disparity exists, with strong performers like DeXe defying the broader market weakness, while others like Jupiter face substantial pressure.
- Concentrated Movement: The positive average change amidst more negative coins indicates that large-cap or specific narratives are holding up well, pulling the average higher.
- Moderate Liquidity: Total volume of $113.71 Billion USD suggests active trading but not extreme panic or euphoric buying.

3. Risk Assessment

- Elevated Downside Risk: The prevailing bearish sentiment and the majority of losing coins point to potential for further price depreciation.
- Increased Volatility: The presence of both a top gainer and a top loser highlights significant asset-specific volatility.
- Capital Preservation: A cautious approach is warranted; focus on protecting capital and avoiding broad market exposure.

4. Trading Opportunities

- Selective Longs: Focus on assets showing clear strength and positive divergence from the overall market (e.g., DeXe), after thorough fundamental and technical analysis.
- Shorting Opportunities: Consider shorting fundamentally weak or technically breaking assets, particularly those showing significant downward momentum (e.g., Jupiter).
- Rotation Plays: Look for sectors or narratives that are showing early signs of resilience or strength, potentially attracting capital from underperforming areas.


๐Ÿ—„๏ธ Database Schema

Table:

crypto_market

Columns:

Column Description
id Coin ID
symbol Coin Symbol
name Coin Name
current_price Current Price
market_cap Market Capitalization
market_cap_rank Market Rank
total_volume Trading Volume
price_change_percentage_24h 24 Hour Change
circulating_supply Circulating Supply
last_updated API Update Time
fetch_time ETL Load Time

๐Ÿ”„ ETL Pipeline

Extract

Collects live data from CoinGecko API.

Output:

data/bronze/*.json

Transform

Performs:

  • Column Selection
  • Missing Value Handling
  • Datetime Conversion
  • Data Validation

Output:

data/silver/*.csv

Load

Loads cleaned data into SQLite.

Destination:

database/crypto.db

๐Ÿš€ Installation

Clone Repository

git clone https://github.com/swapitsneil/crypto-intelligence-platform.git

cd crypto-intelligence-platform

Create Virtual Environment

Windows

python -m venv .venv

Activate:

.venv\Scripts\activate

Linux / Mac

python3 -m venv .venv

source .venv/bin/activate

Install Dependencies

pip install -r requirements.txt

Configure Environment Variables

Create:

.env

Add:

GEMINI_API_KEY=YOUR_API_KEY

Get API Key:

https://aistudio.google.com


Run Streamlit App

streamlit run app.py

โ˜๏ธ Streamlit Community Cloud Deployment

This project is fully compatible with:

  • Python 3.11 โœ…
  • Python 3.12 โœ…

Recommended:

Python 3.11

Why?

  • Most stable for Streamlit deployments
  • Better package compatibility
  • Fewer dependency issues

๐Ÿ“ˆ Key Insights & Recommendations

1. Bitcoin Market Dominance

Bitcoin consistently accounts for the largest share of total cryptocurrency market capitalization, making it the primary driver of overall market sentiment.

Recommendation: Monitor Bitcoin price movements and dominance levels closely, as significant changes often influence the performance of altcoins and the broader crypto market.


2. Trading Volume Concentration

A small number of large-cap cryptocurrencies contribute a significant portion of total market trading volume.

Recommendation: High-volume assets provide better liquidity and lower transaction risk, making them more suitable for active trading and short-term strategies.


3. Market Breadth as a Sentiment Indicator

The ratio of positive to negative coins provides an effective measure of overall market health and investor sentiment.

Recommendation: Use market breadth alongside price movements to identify potential trend reversals and confirm bullish or bearish market conditions.


4. Liquidity Opportunities

Several cryptocurrencies exhibit exceptionally high volume-to-market-cap ratios, indicating strong market participation relative to their size.

Recommendation: Assets with strong liquidity often offer better execution quality and may present attractive opportunities for momentum-based trading strategies.


5. Market Concentration Risk

The cryptocurrency market remains highly concentrated among a small group of leading assets.

Recommendation: Investors and analysts should track concentration metrics regularly to evaluate diversification opportunities and assess systemic market risk.


6. Volatility Monitoring

Top gainers and losers frequently demonstrate large daily price swings, highlighting the highly volatile nature of cryptocurrency markets.

Recommendation: Implement risk management practices such as position sizing, stop-loss strategies, and volatility monitoring when evaluating short-term trading opportunities.


๐Ÿ”ฎ Future Enhancements

  • Historical Price Tracking
  • Automated ETL Scheduling
  • Cryptocurrency Forecasting
  • Portfolio Optimization
  • Real-Time Alerts
  • RAG-based Crypto Research Assistant
  • Multi-Agent Crypto Intelligence System

๐Ÿ‘จโ€๐Ÿ’ป Author

Swapnil Nicolson Dadel

Aspiring Data Analyst

Skills:

  • Python
  • SQL
  • Power BI
  • Streamlit
  • MS Excel
  • Cloud
  • Data Engineering
  • Machine Learning
  • Generative AI

GitHub: https://github.com/swapitsneil

LinkedIn: https://www.linkedin.com/in/swapnil-nicolson-dadel/


โญ If you found this project useful

Please consider starring the repository.

  • โญ Star the repo
  • ๐Ÿด Fork the project
  • ๐Ÿ“ข Share your feedback

About

End-to-end crypto analytics platform featuring live market data ingestion, ETL pipelines, SQLite storage, Power BI dashboards, Streamlit visualization, and Gemini-powered AI market analysis.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors