Skip to content

About

A simple python retro game scraper though to be used on Ambernic RGXX based systems.

Resources

Stars

5 stars

Watchers

0 watching

Forks

 
 

Repository files navigation

Tiny Scraper

中文

A fork of Julioevm/tiny-scraper with enhanced features.


What's New

  • Dual Screen Support: Added lower screen display for recently scraped game previews, optimized for RGDS and other dual-screen capable devices
  • Scrape History Display: The lower screen now shows recently scraped game previews, making it easy to review results at a glance
  • Multi-Language Support: Now supports 10 languages including English, Simplified/Traditional Chinese, Japanese, Korean, Spanish, Russian, German, French, and Portuguese (Brazil). Automatically detects device system language
  • UI Redesign: Completely refactored user interface with a modern look, supporting multiple screen resolutions for different Anbernic devices (RG28xx, RG34xx, RGcubeXX)
  • RGDS Linux Support: Now supports RGDS series devices running official Linux firmware
  • Libretro Data Source: Added Libretro Thumbnails as a data source
  • Multi-Source Automatic Fallback: Supports configuring multiple data sources, prioritizes Libretro, automatically falls back to Screenscraper on failure
  • Multi-Threaded Scraping: Libretro data source supports multi-threaded parallel scraping (up to 3 threads), significantly improving scraping speed
  • Smart Game Name Matching: Intelligent mapping from Chinese game names to English names via merged_games.json
  • Detailed Scraping Logs: Prints detailed logs during each scrape, including data source, time spent, success/failure status
  • Startup Log Clear: Automatically clears log file on program startup, avoiding accumulation of old logs
  • Network Retry Mechanism: Automatically retries on temporary network errors (DNS failure, timeout, etc.), up to 3 attempts

Screenshot


Platform

Platform

Features

  • Easy Downloads: Download cover media directly onto your device.
  • User-Friendly Interface: Simple and intuitive interface designed for handheld gaming devices.
  • Wide Compatibility: Supports various ROM file types and multiple device models.

Supported Devices

Anbernic:

  • Tested: RG35XX H
  • Theoretically supported: RG40XXV, RGcubeXX, RG28xx, RG34xx
  • Possibly compatible: Any Anbernic handheld with Python >= 3.7

RGDS (Linux):

  • Supports official Linux firmware
  • Tested on various RGDS handheld devices

Installation

  1. Download Latest Release:

    • Navigate to the Releases page and download the latest version.
  2. Transfer to Device:

    • Extract and copy the content of the downloaded zip to the APPS directory of your device.
    • Anbernic SD2: /mnt/sdcard/Roms/APPS
    • Anbernic SD1: /mnt/mmc/Roms/APPS
    • RGDS: /roms/apps/
  3. Setup config.json: Create a config.json file inside the tiny_scraper folder:

{
    "user": "your_user",
    "password": "your_password",
    "media_type": "sstitle",
    "region": "wor",
    "resize": false,
    "preferred_sources": ["libretro", "screenscraper"]
}

Configuration Details:

Parameter Description
user / password Your account registered at screenscraper.fr
media_type Media type: ss (screenshot), sstitle (title screen), box-2D/box-3D (box art), mixrbv1/mixrbv2 (mixed)
region Region priority: wor, jp, eu, asi, kr, ss, us
resize true/false - Resize to 320x240
preferred_sources Data source priority: libretro (local cache), screenscraper (online)
  1. Start Tiny Scraper:
    • Anbernic: From the main menu, go to App Center, select Apps and launch Tiny Scraper.
    • RGDS: Launch from the Apps section in the game menu.

Data Source Description

This program supports two data sources:

Libretro Thumbnails

  • Advantages: Fast (multi-threaded), no network required, stable quality
  • Disadvantages: Requires downloading thumbnail library in advance, some games may be missing

Screenscraper

  • Advantages: Rich resources, covering almost all games
  • Disadvantages: Slower (single-threaded), requires account, requires network

Troubleshooting

Old version of stock OS might cause issues. V 1.0.3 (20240511) is reported to miss some necessary libraries: No module named 'PIL'. Try to update in this case.

Any issue should be logged in the tiny_scraper/log.txt file.


Original Project

Julioevm/tiny-scraper

About

A simple python retro game scraper though to be used on Ambernic RGXX based systems.

Resources

Stars

5 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages