Compare commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
38a3859a21 | ||
|
|
96e876b8ec | ||
|
|
733e3c9089 | ||
|
|
dc7d6c9720 | ||
|
|
5c5bb6e5d6 | ||
|
|
35db22e3c5 | ||
|
|
b0cdac5483 | ||
|
|
f367bbe298 | ||
|
|
c61d8e9d3f | ||
|
|
78f6d44c73 | ||
|
|
a7f90cd5a7 | ||
|
|
c9575817fe | ||
|
|
b576ff5747 | ||
|
|
6510229b07 | ||
|
|
e61d91418e | ||
|
|
a1c461f6aa | ||
|
|
985c8df2cc |
@@ -22,15 +22,19 @@ jobs:
|
||||
pip install -r requirements-build.txt
|
||||
|
||||
- name: Build
|
||||
run: pyinstaller --clean --noconfirm psp-preserve.spec
|
||||
run: pyinstaller --clean --noconfirm psppt.spec
|
||||
|
||||
- name: Package tarball
|
||||
run: tar -czf psp-preserve-linux-x86_64.tar.gz -C dist psp-preserve
|
||||
run: |
|
||||
cp packaging/install.sh dist/psppt/
|
||||
cp packaging/psppt.desktop dist/psppt/
|
||||
cp img/app-icon.png dist/psppt/
|
||||
tar -czf psppt-linux-x86_64.tar.gz -C dist psppt
|
||||
|
||||
- uses: actions/upload-artifact@v3
|
||||
with:
|
||||
name: psp-preserve-linux-x86_64
|
||||
path: psp-preserve-linux-x86_64.tar.gz
|
||||
name: psppt-linux-x86_64
|
||||
path: psppt-linux-x86_64.tar.gz
|
||||
|
||||
windows:
|
||||
name: Windows x64 (Wine)
|
||||
@@ -44,13 +48,13 @@ jobs:
|
||||
winpython -m pip install -r requirements-build.txt
|
||||
|
||||
- name: Build
|
||||
run: winpython -m PyInstaller --clean --noconfirm psp-preserve.spec
|
||||
run: winpython -m PyInstaller --clean --noconfirm psppt.spec
|
||||
|
||||
- name: Package zip
|
||||
run: |
|
||||
cd dist && zip -rq ../psp-preserve-windows-x64.zip psp-preserve
|
||||
cd dist && zip -rq ../psppt-windows-x64.zip psppt
|
||||
|
||||
- uses: actions/upload-artifact@v3
|
||||
with:
|
||||
name: psp-preserve-windows-x64
|
||||
path: psp-preserve-windows-x64.zip
|
||||
name: psppt-windows-x64
|
||||
path: psppt-windows-x64.zip
|
||||
|
||||
+5
-1
@@ -23,4 +23,8 @@ data/nps/*.tsv
|
||||
|
||||
# PyInstaller output
|
||||
build/
|
||||
dist/
|
||||
dist/
|
||||
|
||||
# Offline cover bundles (large; fetched from the project release on first run)
|
||||
data/covers/*.zip
|
||||
/psppt-covers.zip
|
||||
@@ -3,5 +3,5 @@
|
||||
# Port-forward 80 and 443 on your router to this host.
|
||||
|
||||
hostname.com {
|
||||
reverse_proxy psp-preserve:8000
|
||||
reverse_proxy psppt:8000
|
||||
}
|
||||
|
||||
@@ -1,6 +1,10 @@
|
||||
# PSP Preservation Tool
|
||||
# psppt
|
||||
|
||||
|
||||
the name is terrible, i know.
|
||||
|
||||

|
||||
|
||||

|
||||
|
||||
A cross-platform (Linux + Windows) desktop GUI — PySide6 — for preserving PSP
|
||||
@@ -11,7 +15,7 @@ save-data with a real PSP, can pull missing discs from a Redump 7z archive
|
||||
collection, downloads PSN content from NoPayStation, and converts PlayStation 1
|
||||
ISO/CUE/BIN rips into PSP `EBOOT.PBP` homebrew.
|
||||
|
||||

|
||||

|
||||
* Dark theme with a blue accent — the Library tab in cover view. *
|
||||
|
||||
## Features
|
||||
@@ -69,14 +73,16 @@ see the note inside).
|
||||
python3 -m venv .venv-build
|
||||
. .venv-build/bin/activate
|
||||
pip install -r requirements-build.txt
|
||||
pyinstaller --clean --noconfirm psp-preserve.spec
|
||||
# output: dist/psp-preserve/ → run dist/psp-preserve/psp-preserve
|
||||
pyinstaller --clean --noconfirm psppt.spec
|
||||
# output: dist/psppt/ → run dist/psppt/psppt
|
||||
```
|
||||
|
||||
Notes:
|
||||
|
||||
- The build bundles the DATs, PS1 loader, and the offline cover bundles. The
|
||||
cover zips are large (~850 MB), so builds are slow and the output is big.
|
||||
- The build bundles the DATs, PS1 loader, cover templates, and index catalogs
|
||||
(~80 MB total). The large offline cover zips (~850 MB) are **not** bundled —
|
||||
the app fetches them on first run (see
|
||||
[Offline bundles](#offline-bundles--auto-download)).
|
||||
- `7z` (p7zip-full on Linux, 7-Zip on Windows) is a **runtime** dependency for
|
||||
reading store archives — it is not bundled.
|
||||
- User data (credentials, manual covers, PS1 templates, NPS cache, library DB,
|
||||
@@ -166,9 +172,10 @@ Discs are matched by hash first (most precise), then serial, then filename.
|
||||
- `data/credentials.json` — cover/metadata API keys (IGDB, TheMovieDB,
|
||||
ScreenScraper, Google Custom Search). Environment variables take precedence.
|
||||
- `data/manual_covers/games|videos/` — your own cover images.
|
||||
- `data/covers/` — checked-in assets: the UMD video/game cover templates,
|
||||
`libretro-index.json` + `openvgdb-index.json` catalogs, `libretro-covers.zip` +
|
||||
`openvgdb-covers.zip` offline cover bundles, and the legacy cover cache.
|
||||
- `data/covers/` — checked-in assets: the UMD video/game cover templates and
|
||||
the `libretro-index.json` + `openvgdb-index.json` catalogs. The large
|
||||
`libretro-covers.zip` + `openvgdb-covers.zip` bundles are git-ignored and
|
||||
distributed as `psppt-covers.zip` (see above).
|
||||
- `data/base.PBP` — a PSN PS1 classic EBOOT (any game) supplying `STARTDAT`
|
||||
+ a base `PARAM.SFO`/icon for PS1 conversion (git-ignored, copyrighted).
|
||||
- `data/loader/DATA.PSP` + `data/loader/KEYS.BIN` — bundled plain-ELF POPS
|
||||
@@ -178,7 +185,7 @@ Discs are matched by hash first (most precise), then serial, then filename.
|
||||
to drawn art when they're absent.
|
||||
- `data/nps/` — NoPayStation TSV lists (cached here on first store scan in dev;
|
||||
a packaged build stores them under the state dir instead).
|
||||
- State dir (`~/.local/state/psp-preserve/` on Linux, `%LOCALAPPDATA%\PSPPreserve`
|
||||
- State dir (`~/.local/state/psppt/` on Linux, `%LOCALAPPDATA%\psppt`
|
||||
on Windows, or `$PSP_STATE_DIR`):
|
||||
- `library.sqlite` — the catalog + library database.
|
||||
- `covers/` — downloaded cover cache.
|
||||
@@ -192,13 +199,13 @@ bundled with the app; user-writable data lives in the state dir.
|
||||
## Configuration
|
||||
|
||||
Everything is driven by environment variables, with GUI settings (stored in
|
||||
QSettings under `PSPPreserve`) taking precedence where noted.
|
||||
QSettings under `psppt`) taking precedence where noted.
|
||||
|
||||
| Variable | Default | Purpose |
|
||||
|---|---|---|
|
||||
| `PSP_DATA_DIR` | `./data` | data root (DATs, credentials, manual covers) |
|
||||
| `PSP_DATS_DIR` | `$PSP_DATA_DIR/dats` | DAT folder |
|
||||
| `PSP_STATE_DIR` | `~/.local/state/psp-preserve` | local state root |
|
||||
| `PSP_STATE_DIR` | `~/.local/state/psppt` | local state root |
|
||||
| `PSP_DB_PATH` | `$PSP_STATE_DIR/library.sqlite` | SQLite library |
|
||||
| `PSP_COVERS_DIR` | `$PSP_STATE_DIR/covers` | cover cache |
|
||||
| `PSP_GAMES_ROOTS` | `/data/umd_games` | comma-separated game disc roots |
|
||||
@@ -219,6 +226,7 @@ QSettings under `PSPPreserve`) taking precedence where noted.
|
||||
| `PSP_CREDENTIALS` | `$PSP_USER_DATA_DIR/credentials.json` | credentials file |
|
||||
| `PSP_LIBRETRO_COVERS_URL` | *(empty)* | direct URL for `libretro-covers.zip` (else derived from store server) |
|
||||
| `PSP_OVGDB_COVERS_URL` | *(empty)* | direct URL for `openvgdb-covers.zip` (else derived from store server) |
|
||||
| `PSP_COVERS_BUNDLE_URL` | Gitea `covers` release asset | combined `psppt-covers.zip` download URL |
|
||||
|
||||
Cover/metadata keys can also be set as env vars: `IGDB_CLIENT_ID`,
|
||||
`IGDB_CLIENT_SECRET`, `TMDB_API_KEY`, `GOOGLE_API_KEY`, `GOOGLE_CX`,
|
||||
@@ -251,12 +259,23 @@ Manual covers in `data/manual_covers/videos/` always win.
|
||||
|
||||
### Offline bundles & auto-download
|
||||
|
||||
The two bundles (`libretro-covers.zip`, `openvgdb-covers.zip`) are shipped in
|
||||
`data/covers/`, so a fresh install works with **no internet and no API keys**.
|
||||
If either is missing at startup, the app downloads it from the store server's
|
||||
`/api/covers/<name>.zip` endpoint (see [Server setup](#server-setup)).
|
||||
The two bundles (`libretro-covers.zip`, `openvgdb-covers.zip`) are packaged
|
||||
into one `psppt-covers.zip` (~850 MB) and attached to the repo's `covers`
|
||||
release — **not** bundled into the app binary.
|
||||
|
||||
Rebuild them yourself:
|
||||
On first launch, if the bundle isn't installed, the app asks whether to
|
||||
download it (with a progress bar). Covers keep working online via libretro /
|
||||
OpenVGDB / ScreenScraper / IGDB without it — the bundle just makes them instant
|
||||
and offline. "Don't ask again" is remembered, and you can re-download from
|
||||
**Settings → Cover sources → Download offline cover bundle…**.
|
||||
|
||||
Build the bundle yourself:
|
||||
|
||||
```bash
|
||||
python3 scripts/make-covers-bundle.py # -> psppt-covers.zip
|
||||
```
|
||||
|
||||
Rebuild the inner zips:
|
||||
|
||||
```bash
|
||||
python3 -m app.libretro # libretro-thumbnails -> libretro-covers.zip
|
||||
@@ -423,7 +442,7 @@ Token protection: set `PSP_API_TOKEN`; the client sends
|
||||
macvlan bridge so it gets its own LAN IP (e.g. `192.168.1.100`, plain HTTP on 8000):
|
||||
|
||||
```bash
|
||||
# in /path/to/psp-preserve/
|
||||
# in /path/to/psppt/
|
||||
cp .env.example .env # then edit: LAN IP, share paths, API token
|
||||
docker compose up -d --build
|
||||
```
|
||||
|
||||
+1
-1
@@ -1 +1 @@
|
||||
"""PSP Preservation Tool application package."""
|
||||
"""psppt application package."""
|
||||
|
||||
+2
-2
@@ -251,7 +251,7 @@ def _library(conn, system=None, refresh=False):
|
||||
|
||||
|
||||
class Handler(BaseHTTPRequestHandler):
|
||||
server_version = "PSPPreserve/0.1"
|
||||
server_version = "psppt/0.1"
|
||||
|
||||
def do_GET(self):
|
||||
parsed = urlparse(self.path)
|
||||
@@ -262,7 +262,7 @@ class Handler(BaseHTTPRequestHandler):
|
||||
try:
|
||||
if path == "/":
|
||||
_json(self, {
|
||||
"name": "PSP Preservation Tool API",
|
||||
"name": "psppt API",
|
||||
"endpoints": [
|
||||
"/api/summary",
|
||||
"/api/releases?system=games|videos&q=&limit=&offset=",
|
||||
|
||||
+22
-2
@@ -11,6 +11,19 @@ _BUNDLE_DIR = getattr(sys, "_MEIPASS", None)
|
||||
|
||||
PROJECT_ROOT = Path(_BUNDLE_DIR).resolve() if _BUNDLE_DIR else Path(__file__).resolve().parent.parent
|
||||
|
||||
# Frozen bundles don't ship the system CA store, so Python's urllib would fail
|
||||
# TLS verification against the store server / NoPayStation / TMDB / archive.org.
|
||||
# Point OpenSSL at the certifi bundle (a curl_cffi dependency) when frozen only;
|
||||
# source runs keep using the OS CA store.
|
||||
if IS_FROZEN:
|
||||
try:
|
||||
import certifi
|
||||
_CA_BUNDLE = certifi.where()
|
||||
os.environ.setdefault("SSL_CERT_FILE", _CA_BUNDLE)
|
||||
os.environ.setdefault("REQUESTS_CA_BUNDLE", _CA_BUNDLE)
|
||||
except Exception: # noqa: BLE001
|
||||
pass
|
||||
|
||||
|
||||
def resource_path(*parts):
|
||||
"""Absolute path to a read-only bundled resource (works when frozen)."""
|
||||
@@ -29,10 +42,10 @@ def _default_state_dir():
|
||||
"""
|
||||
if os.name == "nt":
|
||||
base = os.environ.get("LOCALAPPDATA") or os.environ.get("APPDATA") or str(Path.home())
|
||||
return Path(base) / "PSPPreserve"
|
||||
return Path(base) / "psppt"
|
||||
xdg = os.environ.get("XDG_STATE_HOME")
|
||||
base = Path(xdg) if xdg else Path.home() / ".local" / "state"
|
||||
return base / "psp-preserve"
|
||||
return base / "psppt"
|
||||
|
||||
|
||||
STATE_DIR = Path(os.environ.get("PSP_STATE_DIR", str(_default_state_dir())))
|
||||
@@ -63,6 +76,13 @@ STORE_TOKEN = os.environ.get("PSP_STORE_TOKEN", "")
|
||||
LIBRETRO_COVERS_URL = os.environ.get("PSP_LIBRETRO_COVERS_URL", "")
|
||||
OVGDB_COVERS_URL = os.environ.get("PSP_OVGDB_COVERS_URL", "")
|
||||
|
||||
# Combined offline cover bundle (both inner zips) fetched on first run when the
|
||||
# user opts in. Defaults to the project's Gitea release asset.
|
||||
COVERS_BUNDLE_URL = os.environ.get(
|
||||
"PSP_COVERS_BUNDLE_URL",
|
||||
"https://git.ceaf.dev/quoije/psp-preservation-tool/releases/download/covers/psppt-covers.zip",
|
||||
)
|
||||
|
||||
# archive.org item hosting the same Redump 7z set (identifier or full URL).
|
||||
ARCHIVE_ITEM = os.environ.get("PSP_ARCHIVE_ITEM", "psp-redump-roms321.com")
|
||||
|
||||
|
||||
+75
-35
@@ -53,8 +53,20 @@ _TMDB_SEARCH = "https://api.themoviedb.org/3/search/movie"
|
||||
_TMDB_IMAGE = "https://image.tmdb.org/t/p/"
|
||||
_GOOGLE_CSE_API = "https://www.googleapis.com/customsearch/v1"
|
||||
_MANUAL_DIR = config.USER_DATA_DIR / "manual_covers"
|
||||
_OVGDB_ZIP = config.DATA_DIR / "covers" / "openvgdb-covers.zip"
|
||||
_LIBRETRO_ZIP = config.DATA_DIR / "covers" / "libretro-covers.zip"
|
||||
# Offline cover bundles live in the writable cover dir (downloaded on demand),
|
||||
# not the read-only app bundle. A source checkout keeps them in data/covers/.
|
||||
_OVGDB_ZIP = config.COVERS_DIR / "openvgdb-covers.zip"
|
||||
_LIBRETRO_ZIP = config.COVERS_DIR / "libretro-covers.zip"
|
||||
_BUNDLE_ZIP = config.COVERS_DIR / "psppt-covers.zip"
|
||||
|
||||
|
||||
def _bundle_zip_path(name):
|
||||
"""Resolve a cover bundle zip: writable dir first, legacy checkout second."""
|
||||
for base in (config.COVERS_DIR, config.LEGACY_COVERS_DIR):
|
||||
p = base / name
|
||||
if p.exists():
|
||||
return p
|
||||
return config.COVERS_DIR / name
|
||||
|
||||
_WIKI_SEARCH = "https://en.wikipedia.org/w/api.php"
|
||||
_WIKI_SUMMARY = "https://en.wikipedia.org/api/rest_v1/page/summary/"
|
||||
@@ -62,7 +74,7 @@ _WIKI_SUMMARY = "https://en.wikipedia.org/api/rest_v1/page/summary/"
|
||||
_PNG_MAGIC = b"\x89PNG\r\n\x1a\n"
|
||||
_JPEG_MAGIC = b"\xff\xd8\xff"
|
||||
_MAX_HOPS = 3 # follow libretro symlink text bodies at most this many times
|
||||
_UA = {"User-Agent": "psp-preserve/0.1 (https://github.com; local tool)"}
|
||||
_UA = {"User-Agent": "psppt/0.1 (https://github.com; local tool)"}
|
||||
_igdb_token_state = {"token": "", "expires": 0.0} # IGDB OAuth2 token cache
|
||||
_igdb_lock = threading.Lock()
|
||||
_igdb_last = 0.0 # monotonic clock of the last IGDB API call
|
||||
@@ -158,48 +170,74 @@ def clear_cover_cache():
|
||||
pass
|
||||
|
||||
|
||||
def _download_file(url, dest, timeout=600):
|
||||
"""Stream `url` to `dest` (atomic); returns True on success."""
|
||||
def _download_file(url, dest, timeout=600, progress_cb=None, cancel_event=None):
|
||||
"""Stream `url` to `dest` (atomic); returns True on success.
|
||||
|
||||
``progress_cb(done, total)`` is called with bytes so far (total is 0 when
|
||||
the server doesn't report a content length). ``cancel_event`` aborts the
|
||||
download when set.
|
||||
"""
|
||||
req = urllib.request.Request(url, headers=_UA)
|
||||
with urllib.request.urlopen(req, timeout=timeout) as resp:
|
||||
if resp.status != 200:
|
||||
return False
|
||||
total = int(resp.headers.get("Content-Length") or 0)
|
||||
tmp = dest.with_name(dest.name + ".tmp")
|
||||
done = 0
|
||||
with open(tmp, "wb") as f:
|
||||
while True:
|
||||
if cancel_event is not None and cancel_event.is_set():
|
||||
raise InterruptedError("download cancelled")
|
||||
chunk = resp.read(1 << 20)
|
||||
if not chunk:
|
||||
break
|
||||
f.write(chunk)
|
||||
done += len(chunk)
|
||||
if progress_cb is not None:
|
||||
progress_cb(done, total)
|
||||
os.replace(tmp, dest)
|
||||
return True
|
||||
|
||||
|
||||
def ensure_cover_bundles(server_url=""):
|
||||
"""Download missing offline cover bundle zips from the store server.
|
||||
def covers_bundle_present():
|
||||
"""True when the offline cover bundle is installed (both inner zips)."""
|
||||
return (_bundle_zip_path("libretro-covers.zip").exists()
|
||||
and _bundle_zip_path("openvgdb-covers.zip").exists())
|
||||
|
||||
``server_url`` is the base URL (e.g. ``http://192.168.10.100:8000``); the
|
||||
zips are fetched from ``<base>/api/covers/<name>.zip`` unless a direct URL
|
||||
is set in config. Returns the names of bundles downloaded.
|
||||
|
||||
def download_covers_bundle(url=None, progress_cb=None, cancel_event=None):
|
||||
"""Download and extract the combined cover bundle into the cover dir.
|
||||
|
||||
``url`` defaults to ``config.COVERS_BUNDLE_URL``. Raises on failure; the
|
||||
caller decides whether to surface the error.
|
||||
"""
|
||||
base = (server_url or config.STORE_SERVER_URL or "").rstrip("/")
|
||||
downloaded = []
|
||||
for name, path, direct in (
|
||||
("libretro-covers.zip", _LIBRETRO_ZIP, config.LIBRETRO_COVERS_URL),
|
||||
("openvgdb-covers.zip", _OVGDB_ZIP, config.OVGDB_COVERS_URL),
|
||||
):
|
||||
if path.exists():
|
||||
continue
|
||||
url = direct or (f"{base}/api/covers/{name}" if base else "")
|
||||
if not url:
|
||||
continue
|
||||
try:
|
||||
if _download_file(url, path):
|
||||
downloaded.append(name)
|
||||
log.info("downloaded offline cover bundle %s", name)
|
||||
except Exception as exc: # noqa: BLE001
|
||||
log.warning("could not download cover bundle %s: %s", name, exc)
|
||||
return downloaded
|
||||
url = (url or config.COVERS_BUNDLE_URL or "").strip()
|
||||
if not url:
|
||||
raise ValueError("no cover bundle URL configured")
|
||||
config.COVERS_DIR.mkdir(parents=True, exist_ok=True)
|
||||
_download_file(url, _BUNDLE_ZIP, timeout=3600,
|
||||
progress_cb=progress_cb, cancel_event=cancel_event)
|
||||
inner = ("libretro-covers.zip", "openvgdb-covers.zip")
|
||||
with zipfile.ZipFile(_BUNDLE_ZIP) as z:
|
||||
missing = [n for n in inner if n not in z.namelist()]
|
||||
if missing:
|
||||
raise ValueError(f"cover bundle is missing: {', '.join(missing)}")
|
||||
with zipfile.ZipFile(_BUNDLE_ZIP) as z:
|
||||
for name in inner:
|
||||
out = config.COVERS_DIR / name
|
||||
tmp = out.with_name(out.name + ".tmp")
|
||||
with z.open(name) as src, open(tmp, "wb") as dst:
|
||||
while True:
|
||||
chunk = src.read(1 << 20)
|
||||
if not chunk:
|
||||
break
|
||||
dst.write(chunk)
|
||||
os.replace(tmp, out)
|
||||
# Invalidate cached namelists so lookups pick up the freshly extracted zips.
|
||||
global _libretro_names, _ovgdb_names
|
||||
_libretro_names = None
|
||||
_ovgdb_names = None
|
||||
return config.COVERS_DIR
|
||||
|
||||
|
||||
def cover_url(name, kind="Named_Boxarts", system="games"):
|
||||
@@ -482,9 +520,10 @@ def _ovgdb_name_list():
|
||||
global _ovgdb_names
|
||||
if _ovgdb_names is None:
|
||||
_ovgdb_names = set()
|
||||
if _OVGDB_ZIP.exists():
|
||||
path = _bundle_zip_path("openvgdb-covers.zip")
|
||||
if path.exists():
|
||||
try:
|
||||
with zipfile.ZipFile(_OVGDB_ZIP) as z:
|
||||
with zipfile.ZipFile(path) as z:
|
||||
_ovgdb_names = {n[:-4] for n in z.namelist() if n.endswith(".jpg")}
|
||||
except Exception: # noqa: BLE001
|
||||
pass
|
||||
@@ -535,7 +574,7 @@ def fetch_openvgdb_local(name):
|
||||
if entry is None:
|
||||
return None
|
||||
try:
|
||||
with zipfile.ZipFile(_OVGDB_ZIP) as z:
|
||||
with zipfile.ZipFile(_bundle_zip_path("openvgdb-covers.zip")) as z:
|
||||
data = z.read(entry)
|
||||
return data if _is_image(data) else None
|
||||
except Exception: # noqa: BLE001
|
||||
@@ -559,7 +598,7 @@ def fetch_libretro_local(name):
|
||||
if entry is None:
|
||||
return None
|
||||
try:
|
||||
with zipfile.ZipFile(_LIBRETRO_ZIP) as z:
|
||||
with zipfile.ZipFile(_bundle_zip_path("libretro-covers.zip")) as z:
|
||||
data = z.read(entry)
|
||||
return data if _is_image(data) else None
|
||||
except Exception: # noqa: BLE001
|
||||
@@ -570,9 +609,10 @@ def _libretro_name_list():
|
||||
global _libretro_names
|
||||
if _libretro_names is None:
|
||||
_libretro_names = set()
|
||||
if _LIBRETRO_ZIP.exists():
|
||||
path = _bundle_zip_path("libretro-covers.zip")
|
||||
if path.exists():
|
||||
try:
|
||||
with zipfile.ZipFile(_LIBRETRO_ZIP) as z:
|
||||
with zipfile.ZipFile(path) as z:
|
||||
_libretro_names = {n[:-4] for n in z.namelist() if n.endswith(".png")}
|
||||
except Exception: # noqa: BLE001
|
||||
pass
|
||||
@@ -610,7 +650,7 @@ def _fetch_screenscraper(name, timeout, system="games"):
|
||||
params = {
|
||||
"devid": devid,
|
||||
"devpassword": devpassword,
|
||||
"softname": creds.get("screenscraper_softname") or "psp-preserve",
|
||||
"softname": creds.get("screenscraper_softname") or "psppt",
|
||||
"output": "json",
|
||||
"systemeid": _platform(system)["ss_id"],
|
||||
"romtype": "rom",
|
||||
|
||||
+297
-38
@@ -1,4 +1,4 @@
|
||||
"""Native Linux GUI for the PSP Preservation Tool (PySide6 / Qt).
|
||||
"""Native Linux GUI for psppt (PySide6 / Qt).
|
||||
|
||||
Run with::
|
||||
|
||||
@@ -7,6 +7,7 @@ Run with::
|
||||
import datetime
|
||||
import json
|
||||
import logging
|
||||
import signal
|
||||
import sys
|
||||
import threading
|
||||
from pathlib import Path
|
||||
@@ -117,14 +118,16 @@ def _thread_running(thread):
|
||||
|
||||
|
||||
class CoverLoader(QObject):
|
||||
loaded = Signal(int, int, str) # gen, item index, cached image path
|
||||
loaded = Signal(int, int, QImage) # gen, item index, fitted cover image
|
||||
failed = Signal(int, int, str) # gen, item index, name (no cover found)
|
||||
finished = Signal()
|
||||
|
||||
def __init__(self, items, gen):
|
||||
def __init__(self, items, gen, icon_w=150, icon_h=220):
|
||||
super().__init__()
|
||||
self.items = items
|
||||
self.gen = gen
|
||||
self.icon_w = icon_w
|
||||
self.icon_h = icon_h
|
||||
self._cancel = threading.Event()
|
||||
|
||||
def cancel(self):
|
||||
@@ -148,11 +151,17 @@ class CoverLoader(QObject):
|
||||
except Exception: # noqa: BLE001
|
||||
path = None
|
||||
if path is not None:
|
||||
self.loaded.emit(self.gen, i, str(path))
|
||||
img = QImage(str(path))
|
||||
if img.isNull():
|
||||
self.failed.emit(self.gen, i, self.items[i]["name"])
|
||||
else:
|
||||
self.loaded.emit(self.gen, i, _fit_image(img, self.icon_w, self.icon_h))
|
||||
else:
|
||||
self.failed.emit(self.gen, i, self.items[i]["name"])
|
||||
finally:
|
||||
pool.shutdown(wait=True, cancel_futures=True)
|
||||
# Return promptly on cancel/exit instead of blocking the GUI thread
|
||||
# on in-flight network timeouts during shutdown.
|
||||
pool.shutdown(wait=not self._cancel.is_set(), cancel_futures=True)
|
||||
self.finished.emit()
|
||||
|
||||
|
||||
@@ -276,6 +285,25 @@ def _fit_pixmap(pm, w, h):
|
||||
return canvas
|
||||
|
||||
|
||||
def _fit_image(img, w, h):
|
||||
"""Scale a QImage into a letterboxed ``w x h`` ARGB image (thread-safe).
|
||||
|
||||
Decoding + scaling happen off the GUI thread in the cover loaders; the
|
||||
main thread only converts the result to a QPixmap (cheap).
|
||||
"""
|
||||
canvas = QImage(w, h, QImage.Format_ARGB32)
|
||||
canvas.fill(Qt.transparent)
|
||||
if img.isNull():
|
||||
return canvas
|
||||
scaled = img.scaled(w, h, Qt.KeepAspectRatio, Qt.SmoothTransformation)
|
||||
x = (w - scaled.width()) // 2
|
||||
y = (h - scaled.height()) // 2
|
||||
painter = QPainter(canvas)
|
||||
painter.drawImage(x, y, scaled)
|
||||
painter.end()
|
||||
return canvas
|
||||
|
||||
|
||||
def _cover_pixmap(rid, system, max_w, max_h):
|
||||
"""Return a scaled cover pixmap for an item, or None if unavailable."""
|
||||
if rid is None:
|
||||
@@ -429,7 +457,7 @@ class CoverShowcase(QWidget):
|
||||
for loader in self._loaders:
|
||||
loader.cancel()
|
||||
self.thread = QThread(self)
|
||||
self.loader = CoverLoader(self.items, gen)
|
||||
self.loader = CoverLoader(self.items, gen, self.ICON_W, self.ICON_H)
|
||||
self.loader.moveToThread(self.thread)
|
||||
self.thread.started.connect(self.loader.run)
|
||||
self.loader.loaded.connect(self._on_loaded)
|
||||
@@ -454,12 +482,12 @@ class CoverShowcase(QWidget):
|
||||
painter.end()
|
||||
return QIcon(pm)
|
||||
|
||||
def _on_loaded(self, gen, index, path):
|
||||
if gen != self._generation:
|
||||
def _on_loaded(self, gen, index, image):
|
||||
if self._closing or gen != self._generation:
|
||||
return
|
||||
item = self.list.item(index)
|
||||
if item is not None:
|
||||
item.setIcon(self._fit_icon(QPixmap(path)))
|
||||
item.setIcon(QIcon(QPixmap.fromImage(image)))
|
||||
if 0 <= index < len(self.items):
|
||||
self.cover_loaded.emit(self.items[index])
|
||||
|
||||
@@ -477,7 +505,7 @@ class CoverShowcase(QWidget):
|
||||
self.play_requested.emit(data)
|
||||
|
||||
def _on_failed(self, gen, index, name):
|
||||
if gen != self._generation:
|
||||
if self._closing or gen != self._generation:
|
||||
return
|
||||
if index not in self.missing:
|
||||
self.missing.append(index)
|
||||
@@ -485,6 +513,8 @@ class CoverShowcase(QWidget):
|
||||
self._update_status()
|
||||
|
||||
def _on_loading_done(self):
|
||||
if self._closing:
|
||||
return
|
||||
sender = self.sender()
|
||||
if sender is not None and getattr(sender, "gen", None) != self._generation:
|
||||
return
|
||||
@@ -492,6 +522,8 @@ class CoverShowcase(QWidget):
|
||||
self._update_status()
|
||||
|
||||
def _update_status(self):
|
||||
if self._closing:
|
||||
return
|
||||
if self._loading:
|
||||
self.status.setText("Loading covers…")
|
||||
self.missing_changed.emit(0)
|
||||
@@ -1111,13 +1143,14 @@ class ScrapeDialog(QDialog):
|
||||
|
||||
class SettingsPage(QWidget):
|
||||
saved = Signal()
|
||||
download_covers = Signal()
|
||||
|
||||
def __init__(self, games_dir, videos_dir, store_dir, ppsspp_dir, cloud_dir, ppsspp_exe,
|
||||
store_server_url, store_token, store_archive_id, store_archive_sig, store_archive_user,
|
||||
iso_category, ps1_category, psp_category, ps1_dir, ps1_output_dir, ps1_base_pbp,
|
||||
nps_dir="", parent=None):
|
||||
super().__init__(parent)
|
||||
s = QSettings("PSPPreserve", "PSPPreserve")
|
||||
s = QSettings("psppt", "psppt")
|
||||
|
||||
outer = QVBoxLayout(self)
|
||||
outer.setContentsMargins(16, 16, 16, 16)
|
||||
@@ -1278,6 +1311,25 @@ class SettingsPage(QWidget):
|
||||
self.clear_covers_btn = QPushButton("Clear cover cache (re-fetch all covers)")
|
||||
self.clear_covers_btn.clicked.connect(self._clear_cover_cache)
|
||||
form.addRow(self.clear_covers_btn)
|
||||
self.download_bundle_btn = QPushButton("Download offline cover bundle…")
|
||||
self.download_bundle_btn.clicked.connect(self.download_covers.emit)
|
||||
form.addRow(self.download_bundle_btn)
|
||||
col.addWidget(box)
|
||||
|
||||
# -- Storage ---------------------------------------------------------- #
|
||||
box, form = self._group("Storage")
|
||||
self._path_row(form, "State directory", str(config.STATE_DIR))
|
||||
self._path_row(form, "Library database", str(config.DB_PATH))
|
||||
self._path_row(form, "Cover cache", str(config.COVERS_DIR))
|
||||
self._path_row(form, "User data (credentials, NPS cache…)", str(config.USER_DATA_DIR))
|
||||
note = QLabel(
|
||||
"Your library, covers, and credentials live here — outside the app "
|
||||
"bundle, so they survive upgrades. On Linux this is the "
|
||||
"~/.local/state/psppt folder."
|
||||
)
|
||||
note.setWordWrap(True)
|
||||
note.setStyleSheet("color: #9a9ba5;")
|
||||
form.addRow(note)
|
||||
col.addWidget(box)
|
||||
|
||||
col.addStretch(1)
|
||||
@@ -1342,6 +1394,29 @@ class SettingsPage(QWidget):
|
||||
form.addRow(label, edit)
|
||||
return edit
|
||||
|
||||
def _path_row(self, form, label, path):
|
||||
edit = QLineEdit(path)
|
||||
edit.setReadOnly(True)
|
||||
open_btn = QPushButton("Open")
|
||||
open_btn.clicked.connect(lambda _=False, p=Path(path): self._open_path(p))
|
||||
row = QWidget()
|
||||
h = QHBoxLayout(row)
|
||||
h.setContentsMargins(0, 0, 0, 0)
|
||||
h.addWidget(edit, 1)
|
||||
h.addWidget(open_btn)
|
||||
form.addRow(label, row)
|
||||
return edit
|
||||
|
||||
@staticmethod
|
||||
def _open_path(path):
|
||||
path = Path(path)
|
||||
target = path if path.is_dir() else path.parent
|
||||
if target.is_dir():
|
||||
QDesktopServices.openUrl(QUrl.fromLocalFile(str(target)))
|
||||
else:
|
||||
QMessageBox.information(None, "Not found",
|
||||
f"Folder not created yet:\n{target}\n\nIt is created on first use.")
|
||||
|
||||
def games_dir(self):
|
||||
return self.games_edit.text().strip()
|
||||
|
||||
@@ -1405,7 +1480,7 @@ class SettingsPage(QWidget):
|
||||
def _save(self):
|
||||
sources.save({key: edit.text() for key, edit in self.fields.items()})
|
||||
covers.clear_miss_cache()
|
||||
s = QSettings("PSPPreserve", "PSPPreserve")
|
||||
s = QSettings("psppt", "psppt")
|
||||
s.setValue("auto_scan", self.auto_scan.isChecked())
|
||||
s.setValue("scan_workers", self.workers_spin.value())
|
||||
s.setValue("auto_sync_saves", self.auto_sync.isChecked())
|
||||
@@ -1440,14 +1515,16 @@ class StoreScanWorker(QObject):
|
||||
|
||||
|
||||
class StoreCoverLoader(QObject):
|
||||
loaded = Signal(int, int, str) # gen, grid row, cached image path
|
||||
loaded = Signal(int, int, QImage) # gen, grid row, fitted cover image
|
||||
finished = Signal()
|
||||
|
||||
def __init__(self, tasks, gen, quick=True):
|
||||
def __init__(self, tasks, gen, quick=True, icon_w=150, icon_h=220):
|
||||
super().__init__()
|
||||
self.tasks = tasks # list of (grid_row, item_dict)
|
||||
self.gen = gen
|
||||
self.quick = quick
|
||||
self.icon_w = icon_w
|
||||
self.icon_h = icon_h
|
||||
self._cancel = threading.Event()
|
||||
|
||||
def cancel(self):
|
||||
@@ -1471,9 +1548,13 @@ class StoreCoverLoader(QObject):
|
||||
except Exception: # noqa: BLE001
|
||||
path = None
|
||||
if path is not None:
|
||||
self.loaded.emit(self.gen, row, str(path))
|
||||
img = QImage(str(path))
|
||||
if not img.isNull():
|
||||
self.loaded.emit(self.gen, row, _fit_image(img, self.icon_w, self.icon_h))
|
||||
finally:
|
||||
pool.shutdown(wait=True, cancel_futures=True)
|
||||
# Return promptly on cancel/exit instead of blocking the GUI thread
|
||||
# on in-flight network timeouts during shutdown.
|
||||
pool.shutdown(wait=not self._cancel.is_set(), cancel_futures=True)
|
||||
self.finished.emit()
|
||||
|
||||
|
||||
@@ -1789,6 +1870,11 @@ class StorePage(QWidget):
|
||||
self.psp_filter.setToolTip("Filter by whether the archive matches a disc installed on the connected PSP")
|
||||
self.psp_filter.currentIndexChanged.connect(self._apply_filter)
|
||||
bar.addWidget(self.psp_filter)
|
||||
self.store_sort = QComboBox()
|
||||
self.store_sort.addItems(["Newest first", "Title (A–Z)", "Region (A–Z)", "Size (largest)", "In library first"])
|
||||
self.store_sort.setToolTip("Sort the cover grid")
|
||||
self.store_sort.currentTextChanged.connect(self._apply_filter)
|
||||
bar.addWidget(self.store_sort)
|
||||
refresh_btn = QPushButton("Refresh")
|
||||
refresh_btn.clicked.connect(lambda: self.refresh(force=True))
|
||||
bar.addWidget(refresh_btn)
|
||||
@@ -2046,7 +2132,7 @@ class StorePage(QWidget):
|
||||
if not it.get("release_date"):
|
||||
it["release_date"] = dates.get((str(rid), system)) or ""
|
||||
filtered.append(it)
|
||||
filtered.sort(key=self._store_sort_key)
|
||||
self._sort_store_items(filtered)
|
||||
self._filtered = filtered
|
||||
if self.all_check.isChecked():
|
||||
show = len(filtered)
|
||||
@@ -2054,6 +2140,19 @@ class StorePage(QWidget):
|
||||
show = min(self.RECENT_LIMIT, len(filtered))
|
||||
self._populate(filtered, show)
|
||||
|
||||
def _sort_store_items(self, items):
|
||||
mode = self.store_sort.currentText()
|
||||
if mode == "Title (A–Z)":
|
||||
items.sort(key=lambda it: store.display_name(it["name"]).lower())
|
||||
elif mode == "Region (A–Z)":
|
||||
items.sort(key=lambda it: (store.region(it["name"]) or "").lower())
|
||||
elif mode == "Size (largest)":
|
||||
items.sort(key=lambda it: it.get("size") or 0, reverse=True)
|
||||
elif mode == "In library first":
|
||||
items.sort(key=lambda it: (not it.get("in_library"), store.display_name(it["name"]).lower()))
|
||||
else: # Newest first
|
||||
items.sort(key=self._store_sort_key)
|
||||
|
||||
@staticmethod
|
||||
def _store_sort_key(it):
|
||||
d = it.get("release_date") or ""
|
||||
@@ -2267,7 +2366,7 @@ class StorePage(QWidget):
|
||||
thread.start()
|
||||
|
||||
def _on_date_loaded(self, gen, row, date):
|
||||
if gen != self._generation or not date:
|
||||
if self._closing or gen != self._generation or not date:
|
||||
return
|
||||
if 0 <= row < len(self._filtered):
|
||||
self._filtered[row]["release_date"] = date
|
||||
@@ -2279,7 +2378,7 @@ class StorePage(QWidget):
|
||||
if self._closing or not tasks:
|
||||
return
|
||||
thread = QThread(self)
|
||||
loader = StoreCoverLoader(tasks, gen, quick=True)
|
||||
loader = StoreCoverLoader(tasks, gen, quick=True, icon_w=self.ICON_W, icon_h=self.ICON_H)
|
||||
loader.moveToThread(thread)
|
||||
thread.started.connect(loader.run)
|
||||
loader.loaded.connect(self._on_cover_loaded)
|
||||
@@ -2289,12 +2388,12 @@ class StorePage(QWidget):
|
||||
self._loaders.append(loader)
|
||||
thread.start()
|
||||
|
||||
def _on_cover_loaded(self, gen, row, path):
|
||||
if gen != self._generation:
|
||||
def _on_cover_loaded(self, gen, row, image):
|
||||
if self._closing or gen != self._generation:
|
||||
return
|
||||
item = self.grid.item(row)
|
||||
if item is not None:
|
||||
item.setIcon(QIcon(_fit_pixmap(QPixmap(path), self.ICON_W, self.ICON_H)))
|
||||
item.setIcon(QIcon(QPixmap.fromImage(image)))
|
||||
it = item.data(Qt.UserRole)
|
||||
shown = getattr(self.details, "_item", None)
|
||||
if it is not None and shown is not None and it.get("path") == shown.get("path"):
|
||||
@@ -3662,6 +3761,35 @@ class LibraryWorker(QObject):
|
||||
self.finished.emit()
|
||||
|
||||
|
||||
class CoversBundleWorker(QObject):
|
||||
"""Download + extract the offline cover bundle off the GUI thread."""
|
||||
progress = Signal(int, int) # done bytes, total bytes (0 = unknown)
|
||||
succeeded = Signal()
|
||||
failed = Signal(str)
|
||||
finished = Signal()
|
||||
|
||||
def __init__(self):
|
||||
super().__init__()
|
||||
self._cancel = threading.Event()
|
||||
|
||||
def cancel(self):
|
||||
self._cancel.set()
|
||||
|
||||
def run(self):
|
||||
try:
|
||||
covers.download_covers_bundle(
|
||||
progress_cb=lambda d, t: self.progress.emit(d, t),
|
||||
cancel_event=self._cancel)
|
||||
except InterruptedError:
|
||||
pass
|
||||
except Exception as exc: # noqa: BLE001
|
||||
self.failed.emit(str(exc))
|
||||
else:
|
||||
self.succeeded.emit()
|
||||
finally:
|
||||
self.finished.emit()
|
||||
|
||||
|
||||
class SaveSyncPlanWorker(QObject):
|
||||
"""Compute the save-sync plan off the GUI thread (content hashing is I/O-heavy)."""
|
||||
plan = Signal(list, bool) # plan, switch_to_queue
|
||||
@@ -4044,6 +4172,7 @@ class Ps1Page(QWidget):
|
||||
self._preview_gen = 0
|
||||
self._preview_threads = []
|
||||
self._preview_workers = []
|
||||
self._closing = False
|
||||
|
||||
layout = QVBoxLayout(self)
|
||||
bar = QHBoxLayout()
|
||||
@@ -4142,7 +4271,7 @@ class Ps1Page(QWidget):
|
||||
self._preview_workers.append(worker)
|
||||
|
||||
def _on_preview_result(self, gen, game_id, icon0, pic0, pic1):
|
||||
if gen != self._preview_gen:
|
||||
if self._closing or gen != self._preview_gen:
|
||||
return
|
||||
self.preview_icon0.setText("")
|
||||
self.preview_pic0.setText("")
|
||||
@@ -4190,6 +4319,8 @@ class Ps1Page(QWidget):
|
||||
self._thread.start()
|
||||
|
||||
def _on_results(self, entries):
|
||||
if self._closing:
|
||||
return
|
||||
# Only show discs that still need converting; converted games already
|
||||
# appear in the Library tab.
|
||||
entries = [e for e in entries if e["kind"] == "disc" and e.get("status") != "converted"]
|
||||
@@ -4205,7 +4336,22 @@ class Ps1Page(QWidget):
|
||||
self.table.selectRow(0)
|
||||
|
||||
def _on_failed(self, message):
|
||||
self.status.setText(f"PS1 scan failed: {message}")
|
||||
if not self._closing:
|
||||
self.status.setText(f"PS1 scan failed: {message}")
|
||||
|
||||
def shutdown(self):
|
||||
self._closing = True
|
||||
if self._thread is not None and _thread_running(self._thread):
|
||||
self._thread.quit()
|
||||
self._thread.wait()
|
||||
for t in self._preview_threads:
|
||||
if _thread_running(t):
|
||||
t.quit()
|
||||
t.wait()
|
||||
self._preview_threads = []
|
||||
self._preview_workers = []
|
||||
self._thread = None
|
||||
self._worker = None
|
||||
|
||||
def _convert_selected(self):
|
||||
row = self.table.currentRow()
|
||||
@@ -4230,7 +4376,7 @@ class Ps1Page(QWidget):
|
||||
class MainWindow(QMainWindow):
|
||||
def __init__(self):
|
||||
super().__init__()
|
||||
self.setWindowTitle("psp preservation tool ~ quoije")
|
||||
self.setWindowTitle("psppt ~ quoije")
|
||||
self.resize(1240, 780)
|
||||
self._rows = []
|
||||
self._renames = []
|
||||
@@ -4253,7 +4399,7 @@ class MainWindow(QMainWindow):
|
||||
self._library_workers = []
|
||||
self._library_loading = False
|
||||
|
||||
self.settings = QSettings("PSPPreserve", "PSPPreserve")
|
||||
self.settings = QSettings("psppt", "psppt")
|
||||
self._games_dir = self._first_existing(config.GAMES_ROOTS) or self.settings.value("games_dir", "") or ""
|
||||
self._videos_dir = self._first_existing(config.VIDEO_ROOTS) or self.settings.value("videos_dir", "") or ""
|
||||
self._store_dir = str(self.settings.value("store_dir", str(config.STORE_ROOT)) or "")
|
||||
@@ -4296,7 +4442,7 @@ class MainWindow(QMainWindow):
|
||||
pm = QPixmap(str(icon_path))
|
||||
pm = pm.scaled(28, 28, Qt.KeepAspectRatio, Qt.SmoothTransformation)
|
||||
logo.setPixmap(pm)
|
||||
logo.setToolTip("PSP Preservation Tool")
|
||||
logo.setToolTip("psppt")
|
||||
self.tabs.setCornerWidget(logo, Qt.TopRightCorner)
|
||||
|
||||
self.queue = queue.TransferQueue(self)
|
||||
@@ -4366,6 +4512,11 @@ class MainWindow(QMainWindow):
|
||||
self.library_view = QComboBox()
|
||||
self.library_view.addItems(["Cover view", "List view"])
|
||||
bar.addWidget(self.library_view)
|
||||
self.library_sort = QComboBox()
|
||||
self.library_sort.addItems(["Title", "Release date", "Size", "Region", "Type", "Serial"])
|
||||
self.library_sort.setToolTip("Sort the cover grid")
|
||||
self.library_sort.currentTextChanged.connect(self._apply_library_filter)
|
||||
bar.addWidget(self.library_sort)
|
||||
reload_btn = QPushButton("Reload")
|
||||
reload_btn.clicked.connect(self.load_library)
|
||||
bar.addWidget(reload_btn)
|
||||
@@ -4497,6 +4648,7 @@ class MainWindow(QMainWindow):
|
||||
self._ps1_dir, self._ps1_output_dir, self._ps1_base_pbp,
|
||||
self._nps_dir)
|
||||
self.settings_page.saved.connect(self._on_settings_saved)
|
||||
self.settings_page.download_covers.connect(self._download_covers_bundle)
|
||||
return self.settings_page
|
||||
|
||||
def _on_settings_saved(self):
|
||||
@@ -4633,12 +4785,30 @@ class MainWindow(QMainWindow):
|
||||
if psp_f == "Not on PSP" and it.get("on_psp"):
|
||||
continue
|
||||
items.append(it)
|
||||
self._sort_library_items(items)
|
||||
self._library_filtered = items
|
||||
self._populate_library_table(items)
|
||||
self.cover_grid.set_items(items)
|
||||
if hasattr(self, "psp_page"):
|
||||
self.psp_page.set_library_items(self._library_cache)
|
||||
|
||||
def _sort_library_items(self, items):
|
||||
mode = self.library_sort.currentText()
|
||||
title = lambda it: (it.get("title_override") or it.get("canonical") or it["name"] or "").lower()
|
||||
if mode == "Release date":
|
||||
items.sort(key=lambda it: it.get("release_date") or "", reverse=True)
|
||||
elif mode == "Size":
|
||||
items.sort(key=lambda it: it.get("size") or 0, reverse=True)
|
||||
elif mode == "Region":
|
||||
items.sort(key=lambda it: (it.get("region") or "").lower())
|
||||
elif mode == "Type":
|
||||
order = {"games": 0, "videos": 1, "ps1": 2, "theme": 3, "dlc": 4}
|
||||
items.sort(key=lambda it: (order.get(it.get("system"), 9), title(it)))
|
||||
elif mode == "Serial":
|
||||
items.sort(key=lambda it: (it.get("serial") or "").lower())
|
||||
else: # Title
|
||||
items.sort(key=title)
|
||||
|
||||
def _populate_library_table(self, items):
|
||||
self.library_table.setUpdatesEnabled(False)
|
||||
self.library_table.setSortingEnabled(False)
|
||||
@@ -5551,6 +5721,79 @@ class MainWindow(QMainWindow):
|
||||
QMessageBox.information(self, "Done", f"Renamed {renamed} file(s).")
|
||||
self.load_library()
|
||||
|
||||
def maybe_offer_covers_bundle(self):
|
||||
"""Offer to download the offline cover bundle once, if it's missing."""
|
||||
if self._closing or covers.covers_bundle_present():
|
||||
return
|
||||
s = QSettings("psppt", "psppt")
|
||||
if str(s.value("covers_bundle_skip", "false")).lower() == "true":
|
||||
return
|
||||
box = QMessageBox(self)
|
||||
box.setWindowTitle("Offline covers")
|
||||
box.setIcon(QMessageBox.Question)
|
||||
box.setText(
|
||||
"The offline cover bundle (~843 MB) isn't installed.\n\n"
|
||||
"Download it now from the project repo? Covers keep working online "
|
||||
"without it — the bundle just makes them instant and offline."
|
||||
)
|
||||
download = box.addButton("Download", QMessageBox.AcceptRole)
|
||||
box.addButton("Not now", QMessageBox.RejectRole)
|
||||
never = box.addButton("Don't ask again", QMessageBox.DestructiveRole)
|
||||
box.setDefaultButton(download)
|
||||
box.exec()
|
||||
clicked = box.clickedButton()
|
||||
if clicked is never:
|
||||
s.setValue("covers_bundle_skip", "true")
|
||||
elif clicked is download:
|
||||
self._download_covers_bundle()
|
||||
|
||||
def _download_covers_bundle(self):
|
||||
"""Download + extract the offline cover bundle with a progress dialog."""
|
||||
if self._closing or getattr(self, "_bundle_worker", None) is not None:
|
||||
return
|
||||
prog = QProgressDialog("Downloading cover bundle…", "Cancel", 0, 0, self)
|
||||
prog.setWindowTitle("Offline covers")
|
||||
prog.setWindowModality(Qt.WindowModal)
|
||||
prog.setMinimumDuration(0)
|
||||
prog.setAutoClose(False)
|
||||
prog.setAutoReset(False)
|
||||
|
||||
result = {"ok": False, "err": ""}
|
||||
thread = QThread(self)
|
||||
worker = CoversBundleWorker()
|
||||
worker.moveToThread(thread)
|
||||
thread.started.connect(worker.run)
|
||||
worker.progress.connect(lambda d, t: self._on_bundle_progress(prog, d, t))
|
||||
worker.succeeded.connect(lambda: result.update(ok=True))
|
||||
worker.failed.connect(lambda e: result.update(err=str(e)))
|
||||
prog.canceled.connect(worker.cancel)
|
||||
worker.finished.connect(thread.quit)
|
||||
thread.finished.connect(lambda: self._on_bundle_done(prog, result, worker, thread))
|
||||
self._bundle_worker = worker
|
||||
self._bundle_thread = thread
|
||||
thread.start()
|
||||
|
||||
@staticmethod
|
||||
def _on_bundle_progress(prog, done, total):
|
||||
if total > 0:
|
||||
prog.setRange(0, total)
|
||||
prog.setValue(done)
|
||||
prog.setLabelText(
|
||||
f"Downloading cover bundle… {done / (1 << 20):.0f} / {total / (1 << 20):.0f} MB")
|
||||
else:
|
||||
prog.setRange(0, 0)
|
||||
|
||||
def _on_bundle_done(self, prog, result, worker, thread):
|
||||
prog.close()
|
||||
self._bundle_worker = None
|
||||
self._bundle_thread = None
|
||||
if result["ok"]:
|
||||
QMessageBox.information(self, "Offline covers", "Cover bundle installed.")
|
||||
covers.clear_miss_cache()
|
||||
self.load_library()
|
||||
elif result["err"]:
|
||||
QMessageBox.warning(self, "Offline covers", f"Download failed:\n{result['err']}")
|
||||
|
||||
def closeEvent(self, event):
|
||||
self._closing = True
|
||||
self.settings.setValue("window_geometry", self.saveGeometry())
|
||||
@@ -5559,6 +5802,11 @@ class MainWindow(QMainWindow):
|
||||
self.worker.choose(None)
|
||||
self.worker.cancel()
|
||||
self._thread_cleanup()
|
||||
if getattr(self, "_bundle_worker", None) is not None:
|
||||
self._bundle_worker.cancel()
|
||||
if getattr(self, "_bundle_thread", None) is not None and _thread_running(self._bundle_thread):
|
||||
self._bundle_thread.quit()
|
||||
self._bundle_thread.wait()
|
||||
self.cover_grid.shutdown()
|
||||
for t in self._meta_threads:
|
||||
if _thread_running(t):
|
||||
@@ -5576,18 +5824,11 @@ class MainWindow(QMainWindow):
|
||||
self.psp_page.shutdown()
|
||||
if hasattr(self, "saves_page"):
|
||||
self.saves_page.shutdown()
|
||||
if hasattr(self, "ps1_page"):
|
||||
self.ps1_page.shutdown()
|
||||
event.accept()
|
||||
|
||||
|
||||
def _start_bundle_check(window):
|
||||
"""Download any missing offline cover bundles in the background."""
|
||||
server = getattr(window, "_store_server_url", "") or ""
|
||||
try:
|
||||
covers.ensure_cover_bundles(server)
|
||||
except Exception: # noqa: BLE001 - background best-effort
|
||||
pass
|
||||
|
||||
|
||||
def main():
|
||||
logging.basicConfig(level=logging.INFO, format="%(asctime)s %(levelname)-7s %(name)-14s %(message)s")
|
||||
init_db() # migrate legacy on-share DB/covers to local storage, then schema
|
||||
@@ -5596,16 +5837,34 @@ def main():
|
||||
n = ingest.ensure_catalog()
|
||||
if n:
|
||||
log.info("ingested %d DAT(s) into the catalog", n)
|
||||
log.info("starting psp-preserve (db: %s)", config.DB_PATH)
|
||||
log.info("starting psppt (db: %s)", config.DB_PATH)
|
||||
app = QApplication(sys.argv)
|
||||
style.apply_theme(app)
|
||||
app.setApplicationName("psppt")
|
||||
app.setDesktopFileName("psppt")
|
||||
icon_path = config.PROJECT_ROOT / "img" / "app-icon.png"
|
||||
if icon_path.is_file():
|
||||
app.setWindowIcon(QIcon(str(icon_path)))
|
||||
window = MainWindow()
|
||||
window.setWindowIcon(app.windowIcon())
|
||||
window.show()
|
||||
log.info("main window ready")
|
||||
threading.Thread(target=_start_bundle_check, args=(window,), daemon=True).start()
|
||||
QTimer.singleShot(1200, window.maybe_offer_covers_bundle)
|
||||
|
||||
# Ctrl+C should close the window gracefully (running closeEvent's thread
|
||||
# cleanup) rather than tearing Qt down mid-thread, which segfaults.
|
||||
interrupt = {"pending": False}
|
||||
|
||||
def _sigint_handler(signum, frame):
|
||||
interrupt["pending"] = True
|
||||
|
||||
signal.signal(signal.SIGINT, _sigint_handler)
|
||||
sigint_timer = QTimer()
|
||||
sigint_timer.setInterval(100)
|
||||
sigint_timer.timeout.connect(
|
||||
lambda: window.close() if interrupt["pending"] else None)
|
||||
sigint_timer.start()
|
||||
|
||||
return app.exec()
|
||||
|
||||
|
||||
|
||||
+1
-1
@@ -1,4 +1,4 @@
|
||||
"""PSP Preservation Tool entry point (native GUI).
|
||||
"""psppt entry point (native GUI).
|
||||
|
||||
Run with::
|
||||
|
||||
|
||||
+1
-1
@@ -151,7 +151,7 @@ def fetch_items(content_type: str, url: str = "", timeout: int = 60, force: bool
|
||||
return items
|
||||
|
||||
try:
|
||||
req = urllib.request.Request(url, headers={"User-Agent": "psp-preserve/0.1"})
|
||||
req = urllib.request.Request(url, headers={"User-Agent": "psppt/0.1"})
|
||||
with urllib.request.urlopen(req, timeout=timeout) as resp:
|
||||
data = resp.read()
|
||||
text = data.decode("utf-8", errors="replace")
|
||||
|
||||
+1
-1
@@ -155,7 +155,7 @@ def scrape(limit=None, workers=8, rate=3.0):
|
||||
log.info("downloading OpenVGDB dump (%s)…", OVGDB_ZIP_URL)
|
||||
tmpdir = Path(tempfile.mkdtemp(prefix="openvgdb-"))
|
||||
dump_zip = tmpdir / "openvgdb.zip"
|
||||
req = urllib.request.Request(OVGDB_ZIP_URL, headers={"User-Agent": "psp-preserve/0.1"})
|
||||
req = urllib.request.Request(OVGDB_ZIP_URL, headers={"User-Agent": "psppt/0.1"})
|
||||
with urllib.request.urlopen(req, timeout=60) as r, open(dump_zip, "wb") as f:
|
||||
f.write(r.read())
|
||||
|
||||
|
||||
+2
-2
@@ -284,7 +284,7 @@ class RemoteStoreSource(Source):
|
||||
self.token = token or ""
|
||||
|
||||
def _headers(self):
|
||||
headers = {"User-Agent": "psp-preserve/0.1"}
|
||||
headers = {"User-Agent": "psppt/0.1"}
|
||||
if self.token:
|
||||
headers["Authorization"] = f"Bearer {self.token}"
|
||||
return headers
|
||||
@@ -347,7 +347,7 @@ class ArchiveOrgSource(Source):
|
||||
return f"https://archive.org/download/{self.item}"
|
||||
|
||||
def _headers(self):
|
||||
headers = {"User-Agent": "psp-preserve/0.1"}
|
||||
headers = {"User-Agent": "psppt/0.1"}
|
||||
cookie = "; ".join(
|
||||
p for p in (
|
||||
f"logged-in-sig={self.sig}" if self.sig else "",
|
||||
|
||||
Binary file not shown.
Binary file not shown.
+2
-2
@@ -1,7 +1,7 @@
|
||||
services:
|
||||
psp-preserve:
|
||||
psppt:
|
||||
build: .
|
||||
container_name: psp-preserve
|
||||
container_name: psppt
|
||||
# Attach to Unraid's macvlan bridge so the API gets its own LAN IP.
|
||||
# Plain HTTP for now; see Caddyfile to add Let's Encrypt TLS later.
|
||||
networks:
|
||||
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 12 KiB |
Executable
+81
@@ -0,0 +1,81 @@
|
||||
#!/bin/sh
|
||||
# Install psppt to a system prefix.
|
||||
#
|
||||
# FHS-friendly layout:
|
||||
# $PREFIX/bin/psppt symlink -> payload binary
|
||||
# $PREFIX/lib/psppt/ app payload (binary + lib/)
|
||||
# $PREFIX/share/applications/ desktop entry
|
||||
# $PREFIX/share/icons/hicolor/256x256/apps/ app icon
|
||||
#
|
||||
# The PyInstaller onedir build keeps the executable and its `lib/` contents
|
||||
# directory side by side, so both live under $PREFIX/lib/psppt/ and a
|
||||
# symlink exposes the binary at $PREFIX/bin/psppt.
|
||||
#
|
||||
# Usage (run from inside the extracted tarball):
|
||||
# sudo ./install.sh # install to /usr/local (default)
|
||||
# sudo ./install.sh --prefix=/usr # install to /usr
|
||||
# sudo ./install.sh --uninstall # remove from the default prefix
|
||||
set -eu
|
||||
|
||||
PREFIX=/usr/local
|
||||
MODE=install
|
||||
|
||||
for arg in "$@"; do
|
||||
case "$arg" in
|
||||
--prefix=*) PREFIX=${arg#--prefix=} ;;
|
||||
--uninstall) MODE=uninstall ;;
|
||||
*) echo "unknown argument: $arg" >&2; exit 2 ;;
|
||||
esac
|
||||
done
|
||||
|
||||
SRC_DIR=$(CDPATH= cd -- "$(dirname -- "$0")" && pwd)
|
||||
LIBDIR="$PREFIX/lib/psppt"
|
||||
BINDIR="$PREFIX/bin"
|
||||
APPDIR="$PREFIX/share/applications"
|
||||
ICONDIR="$PREFIX/share/icons/hicolor/256x256/apps"
|
||||
APP_BIN="$LIBDIR/psppt"
|
||||
|
||||
require_root() {
|
||||
if [ "$(id -u)" -ne 0 ]; then
|
||||
echo "run as root (e.g. sudo)" >&2
|
||||
exit 1
|
||||
fi
|
||||
}
|
||||
|
||||
uninstall() {
|
||||
rm -f "$BINDIR/psppt"
|
||||
rm -f "$APPDIR/psppt.desktop"
|
||||
rm -f "$ICONDIR/psppt.png"
|
||||
rm -rf "$LIBDIR"
|
||||
echo "Uninstalled from $PREFIX"
|
||||
}
|
||||
|
||||
if [ "$MODE" = uninstall ]; then
|
||||
require_root
|
||||
uninstall
|
||||
exit 0
|
||||
fi
|
||||
|
||||
require_root
|
||||
|
||||
# The tarball ships these next to this script.
|
||||
for f in psppt lib psppt.desktop app-icon.png; do
|
||||
if [ ! -e "$SRC_DIR/$f" ]; then
|
||||
echo "missing $f (run install.sh from inside the extracted tarball)" >&2
|
||||
exit 1
|
||||
fi
|
||||
done
|
||||
|
||||
mkdir -p "$LIBDIR" "$BINDIR" "$APPDIR" "$ICONDIR"
|
||||
rm -rf "$LIBDIR"
|
||||
mkdir -p "$LIBDIR"
|
||||
cp -a "$SRC_DIR/psppt" "$LIBDIR/psppt"
|
||||
cp -a "$SRC_DIR/lib" "$LIBDIR/lib"
|
||||
install -m 0644 "$SRC_DIR/psppt.desktop" "$APPDIR/psppt.desktop"
|
||||
install -m 0644 "$SRC_DIR/app-icon.png" "$ICONDIR/psppt.png"
|
||||
ln -sfn "$APP_BIN" "$BINDIR/psppt"
|
||||
|
||||
echo "Installed to $PREFIX"
|
||||
echo " binary: $BINDIR/psppt -> $APP_BIN"
|
||||
echo " payload: $LIBDIR"
|
||||
echo " desktop: $APPDIR/psppt.desktop"
|
||||
@@ -0,0 +1,9 @@
|
||||
[Desktop Entry]
|
||||
Type=Application
|
||||
Name=psppt
|
||||
Comment=Preserve and manage your PSP library
|
||||
Exec=psppt
|
||||
Icon=psppt
|
||||
Terminal=false
|
||||
Categories=Utility;AudioVideo;
|
||||
StartupWMClass=psppt
|
||||
@@ -1,13 +1,13 @@
|
||||
# -*- mode: python ; coding: utf-8 -*-
|
||||
"""PyInstaller spec: build the PSP Preservation Tool (onedir).
|
||||
"""PyInstaller spec: build psppt (onedir).
|
||||
|
||||
Bundles the read-only resources (DATs, PS1 loader, offline cover bundles,
|
||||
icons) under ``_internal/`` next to the executable. User-writable data
|
||||
Bundles the read-only resources (DATs, PS1 loader, cover templates, index
|
||||
catalogs, icons) under ``lib/`` next to the executable. User-writable data
|
||||
(credentials, manual covers, PS1 templates, NPS cache, library DB, cover
|
||||
cache) lives in the OS state dir at runtime — see ``app/config.py``.
|
||||
|
||||
Usage: pyinstaller --clean --noconfirm psp-preserve.spec
|
||||
Output: dist/psp-preserve/
|
||||
Usage: pyinstaller --clean --noconfirm psppt.spec
|
||||
Output: dist/psppt/
|
||||
"""
|
||||
from PyInstaller.utils.hooks import collect_dynamic_libs, collect_submodules
|
||||
|
||||
@@ -15,8 +15,6 @@ datas = [
|
||||
("data/dats", "data/dats"),
|
||||
("data/loader", "data/loader"),
|
||||
("data/supplement.json", "data"),
|
||||
("data/covers/libretro-covers.zip", "data/covers"),
|
||||
("data/covers/openvgdb-covers.zip", "data/covers"),
|
||||
("data/covers/libretro-index.json", "data/covers"),
|
||||
("data/covers/openvgdb-index.json", "data/covers"),
|
||||
("data/covers/UMD_COVER_TEMPLATE.png", "data/covers"),
|
||||
@@ -24,6 +22,7 @@ datas = [
|
||||
("data/covers/UMD_GAME_COVER_TEMPLATE.png", "data/covers"),
|
||||
("img/app-icon.png", "img"),
|
||||
("img/chevron.png", "img"),
|
||||
("packaging/psppt.desktop", "."),
|
||||
]
|
||||
|
||||
a = Analysis(
|
||||
@@ -46,13 +45,14 @@ exe = EXE(
|
||||
a.scripts,
|
||||
[],
|
||||
exclude_binaries=True,
|
||||
name="psp-preserve",
|
||||
name="psppt",
|
||||
debug=False,
|
||||
bootloader_ignore_signals=False,
|
||||
strip=False,
|
||||
upx=False,
|
||||
console=False,
|
||||
disable_windowed_traceback=False,
|
||||
contents_directory="lib",
|
||||
)
|
||||
|
||||
coll = COLLECT(
|
||||
@@ -61,5 +61,5 @@ coll = COLLECT(
|
||||
a.datas,
|
||||
strip=False,
|
||||
upx=False,
|
||||
name="psp-preserve",
|
||||
name="psppt",
|
||||
)
|
||||
+31
-15
@@ -12,34 +12,50 @@ ENV DEBIAN_FRONTEND=noninteractive \
|
||||
WINEDLLOVERRIDES="mscoree,mshtml=" \
|
||||
PYTHON_VERSION=3.12.8
|
||||
|
||||
# Wine (64-bit), node + git for JS actions, and build/package tooling.
|
||||
RUN apt-get update && apt-get install -y --no-install-recommends \
|
||||
ca-certificates curl wget unzip zip \
|
||||
wine wine64 xvfb winetricks cabextract \
|
||||
nodejs git \
|
||||
# WineHQ wine-staging (newer than Debian's 8.0, needed for Python 3.12),
|
||||
# node + git for JS actions, and build/package tooling.
|
||||
RUN dpkg --add-architecture i386 \
|
||||
&& apt-get update \
|
||||
&& apt-get install -y --no-install-recommends ca-certificates curl wget gnupg2 \
|
||||
&& mkdir -p /etc/apt/keyrings \
|
||||
&& wget -qO- https://dl.winehq.org/wine-builds/winehq.key | gpg --dearmor -o /etc/apt/keyrings/winehq.gpg \
|
||||
&& echo "deb [signed-by=/etc/apt/keyrings/winehq.gpg] https://dl.winehq.org/wine-builds/debian/ bookworm main" > /etc/apt/sources.list.d/winehq.list \
|
||||
&& apt-get update \
|
||||
&& apt-get install -y --install-recommends winehq-staging \
|
||||
&& apt-get install -y --no-install-recommends unzip zip xvfb xauth cabextract nodejs git \
|
||||
&& apt-get clean && rm -rf /var/lib/apt/lists/*
|
||||
|
||||
# winetricks (standalone script; not packaged in Debian main).
|
||||
RUN wget -qO /usr/local/bin/winetricks \
|
||||
"https://raw.githubusercontent.com/Winetricks/winetricks/master/src/winetricks" \
|
||||
&& chmod +x /usr/local/bin/winetricks
|
||||
|
||||
# Gitea Actions runner (linux-amd64 binary).
|
||||
RUN wget -qO /usr/local/bin/act_runner \
|
||||
"https://gitea.com/gitea/act_runner/releases/download/v0.6.1/act_runner-0.6.1-linux-amd64" \
|
||||
&& chmod +x /usr/local/bin/act_runner
|
||||
|
||||
# Windows CPython 3.12, silent install into C:\Python312.
|
||||
RUN wget -qO /tmp/python-installer.exe \
|
||||
"https://www.python.org/ftp/python/${PYTHON_VERSION}/python-${PYTHON_VERSION}-amd64.exe" \
|
||||
&& xvfb-run -a wine /tmp/python-installer.exe \
|
||||
/quiet InstallAllUsers=1 PrependPath=1 Include_test=0 Include_launcher=0 Shortcuts=0 \
|
||||
&& rm -f /tmp/python-installer.exe \
|
||||
&& wine "C:\\Python312\\python.exe" --version
|
||||
|
||||
# MSVC runtime required by PySide6's Qt DLLs.
|
||||
# MSVC runtime required by PySide6's Qt DLLs (also initializes the Wine prefix).
|
||||
RUN xvfb-run -a winetricks --unattended vcrun2022
|
||||
|
||||
# Windows CPython 3.12 (embeddable zip) + pip.
|
||||
RUN wget -qO /tmp/pyembed.zip \
|
||||
"https://www.python.org/ftp/python/${PYTHON_VERSION}/python-${PYTHON_VERSION}-embed-amd64.zip" \
|
||||
&& mkdir -p /root/.wine/drive_c/Python312 \
|
||||
&& cd /root/.wine/drive_c/Python312 \
|
||||
&& unzip -q /tmp/pyembed.zip \
|
||||
&& rm -f /tmp/pyembed.zip \
|
||||
&& printf 'python312.zip\n.\nimport site\nLib\\site-packages\n' > python312._pth \
|
||||
&& wine "C:\\Python312\\python.exe" --version
|
||||
|
||||
# Convenience wrapper: winpython -> wine C:\Python312\python.exe
|
||||
RUN printf '#!/bin/sh\nexec wine "C:\\Python312\\python.exe" "$@"\n' > /usr/local/bin/winpython \
|
||||
&& chmod +x /usr/local/bin/winpython
|
||||
|
||||
# Pre-install the Windows build deps so CI jobs start fast.
|
||||
# Bootstrap pip, then pre-install the Windows build deps so CI jobs start fast.
|
||||
RUN wget -qO /tmp/get-pip.py https://bootstrap.pypa.io/get-pip.py \
|
||||
&& wine "C:\\Python312\\python.exe" /tmp/get-pip.py \
|
||||
&& rm -f /tmp/get-pip.py
|
||||
COPY requirements-build.txt /tmp/requirements-build.txt
|
||||
RUN winpython -m pip install --upgrade pip \
|
||||
&& winpython -m pip install -r /tmp/requirements-build.txt \
|
||||
|
||||
@@ -0,0 +1,36 @@
|
||||
#!/usr/bin/env python3
|
||||
"""Package the offline cover zips into a single distributable bundle.
|
||||
|
||||
Outputs ``psppt-covers.zip`` containing ``libretro-covers.zip`` and
|
||||
``openvgdb-covers.zip``. Attach it to the Gitea ``covers`` release; the app
|
||||
downloads it on first run when the user opts in.
|
||||
|
||||
Usage: python3 scripts/make-covers-bundle.py [out-path]
|
||||
"""
|
||||
import sys
|
||||
import zipfile
|
||||
from pathlib import Path
|
||||
|
||||
ROOT = Path(__file__).resolve().parent.parent
|
||||
COVERS = ROOT / "data" / "covers"
|
||||
INNER = ("libretro-covers.zip", "openvgdb-covers.zip")
|
||||
|
||||
|
||||
def main(argv):
|
||||
out = Path(argv[1]) if len(argv) > 1 else ROOT / "psppt-covers.zip"
|
||||
missing = [n for n in INNER if not (COVERS / n).exists()]
|
||||
if missing:
|
||||
print(f"missing: {', '.join(missing)} in {COVERS}", file=sys.stderr)
|
||||
return 2
|
||||
# Inner zips are already compressed; store them to avoid recompressing.
|
||||
with zipfile.ZipFile(out, "w", zipfile.ZIP_STORED) as z:
|
||||
for n in INNER:
|
||||
print(f"adding {n} …")
|
||||
z.write(COVERS / n, arcname=n)
|
||||
size = out.stat().st_size / (1 << 20)
|
||||
print(f"wrote {out} ({size:.0f} MB)")
|
||||
return 0
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
raise SystemExit(main(sys.argv))
|
||||
Reference in New Issue
Block a user