vndb/manned
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
Source code of manned.org https://manned.org/
299 commits 1 branch 0 tags 563 KiB
Find a file
Yorhel 1ee5c9c2df SQL: Add packages.c_hasman cache to speed up package listings 
Going from average ~100ms to ~10ms or so. The previous query had a
tendency to be much slower sometimes, let's see if this cache also takes
care of those outliers.

Migration script:

  ALTER TABLE packages ADD COLUMN c_hasman boolean NOT NULL DEFAULT FALSE;

  DROP INDEX packages_system_name_key;
  CREATE UNIQUE INDEX packages_system_name_key ON packages (system, name) INCLUDE (id, c_hasman, dead);

  UPDATE packages SET c_hasman = NOT c_hasman
   WHERE c_hasman <> EXISTS(SELECT 1 FROM package_versions pv WHERE pv.package = packages.id AND EXISTS(SELECT 1 FROM files f WHERE f.pkgver = pv.id));
2024-04-29 21:15:40 +02:00
indexer SQL: Add packages.c_hasman cache to speed up package listings 2024-04-29 21:15:40 +02:00
lib/ManUtils Drop grog(1) in favor of 'groff -mandoc' + two regexes 2024-04-28 15:08:00 +02:00
util SQL: Add packages.c_hasman cache to speed up package listings 2024-04-29 21:15:40 +02:00
web Make the Rust garbage compile again 2021-12-11 11:53:26 +01:00
www SQL: Add packages.c_hasman cache to speed up package listings 2024-04-29 21:15:40 +02:00
.gitignore Index NetBSD 2024-04-14 11:35:04 +02:00
COPYING Switch to AGPL license 2021-12-13 17:56:29 +01:00
Makefile A few more HTML conversion improvements 2017-01-15 20:27:16 +01:00
README.md Make the Rust garbage compile again 2021-12-11 11:53:26 +01:00
schema.sql SQL: Add packages.c_hasman cache to speed up package listings 2024-04-29 21:15:40 +02:00

README.md

The Manned.org Source Code

This repository holds the source code of Manned.org. For a description of the site, check out https://manned.org/info/about.

Ironically, documentation about how things work is completely lacking.

Requirements

  • perl: A somewhat recent version (no idea which, due to my XS usage)
  • postgresql: Also a somewhat recent version
  • rust: Version who-knows-which

Web front-end

  • AnyEvent
  • DBD::Pg
  • DBI
  • JSON::XS
  • SQL::Interp
  • TUWF

Man page indexer

  • curl
  • psql

File structure

  • indexer/ -> The Rust program that scans package repositories for updates, fetches new packages and extracts the man pages.
  • lib/ManUtils/ -> Perl/XS helper module to format man pages into HTML (uses web/).
  • sql/ -> Database schema & updates.
  • util/ -> Cron job and scripts to run indexer/ on the right repositories.
  • web/ -> Badly named Rust library to convert man pages into HTML.
  • www/ -> The web front-end.