Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Advanced DAT splitter #333

Open
unexpectedpanda opened this issue Apr 28, 2024 · 0 comments
Open

Advanced DAT splitter #333

unexpectedpanda opened this issue Apr 28, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@unexpectedpanda
Copy link
Owner

Likely encompasses the needs of #247, #249, #281. Could touch on #239 for extra credit.

A new tab that lets the user choose how to split DAT file content, preferably into folders to take advantage of RomVault's DatRoot structure being mirrored in its RomRoot.

Prerequisites:

  • Category inference: If something is set up with a single category of Demos, see if other titles are around that mean it can be inferred that its categories should actually be Demos, Games, or Demos, Applications. Same for Audio, Bonus discs, Educational, Manuals, Preproduction, Promotional, Video, and possibly others.
  • No-Intro category oddities: The following & syntax would need to be handled:
    • Applications & Educational
    • Applications & Demos & Educational & Multimedia
    • Audio & Demos
    • Audio & Documents
    • Audio & Multimedia
    • Audio & Video
    • Bonus & Video
    • Covermount & Video
    • Educational & Documents
    • Add-ons & applications
  • No-Intro category collisions: Some dumpers have over-enthusiastically added a large number of categories to titles that probably aren't compatible. Retool needs to be able to handle scenarios where someone has applied both Applications and Games to a title, for example.
  • Category hierarchy: After category inference and No-Intro sanitization is performed, establish a hierarchy so DAT files can be split and organized into subfolders. For example (this would likely evolve as the feature is built out and tested against different DAT files):
    • Audio
    • Coverdiscs
    • Games
      • Add-ons
      • Audio
      • Bad dumps
      • Bonus discs
      • Coverdiscs
      • Demos, kiosks, and samples
      • Educational
      • Manuals
      • Preproduction
      • Production
      • Promotional
      • Unlicensed
        • Aftermarket
        • Console lifetime
        • Pirate
    • Applications
      • Add-ons
      • Bad dumps
      • Coverdiscs
      • Demos, kiosks, and samples
      • Educational
      • Manuals
      • Preproduction
      • Production
      • Promotional
    • BIOS and other chips
    • Multimedia
    • Video

Extra credit:

  • Scraping of Launchbox or other databases for metadata like genre, year released, number of players, cooperative multiplayer, competitive multiplayer, and so on.

Customized split

The user can optionally split by the following dimensions within the category hierarchy:

  • Language
  • Region
  • Alphanumeric folders from 0-9A-Z containing titles that start with that character (needs to handle other unicode characters too). Alternatively custom ranges for those splitting across multiple drives during the ROM management stage, so 0-C, D-K, L-R, S-Z for example.

So it's entirely possible to end up with, for example:

Sony - PlayStation\Games\Production\Europe\English\A-D\Sony - PlayStation (2024-03-27 17-24-40) (10,776) - Games - Production - Europe - English - A-D.dat

If DB scraping was done, you could also add genre, year, and so on to this structure.

Removes

The removes DAT functionality would be moved into this tab, with an option to either output a single DAT file that contains all removes, or a removes DAT file per folder containing the relevant titles for that folder designation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant