Comprehensive List of Natively Supported Compression Formats

[Aorin 4,042]

You still should try Iso Buster, the Free and Pro versions don't differ too much, actually the trial/free version will ask you to register from time to time, and in between the batch process, nothing you can't handle.

[Aorin 4,042]

So, guys, another compression method for a new system, as WIIU emulation is coming along pretty nice lately, I bet this will be really useful for everyone.

WUD to WUX conversion, a really nice conversion I can say.

 

This text is copied from GBAtemp:

 

How does it work?
It detects duplicate sectors and only stores them once. Essentially this leads to all the empty ranges being shaved off, storing only ranges which contain file or filesystem data.
Although the algorithm is simple, it works really well. In almost all cases it will reduce the size by more than 50% (12GB+!)

Examples (uncompressed size is always 23.3GB):
Super Mario World 3D -> 2.61GB (20.69GB saved)
DKC Tropical Freeze -> 11.7GB (11.6GB saved)
Zelda WW HD -> 2.70GB (20.7GB saved)
Darksiders 2 -> 9.43GB (13.87GB saved)
Mario Party 10 -> 4.01GB (19.29GB saved)

 

Link for the tool:

 

https://gbatemp.net/threads/wii-u-image-wud-compression-tool.397901/

 

PS: The conversion tool is a exe file alone, like Maxcso for PS2 and PSP, you just have to drag and drop your WUD file on the exe and it will convert them to Wux, I just tried that, the tool also checks for errors.

[Aorin 4,042]

Dear friends and HDD sellers, I have news for another compression.

 

I'm compressing PS2 games to CSO, it has lots of advantages over Gzip, it ends as a clean and 1 file only, it doesn't need an index file, the emulator launches it as an uncompressed iso, it saves far more space compared to an uncompressed iso, it doesn't have much difference compared to a Gz+temp file though.

I noticed that there are games that comes in Bin format, I read that PS2 has a lot of CD-Rom games, I always thought all its games were in DVD media, these CD-rom games end up in Bin, because the CD mode is different from the DVD mode.

With that, I didn't want to have CSO and Gzips, I wanted all my isos to be compressed to CSO, so I ended up finding a simple tool to make Bins become Isos, and now they can all become CSO.

 

If you are interested too, you can get PS2 Bin to Iso program here:

http://psx-scene.com/forums/content/pc-tool-ps2-iso2bin-v0-1-krat0s-4076/

 

It's intended only for PS2 games that were released in CD-Rom medias, they all end up in Bin, instead of Iso, it won't work for any other bins for any other console.

I tested and it works flawlessly, all songs, everything should be fine, but anyway, I can't run all the games till the end, but I believe everything is fine.

[alcoatjez 159]

Thanks a lot for this topic. I found out a lot of new and useful information.

Personally, I only like compression formats that can be reversed. I'm busy with my GameCube set ATM and looking into GCZ compression.

 

Can someone please compress one of their GameCube ISOs with Dolphin to GCZ and post the crc32 of the ISO and GCM?

I'm wondering if this produces the same file every time. If it does, I can create a clrmamepro datfile for the complete GCM set that people can re-create.

 

Thanks

 

[Aorin 4,042]

It's really hard to know that, I'm posting mine anyway, I never cared about CRCs since we have so much sources to get content from, if I dump a GC disc to iso in my PC will it have the same CRC as from other person that dumped it too?

Anyway, I used a gui tool to calculate CRCs so you can make sure if it creates the same CRC when compressed to GCZ.

http://esrg.sourceforge.net/utils_win_up/md5sum/

 

Files to signature:  1.

--------------------

[001/001] \HyperSpin\Roms\Nintendo GameCube\Super Mario Sunshine (USA).gcz

Size: 1,416,728,028

CRC-32: ECD87C41

MD-5: 0edf1ec830b4db523e154a60700ec989

-------------------- FILE SIGNATURE COMPLETE --------------------

[alcoatjez 159]

Aorin: Thank you very much!

Your file matches mine perfectly. I never expected that, but it's pretty cool.

 

This is the way verifications work when dumping ROMs and ISOs: 2 people dump a game and if they match 100% it is a known good dump.

For GameCube, you know you have a good dump when it's on this list. All GameCube XML entries can be checked there, with the exception of the unlicensed Maxplay game.

So, to answer your question: yes, if two people dump the same game, it will have the same CRC32.

 

For me, it is important to have good dumps or compressed dumps that can be restored again. The main reason is that I don't want to cause emulation problems just because my dump is bad. Now when I have an emu problem, I know it's the emulator

[Aorin 4,042]

Aorin: Thank you very much!

Your file matches mine perfectly. I never expected that, but it's pretty cool.

 

This is the way verifications work when dumping ROMs and ISOs: 2 people dump a game and if they match 100% it is a known good dump.

For GameCube, you know you have a good dump when it's on this list. All GameCube XML entries can be checked there, with the exception of the unlicensed Maxplay game.

So, to answer your question: yes, if two people dump the same game, it will have the same CRC32.

 

For me, it is important to have good dumps or compressed dumps that can be restored again. The main reason is that I don't want to cause emulation problems just because my dump is bad. Now when I have an emu problem, I know it's the emulator

Nice that it helped, I'm surprised it matches your CRC too, I believe all compressed isos can be reverted, PBPs, GCZs, CHDs, CSOs, and so on are all known compressions that can be reverted to bin or iso again.

[Tomkun 160]

By the way, Dolphin does not support CSO.

[phantasy 60]

Anyone have the best compression (even if it is non native zip,7z) options for Saturn, CD-I, 3DO, Commodore CDTV, Commodore Amiga CD32, Sega CD, and NEC Turbografx-16-CD?

[Aorin 4,042]

Anyone have the best compression (even if it is non native zip,7z) options for Saturn, CD-I, 3DO, Commodore CDTV, Commodore Amiga CD32, Sega CD, and NEC Turbografx-16-CD?

As far as I know, if you don't want to zip or 7zip isos for the systems you mention here, your only bet would be to compress them in NTFS, but I don't know how much space you'd spare using NTFS compression, you could try with some isos after the compression, comparing and seeing if it will worth keeping this way or not.

[JoyStickKilla 130]

What is best compression? Most space saved, quickest to decompress, etc?

[Tomkun 160]

Rar5 seems to give the best performance/compression ratio.

[phantasy 60]

This topic is fantastic. Just converted a Dreamcast title by unzipping its gdi file + bunch of .bin ones into the same folder as the conversion tool.  Double click and voila!  I got a new file called "4 Wheel Thunder (USA).gdi.chd". I should point out that Rocketlauncher didn't see this file until I removed '.gdi' from the filename and called it "4 Wheel Thunder (USA).chd" which it then recognized and booted up fine.  Expecting I have to then batch process them through a renamer that edits this out or am I missing something?  All the same, THANK YOU for this thread and to the creators of this!!

 

Also a tutorial I found called "How to Play Dreamcast Games on Android" states terminology I don't know about yet... "The acceptable game formats for Reicast are: gdi, cdi, chd (compressed images, only chd images up to version 4 are supported, chd version 5 images are NOT supported).

 

Anyone know about chd having versions and how to avoid any pitfalls with potential compatibility issues?

 

UPDATE: Also, does anyone rezip the chd files into Rar5 or does that just get crazy?  Finally, can chds be renamed like any rom or are all the named bin files, etc stored within in a way that would mess up the data read?

Example: If I take the gdi and many bin files from Ecco the Dolphin - Defender of the Future (USA) (En,Fr,De,Es) and make a chd of the same name, can I rename it to Ecco the Dolphin - Defender of the Future (USA).chd without consequence?

[phantasy 60]

Found a great renaming command for Windows users:

 

Open Powershell from you start panel.

 

"CD" command over to your directory of files ending in .gdi.chd

 

Type the following:

Dir | Rename-Item –NewName { $_.name –replace “.gdi.chd“,”.chd” }

 

Hit enter

 

You should now have everything renamed without ".gdi" in it.

[phantasy 60]

Sorry for the trilogy of me here. I found this tutorial for Philips CD-i here (you don't need to know french):

 

 

Using the batch utilities of this thread, I messed around with a copy of the .bat to try to simply do batch chd conversion for CD-i but can't get it to work. Anyone know a successful way to tweak the linked tutorial?

[SkyHighGam3r 213]

I only have a couple of CD-i images at the moment, and I haven't gotten RetroArch to play those yet... but I'll have to play with this in the future. I'm in the middle of converting my mess of a playstation library into PBPs finally.

Plus I'm getting married tomorrow and will be away until like the 18th haha.

I think I need to update this front page too with a bit of info...

[tonesmalone 577]

I only have a couple of CD-i images at the moment, and I haven't gotten RetroArch to play those yet... but I'll have to play with this in the future. I'm in the middle of converting my mess of a playstation library into PBPs finally.

Plus I'm getting married tomorrow and will be away until like the 18th haha.

I think I need to update this front page too with a bit of info...

Good luck for the wedding dude! Hope you have a great day!!

Sent from my iPhone using Tapatalk

[annunaki12 38]

Hello

I tested and converted ps1 games to PBP and i have mixed results some games not working like *diablo, worms world party, etc 

Used last retroarch mednafen core

I want to know if someone have the same problem or i am doing something wrong

[Aorin 4,042]

1 hour ago, annunaki12 said:

Hello

I tested and converted ps1 games to PBP and i have mixed results some games not working like *diablo, worms world party, etc 

Used last retroarch mednafen core

I want to know if someone have the same problem or i am doing something wrong

Yeah you're right, maybe we should get together these rare titles that won't work in PBP and make a list, so that people compressing to PBP will be aware since the start.

I don't have and don't plan having the PSX full set here, but I have plenty of titles, including Japanese games.

In my collection, I have five or six titles that won't work in PBP, they are:

Castlevania - Symphony of the Night (USA)

Diablo (USA)

Road & Track Presents - The Need for Speed - (USA)

Road Rash - Jailbreak (USA)

Worms World Party (USA)

All are in Bin+Cue format.

[annunaki12 38]

Thanks Aorin for confirming

Here two more that are not working;

F1 Racing Championship (USA)

FIFA - Road to World Cup 98 (USA)

[OneBadVeggie 6]

Hey, in my experience sometimes the games don't convert correctly on the first try. If you still have you cue/bin version of those games, I'd compress it again and test again.

I just tested my copy of Symphony of the Night, which I have as a PBP and it works perfectly fine. Using Retroarch Mednafen core.

 

EDIT: I also just tested Diablo, and can confirm it works as cue/bin but does not work as PBP. So there definitely needs to be some testing.

[annunaki12 38]

Yes Diablo works fine as cue/bin only converted to PBP not working 

I tested Diablo with other compression level with same result

My  Castlevania - Symphony of the Night (USA) is working to on PBP

[mcgeezer 0]

On 24/05/2016 at 9:52 PM, Aorin said:

You still should try Iso Buster, the Free and Pro versions don't differ too much, actually the trial/free version will ask you to register from time to time, and in between the batch process, nothing you can't handle.

If it helps someone, I had to use IsoBuster to convert the entire PSX set (About 1800 titles)... 

To enable Iggy's batch to work with the free version of IsoBuster you can use this simple AutoIt script to acknowledge the prompt.

You can download Autoit at https://www.autoitscript.com, simply but the script in the SciTE editor, build and run.

--- SNIP ---

while 1
    ;Local $hWnd = WinWaitActive("[TITLE:IsoBuster Professional]", "", 10)

   Local $hWnd = WinWait("IsoBuster Professional")

    ; Activate the Notepad window using the handle returned by WinWait.
    WinActivate($hWnd)

    Send("{LEFT}")
    Send("{ENTER}")
Wend

--- SNIP ---

PS. If I had other uses for IsoBuster I would have actually purchased a license - please consider buying a license if you have other regular uses for it (I didn't).

[Aorin 4,042]

Hey @SkyHighGam3r, can you update the first post?

For some time now we can compress images from systems like Sega CD, NEC PC Engine-CD (TG-CD as well), Sega Saturn, PS1 and NEC PC-FX all to CHD.

The only system I have active that lacks compression so far is Panasonic 3DO.

[thatman84 1,319]

I left him a little reminder in the OP