XeNTaX

Say, does anyone know how people create the filelists for unpackers?

I've been trying to figure this out myself but no amount of messing around in the .BIGs or the .exe turned up the names of those missing files. How did he do it in the first place?

Animation - FULL
AnimationNIS - FULL
Characters - 4310/4384
CharactersHD - FULL
Game - 5700/5748
GameHD - FULL
GameHD2 - 2858/2905
Global - 1165/1332
UI - 3454/3960
Vehicles - FULL

Hm, according to info.txt there's 74 unknown files in Characters.big. One of those must be vital to the game function since it crashes without it.

Data\Characters\CharacterRigs.bin
Data\Characters_New\18k_B_100.perm.bin
Data\Characters_New\18k_B_100.temp.bin
Data\Characters_New\18k_B_100_TS0.perm.bin
Data\Characters_New\18k_B_100_TS0.temp.bin
...

And in Character.list there's a giant list of filenames, I assume the unpacker takes the names from here.

So I just need to locate the names of those 74 missing files and add them to here. Question is, how the heck am I supposed to find those names? There's nothing in the exe, and the .bix file is filled with gibberish.

EDIT:



Well, here's one of them.



I went to the labeled offset in the .big file, but that's not very helpful either. This is clearly a texture.perm.bin. But where's that dang filename?

EDIT:

Falo wrote:*.bix is a simple format, but as always with Square Enix Games most of it uses hash's instead of real filenames,

Welp, there goes that. I really wish I didn't have the intelligence of a potato when it comes to these things.

Okay, I'm stupid. Ignore my entire previous post, cra0 was nice enough to explain this process to me.

For everyone else, Ekey made a convenient hash calculator. That's what they used, and I'll use it too. I swear to god I WILL find those 74 file names, even if it takes me all year!

Um, okay. I've been having some real trouble with this as always, and then I found something interesting.
All the files have some clue inside as to their filenames, but no matter what I tried I couldn't seem to match up the generated hash to the original.

Then I tried a file that already had a filename assigned.



The unpacker assigned this file the name 18k_BrawlerA01_Glasses.perm.bin, which more or less matches up with the name inside.

Yet the hash for that name is completely different.



Well no wonder I was having so much difficulty. Either I'm misunderstanding the point of this program or it's simply outdated/not meant for this purpose.


Also, cra0 recommend I try dumping the exe, but that did nothing. The dumped exe was almost identical to the original. Anyone know any other methods?

EDIT: Oh, who am I kidding, I'm the only one who reads this thread. Maybe when November rolls around the HD remake of the game will attract some people.

SergeantJoe wrote:Um, okay. I've been having some real trouble with this as always, and then I found something interesting.
All the files have some clue inside as to their filenames, but no matter what I tried I couldn't seem to match up the generated hash to the original.

Then I tried a file that already had a filename assigned.



The unpacker assigned this file the name 18k_BrawlerA01_Glasses.perm.bin, which more or less matches up with the name inside.

Yet the hash for that name is completely different.



Well no wonder I was having so much difficulty. Either I'm misunderstanding the point of this program or it's simply outdated/not meant for this purpose.


Also, cra0 recommend I try dumping the exe, but that did nothing. The dumped exe was almost identical to the original. Anyone know any other methods?

EDIT: Oh, who am I kidding, I'm the only one who reads this thread. Maybe when November rolls around the HD remake of the game will attract some people.

I don't have much to add to your question... but I'll propose another question, even though it may make no sense and be totally wrong. Is it possible that the "hash" is an offset address for fat packed file?

I don't really know. From what I've gathered hash refers to that random string of numbers and letters, and that's what the archive stores the file names as. The offset is a separate thing.




Wait, fat archives? You're probably thinking of this instead.

SergeantJoe wrote:I don't really know. From what I've gathered hash refers to that random string of numbers and letters, and that's what the archive stores the file names as. The offset is a separate thing.




Wait, fat archives? You're probably thinking of this instead.

lol, yes... my bad, wrong thread.

I figured there would be confusion eventually. Too many dogs at once!

In any case, I think I'll just not bother with the hashes and throw filenames into the list willy nilly. It's bound to work eventually right?

SergeantJoe wrote:EDIT: Oh, who am I kidding, I'm the only one who reads this thread. Maybe when November rolls around the HD remake of the game will attract some people.

I'm still following
However, I'm don't think it will work. As I've said in a previous post, even extracting only one archive with 100% known names will crash the game.

They're doing a HD remake?? PC too or just nex-gen consoles?

Wait, you are? I thought you quit with this a long time ago.

Chipicao wrote:They're doing a HD remake?? PC too or just nex-gen consoles?

http://forums.sleepingdogs.net/viewtopic.php?f=2&t=4983

It's pretty much just a rumor right now, but I really hope it happens. The textures need improvement desperately.

Chipicao wrote:However, I'm don't think it will work. As I've said in a previous post, even extracting only one archive with 100% known names will crash the game.

Not necessarily. I've unpacked Animation, AnimationNIS and CharacterHD simultaneously and it works perfectly. Simply unpack it, rename or delete the big/bix files, then merge the two Data folders.

With Vehicles the game runs and loads, but crashes at seemingly random points. Interestingly the actual vehicles work, but they seem to have corrupted textures.

If you unpack Characters the game runs, but crashes as soon as it tries to load the world. I just don't understand that, from what I've seen the only missing files are just models and textures.
If a model file is missing from CharactersHD, it'll simply be not there, and the rest of the game will work fine. Yet if a model file is missing from Characters it will crash the whole thing. I just don't get it.

The crashes are not really random, it only crashes when certain vehicles are loaded. The randomness is only in the vehicle spawning.
This suggests that the game can load some unpacked files, but fails to load others.

I assume the same thing happens with Characters, but it crashes every time probably because it's Wei Shen's files that fail to load.

As for Animation, AnimationNIS and CharacterHD, have you considered that maybe you just haven't encountered a situation which required one of the missing files? Or perhaps the game simply ignores it?

It all comes down to how the game handles such errors internally.
In case of textures that are missing or fail to load, it simply won't display them, as you've pointed out with characters and vehicles.
But for other files, such as 3D data, it will crash.

So the behavior actually makes sense. The question is why does it fail to load some but not all files. Is there an error in the extracted paths or filenames? Or maybe there's a limit to the number of files it can load simultaneously? Or what?

Wei's files are all there. The stuff that's unknown is just a bunch of random props like those glasses and DLC stuff like the golden cleaver.

Chipicao wrote:The crashes are not really random, it only crashes when certain vehicles are loaded. The randomness is only in the vehicle spawning.
This suggests that the game can load some unpacked files, but fails to load others.

True. There's obviously more issues with the unpacker than expected.

Chipicao wrote:As for Animation, AnimationNIS and CharacterHD, have you considered that maybe you just haven't encountered a situation which required one of the missing files? Or perhaps the game simply ignores it?

No, those three have no unknown files, those are all good.

But that's the thing. I'm assuming it crashes because it can't load some vital file, but then we have this odd behavior.
Animation, AnimationNIS, CharacterHD, and Vehicles all have no unknown files. The first three work perfectly but Vehicles doesn't. Why do vehicle files cause crashes but character models and animations don't? I just don't understand.

EDIT:

Animation - FULL
AnimationNIS - FULL
Characters - 4310/4384
CharactersHD - FULL
Game - 5700/5748
GameHD - FULL
GameHD2 - 2858/2905
Global - 1165/1332
UI - 3454/3960
Vehicles - FULL

Also, GameHD has no unknown files as well. I tired unpacking that, everything ran smoothly. I drove all over the city, no errors or crashes.

Then I tried Animation, AnimationNIS, CharacterHD and GameHD, all at once, everything worked just fine. That's nearly 4800 unpacked files it had to load, and I did notice it took slightly longer to launch.

No, you don't understand.

What I'm saying is that even though we supposedly have the names for Wei's files, the game still fails to load them.
The same goes for Animation, AnimationNIS, CharacterHD, and Vehicles. Having the correct filenames doesn't necessarily mean they will also work.

Define "work perfectly". Have you tested every single animation available for every single character in-game? There must be hundreds, maybe thousands.
Just because the game doesn't crash doesn't mean it manages to load all of the unpacked files. The proof is in those missing textures you posted yourself. It's easy to see a missing texture, not so easy to see a missing animation.

Chipicao wrote:What I'm saying is that even though we supposedly have the names for Wei's files, the game still fails to load them.
The same goes for Animation, AnimationNIS, CharacterHD, and Vehicles. Having the correct filenames doesn't necessarily mean they will also work.

I get what you're saying here. I sort of assumed the filenames were all correct, but of course just because it works for one doesn't mean it'll work for the rest. Explains the funkiness with Vehicles.

Chipicao wrote:Define "work perfectly". Have you tested every single animation available for every single character in-game? There must be hundreds, maybe thousands.
Just because the game doesn't crash doesn't mean it manages to load all of the unpacked files. The proof is in those missing textures you posted yourself. It's easy to see a missing texture, not so easy to see a missing animation.

I've been playing the game for quite some time this way. Completed most of the missions and sat through all the cutscenes, I didn't see anything wrong.

Only time I saw errors is where I deliberately removed files. The image of Wei's missing head was caused by me manually removing his head file from CharactersHD. Here's another resulting from a manual removal of animations.
Heck, you could create a cheatmod by removing the attack animations from enemies.

Although you're right, I still haven't completed every last one.
I've been meaning to sit down and do a full playthrough on the PC for a while now, this way I can do that and make sure it runs properly at the same time. If I come across a crash or an error it'll be easy to tell which file is causing it.

For find new names you need dump some memory regions not exe