Important information: this site is currently scheduled to go offline indefinitely by end of the year.

Any other tutorials like "Guide To Exploring File Forma

Read or post any tutorial related to file format analysis for modding purposes.
Mr.Mouse
Site Admin
Posts: 4073
Joined: Wed Jan 15, 2003 6:45 pm
Location: Dungeons of Doom
Has thanked: 450 times
Been thanked: 682 times
Contact:

Re: Any other tutorials like "Guide To Exploring File Forma

Post by Mr.Mouse »

I have no idea, the OneStat is a mere pagecounter. http://www.onestat.com
User avatar
xrevenge
veteran
Posts: 119
Joined: Thu Jun 05, 2008 3:46 pm
Been thanked: 9 times

Re: Any other tutorials like "Guide To Exploring File Forma

Post by xrevenge »

Mr.Mouse wrote:I have no idea, the OneStat is a mere pagecounter. http://www.onestat.com
umm...bad news?
I got the onestat cookie again:
You do not have the required permissions to view the files attached to this post.
Mr.Mouse
Site Admin
Posts: 4073
Joined: Wed Jan 15, 2003 6:45 pm
Location: Dungeons of Doom
Has thanked: 450 times
Been thanked: 682 times
Contact:

Re: Any other tutorials like "Guide To Exploring File Forma

Post by Mr.Mouse »

I still don't think that is harmful.
User avatar
xrevenge
veteran
Posts: 119
Joined: Thu Jun 05, 2008 3:46 pm
Been thanked: 9 times

Re: Any other tutorials like "Guide To Exploring File Forma

Post by xrevenge »

Mr.Mouse wrote:I still don't think that is harmful.
if you say so Mr.Stuart (no intent on being rude)
Mr.Mouse
Site Admin
Posts: 4073
Joined: Wed Jan 15, 2003 6:45 pm
Location: Dungeons of Doom
Has thanked: 450 times
Been thanked: 682 times
Contact:

Re: Any other tutorials like "Guide To Exploring File Forma

Post by Mr.Mouse »

That's okay. ;)
User avatar
Corwin
beginner
Posts: 21
Joined: Mon Sep 28, 2009 7:52 pm
Location: Amber
Has thanked: 11 times
Been thanked: 5 times

Re: Any other tutorials like "Guide To Exploring File Forma

Post by Corwin »

Hmmm.... Looks like all links are completely dead.... Actually i'm looking for some guide[AND/OR]tutorial on how to reverese games themselfes (for example when you want to know which encryption/compression used in package). Google doesn't talk much about reverse engeneering, probably i'm asking him wrong :)
All your packages is belong to us!
User avatar
aluigi
VVIP member
VVIP member
Posts: 1916
Joined: Thu Dec 08, 2005 12:26 pm
Location: www.ZENHAX.com
Has thanked: 4 times
Been thanked: 664 times
Contact:

Re: Any other tutorials like "Guide To Exploring File Forma

Post by aluigi »

the problem is that it's not a matter of guides but of practice.
for example the symmetric encryption algorithms (ecb versions, so without ivec) can be usually recognized because if the file has a series of identical bytes (for example 16 or 32 zeros) you can see the same pattern repeated inside all those pseudo-garbage bytes.
but the fact that you have an idea abou the algorithm doesn't help to figure it, in that case it's needed debugging and signsrch.

for the xor/rot related obfuscations instead it's a bit different because the xor key or the xor byte is visible when there are sequences of zeros, otherwise if in doubt I use a quick scanner which tests and visualizes the data after having passed it with all the bytes from 0x00 to 0xff.

the rest is practice, for example during the debugging you see a strange algorithm which uses 16 bit registers and then you say "uhmmm I have already worked with something similar some years ago" and then you see that it's the IDEA algorithm and so on.

other helps could come from the semi-debug messages of the executable (like happened with Shift for XMemDecompress) but it's something not much common.

obviously this was for the encryption part, because for the fields of the archive it's just a matter of hex editor and calculator
Mr.Mouse
Site Admin
Posts: 4073
Joined: Wed Jan 15, 2003 6:45 pm
Location: Dungeons of Doom
Has thanked: 450 times
Been thanked: 682 times
Contact:

Re: Any other tutorials like "Guide To Exploring File Forma

Post by Mr.Mouse »

http://wiki.xentax.com/index.php/DGTEFF You can still read that if you need a place to start. There's also a piece on my reverse engineering of the Painkiller XOR encryption algorithm.

But in general, it's like Bugtest said: practice and I would say experience.

I've spend thousands of hours on figuring out file formats be simply using a hex editor and a calculator (preferably one that has hexadecimal numbering functions as well).

When I was at Craptain's place some years ago, he saw me do it on a new file and was amazed by the speed by which I figured it out, but really,that was the years of experience doing the job, you start to spot immediately the structure of the standard formats.

You must look at it as a game, a puzzle. You will come across difficult ones, but even the more the satisfaction of demystifying it.

Yet, it all starts with a hex editor and a calculator.
User avatar
Corwin
beginner
Posts: 21
Joined: Mon Sep 28, 2009 7:52 pm
Location: Amber
Has thanked: 11 times
Been thanked: 5 times

Re: Any other tutorials like "Guide To Exploring File Forma

Post by Corwin »

I have no problems with just extracting files. Hex editor + win calc in engineer mode + some logic. That's right. But extracted files without knowlege of their format are useless.

I'm looking for a way to discover what exactly the given "game.exe" doing with some file in archive in order to decompress/decrypt it. Is there any specific soft for such research? I've heard about debuggers, disassemblers, decompilers... But info is smooth and not even about games..

So my question is - what tools to use to work with "game.exe", not with package ^__^
All your packages is belong to us!
Mr.Mouse
Site Admin
Posts: 4073
Joined: Wed Jan 15, 2003 6:45 pm
Location: Dungeons of Doom
Has thanked: 450 times
Been thanked: 682 times
Contact:

Re: Any other tutorials like "Guide To Exploring File Forma

Post by Mr.Mouse »

Disassemblers, eg OllyDbg, Ida Pro etc
User avatar
aluigi
VVIP member
VVIP member
Posts: 1916
Joined: Thu Dec 08, 2005 12:26 pm
Location: www.ZENHAX.com
Has thanked: 4 times
Been thanked: 664 times
Contact:

Re: Any other tutorials like "Guide To Exploring File Forma

Post by aluigi »

uhmmm I can list what I use in general, maybe it's useful also to other people interested in the reversing of file formats:
- ollydbg: the debugger
- xvi32: the hex editor, it's unsupported, not much optimized and with some bugs but it's confortable
- signsrch: to know the algorithms used in the executable and knowing where to set the breakpoints for verifying them
- calcc: the only calculator I use
- byte2hex/hex2byte/byte2c: for converting the various dumps of memory/files/pieces of data in various formats, very used
- offzip: to scan the archive if contains zlib or deflate data blocks
- some small testers of common algorithms like lzo, lzss, lzw and blast
- findxor: for scanning various xor and rot values
- mycrc: sometimes for confirming if a field is a crc/hash
- fcomp: for comparing some results like the uncompressed data obtained by me and the correct one obtained by the game
- xor: for verifying a xor key or retrieving it from a xored and plain-text data
- quickrva: used in some occasions but it's not useful when reversing formats
- chd: used only to know the hex values of some strings on the fly
- something else that I have forgotten as usual
MuffinMan123
beginner
Posts: 39
Joined: Fri Feb 25, 2011 3:36 am
Has thanked: 1 time
Been thanked: 2 times

Re: Any other tutorials like "Guide To Exploring File Forma

Post by MuffinMan123 »

Rheini can you upload the file again? I missed the file by 2 years but I really want to get into this stuff.
or if any one still have the file, do you mind mirroring it? thanks a lot
User avatar
Dinoguy1000
Site Admin
Posts: 786
Joined: Mon Sep 13, 2004 1:55 am
Has thanked: 154 times
Been thanked: 163 times

Re: Any other tutorials like "Guide To Exploring File Forma

Post by Dinoguy1000 »

MuffinMan123 wrote:Rheini can you upload the file again? I missed the file by 2 years but I really want to get into this stuff.
or if any one still have the file, do you mind mirroring it? thanks a lot
This thread is four pages long; that's a lot of posts. It would help if you quoted the post containing the link you're talking about.
Welcome to Xentax!

Rules | Requests | Wiki | Discord

If you run across a post that breaks the rules, please report the post - a mod or admin will handle it from there.
MuffinMan123
beginner
Posts: 39
Joined: Fri Feb 25, 2011 3:36 am
Has thanked: 1 time
Been thanked: 2 times

Re:

Post by MuffinMan123 »

Rheini wrote:http://uploaded.to/?id=ce51hh
Version 4
Rheini wrote:1024bar.7z
I am assuming 1024bar is also version 4, just reuploading back in 2009, but every link is dead now.
MuffinMan123
beginner
Posts: 39
Joined: Fri Feb 25, 2011 3:36 am
Has thanked: 1 time
Been thanked: 2 times

Re: Any other tutorials like "Guide To Exploring File Forma

Post by MuffinMan123 »

so no one kept a copy of the file somewhere?
Post Reply