XeNTaX

Posted: **Thu Jul 12, 2007 11:30 am**

So, I'm trying to extract the data from the DATA.PAK, from Puzzle Quest PSP.

But as you could possibly tell, I've had no luck

It's not a Quake .PAK file, it;s not a RAR, ZIP, or any other "normal" compression I know of.
And there doesn't seem to be any human-readable hearer or footer information regarding what compression scheme it is.

Also, inside the archive there should be:
LUA scripts
PNG images (but this could obviously be different formats)
XML data
There might be a few other files, but they will be making up the majority of them.

So, now I turn to you guys.

I've used the WATTO Archive Cutter and I can't attach the result.
So, here's a link: http://www.rocketreplay.com.au/charcoal/DATA.PAK.zip

If needed, I'm sure I could also find the space to put the whole ~80Mb file somewhere.

Thanks for the help!

-Charcoal

Posted: **Fri Jul 20, 2007 10:25 pm**

Yeah, there's definitely such files in there, see attachment. I'm trying to figure out the stream structure.

Posted: **Fri Jul 20, 2007 10:35 pm**

Right, and I think these XML files are compressed, DenizOezmen might say : 'Huffman!" ?

Looks like it has a dictionary??

Posted: **Fri Jul 20, 2007 11:37 pm**

Allright, I've cornered the structure of the file, will create a plugin for MexCom.

Posted: **Sat Jul 21, 2007 2:21 am**

Mr.Mouse wrote:Right, and I think these XML files are compressed, DenizOezmen might say : 'Huffman!" ?

I wouldn't dare suggest such a ghastly thing.

Actually, the given file is not compressed, but rather seems to be a binary representation of an XML file intended for easier parsing. This particular file is even larger than its textual representation, which the programmers could have partly avoided by not duplicating entries in the dictionary (which you have correctly identified):

Code: Select all

<?xml version="1.0"?>
  <Fonts numfonts="39">
    <Font id="0" tag="font_system" file="Assets\Fonts\System" pointsize="18" baseline="14" lineheight="0" r="255" g="245" b="235" a="255" scale="1">
    </Font>
    <Font id="1" tag="font_button" file="Assets\Fonts\WC_Button" pointsize="24" baseline="18" lineheight="0" r="255" g="245" b="235" a="255" scale="1">
    </Font>

[... 37 other font defintions ...]

  </Fonts>

Here's a tool that outputs the XML structure to the console. Usage:

Code: Select all

XMLConv font.xml

Due to the output method, it's not really useful yet and might fail with other files, since the above example does not have enough structure to identify all values within the file.

Posted: **Sat Jul 21, 2007 6:15 am**

Deniz Oezmen wrote:Actually, the given file is not compressed, but rather seems to be a binary representation of an XML file intended for easier parsing.

A similar approach is used in Age of Empires 3 and Ghost Recon 2 (*.xmb)

Posted: **Sat Jul 21, 2007 9:28 am**

Deniz Oezmen wrote: Actually, the given file is not compressed, but rather seems to be a binary representation of an XML file intended for easier parsing. This particular file is even larger than its textual representation, which the programmers could have partly avoided by not duplicating entries in the dictionary (which you have correctly identified):

Nice going!

Posted: **Mon Jul 23, 2007 11:11 pm**

Code: Select all

StandardMonstersText.xml
<?xml version="1.0"?>
  <TextLibrary>
    <Text tag="[MONSTER_MARB_NAME]">
    </Text>
    <Arboleth  Warning: node count 1 (50) does not match node count 2 (2), mightfail
 TextLibrary="TextLibrary" extLibrary="" tLibrary="" tag="[MONSTER_MBAT_NAME]" Giant Bat="Text">
      <xtLibrary  Warning: node count 1 (2) does not match node count 2 (0), mightfail
>
      </xtLibrary>
      <[MONSTER_MBAT_DESC]  Warning: node count 1 (1286) does not match node count 2 (1355), mightfail
 ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="" ="">
        <  Warning: node count 1 (1129144146) does not match node count 2 (1130320969), mightfail
Exception ERangeError in Modul XMLconv.exe bei 00004927.
Fehler bei Bereichspr

Posted: **Mon Jul 23, 2007 11:28 pm**

Okay, here's the plugin for MultiEx Commander as promised. Will open those files and extract the contents for you.

I also attach a table of contents of the PAK file.

Will post the details when I have the time.

Posted: **Tue Jul 24, 2007 12:55 am**

Mr.Mouse wrote:Guess you were on the right track at least!

And fortunately, it's not too hard to fix:

Code: Select all

<?xml version="1.0"?>
  <TextLibrary>
    <Text tag="[MONSTER_MARB_NAME]">
      Arboleth
    </Text>
    <Text tag="[MONSTER_MARB_DESC]">
      Arboleths are violent and mindless creatures of chaos. They absorb energy from enemy spells to heal themselves.  They can also use the Consume Mana spell to power the Chaos Bolt spell.
    </Text>
    <Text tag="[MONSTER_MARB_CAPT]">
      You have captured an Arboleth. Once you have built a Mage Tower in your capital city, you will be able to learn the Consume Mana and Chaos Bolt spells from this creature.
    </Text>

[... tons of descriptions ...]

  </TextLibrary>

(Actually, I still don't know more about the missing values. We simply discovered a new node type within the document.

)

Ah, and the tool now creates a separate text output file for each input ...

Posted: **Tue Jul 24, 2007 9:18 am**

And the format of the Puzzle Quest (PSP) .PAK files:

Code: Select all

// General structure:

Byte(16)		Header
Byte(n)			Resource Info Table
byte(n)			String Table
Byte(n)			Resource raw data

// Detailed structure:

// Header

uint32		Size of resource information data
uint32		Relative Offset of String Table (Size of Resource Info Table)
uint32	 	Absolute offset of Resource Info Table (Size of Header) 
uint32		Version number (1) ?

// Resource Info Table
//
// The number of variables per entry vary depends on type of entry (Folder or File)
// Folders take up 5 uint32 (or 1 uint32 and 2 uint64), Files take up three uint32. 
// As files can only have a value up to uint32, and the number of files/folders is hardly going to 
// exceed an uint32 value, it's probably save to assume that the authors only use uint32 
// values. 

uint32		Relative Offset of Resource Name in String table (starting from 0)
uint32 		IF Folder --> Number of Resources in Folder
		IF File --> Absolute Offset of Resource  
uint32		IF Folder --> Unknown (but could mean that the previous is actually an uint64). 
		IF File --> Size of Resource
uint32		IF FOLDER --> Number of SubFolders in Folder
uint32		IF FOLDER --> Unknown (but could mean that the previous is actually an uint64).

// String Table
//
// To save space, the authors have not listed full paths of each resource in the archive. 
// Instead, they saved a tree, and thus only need to save each folder and file once, 
// as a single null-terminated string. 
//
// The order is simple and also applies to the Resource Info Table obviously.
// The first node is the root ("\"). The Resource Info table tells us this node has 0 files and 2 subfolders
// If there are files or subfolders at a node, the archive lists first the files in sequence and then the folders. 
// (Again, this applies to both the Resource Info Table as the String Table)
// Once this is listed, the next resource will be the first subfolder of the current node. 
// If this too has subfolders, then the subsequent node listed will be the first subfolder of this one. 
// Once all subfolders have been listed of a given node (including any deeper files and subfolders), 
// the next-in-line subfolder of the parent node will be listed. 
// And so on....until we get back a the root node and no more folders are left.

Understandable ?

Posted: **Tue Jul 24, 2007 9:49 am**

Mr.Mouse wrote:Understandable ?

Completely. Good work!

Posted: **Wed Jul 25, 2007 10:40 am**

Thanks for all the work, but it isn't working

The Lua scripts also seem to have been "compressed", much like the xml files were.

But even if someone were to figure that out I doubt that my original plan would work, there are alot more lua scripts in the PSP version, compared to the PC demo.
AND there is a PC full version coming out.

Posted: **Wed Jul 25, 2007 10:46 am**

Charcoal wrote:Thanks for all the work, but it isn't working

The Lua scripts also seem to have been "compressed", much like the xml files were.

But even if someone were to figure that out I doubt that my original plan would work, there are alot more lua scripts in the PSP version, compared to the PC demo.
AND there is a PC full version coming out.

Exactly what isn't working?

Posted: **Thu Feb 14, 2008 11:24 am**

Thanks Mr. Mouse for a plugin for extraction gamefiles from DATA.PAK!
If I understand, your plugin only for extraction, but not for creation or saving after changes..

Could you modify this plugin, that I could save DATA.PAK after some changes?

Thanks for the help!

SHOCKeR

XeNTaX

Puzzle Quest PSP - DATA.PAK

Puzzle Quest PSP - DATA.PAK

Re: Puzzle Quest PSP - DATA.PAK