The Wonderland Board

I compressed a setup file for my Hub project, and the .zip file was larger than the actual file I was compressing!

DEEMAN223344 wrote:I compressed a setup file for my Hub project, and the .zip file was larger than the actual file I was compressing!

LOL, that IS weird. Although all lossless compressions (including zip) will have some kinds of data that do become larger after "compressing".

‎

Emerald141 wrote:How does compression work, anyway? Do the individual bytes somehow become smaller?

Bytes are 8 bits each and that does not change. You meant "symbols", right?

Lossless compression works by rewriting the data in a way that allows the original to be restored, but it's smaller than the original.

General compression algorithms are usually fairly complicated, but the idea can be explained on two simple to understand methods: byte-pair encoding and run-length encoding. I'll demonstrate with symbols, it's easier to understand.

Byte-pair encoding:

Suppose we have a string that looks like this:

AABAACDBAEAAFAAGAAHAA

The "AA" pair appears more often than any other pair. So we replace it with a symbol that isn't yet there in the string. An additional sequence is written as a "table of replacement".

Z=AA
ZBZCDBAEZFZGZHZ

Not very effective here, but in longer examples it can sometimes work miracles. Still, it's fairly limited.

Run-length encoding:
Suppose we have a string like this:

DDDDrrrRRRddddddrrrRRuuuLrrrUULLL

That can be imagined as a solution for a box pushing puzzle, Up Down Left Right, big letters for pushing, small levels for just moving.

Now we do this:
4D3r3R6d3r2R3uL3r2U3L

In both cases, it's perfectly restorable but it is shorter... compression.

One other method is supposedly REALLY popular as something programs do AFTER applying their own methods... so it's kinda important for all file compressors, but... this one is more complicated. Maybe it's the fact that I'm ill right now, but... I don't really get it.

Anyway, it's here: http://en.wikipedia.org/wiki/Huffman_coding

Another thing: WHAT IS MAKING THESE HUB PROJECTS SO HUGE!?
MOMII was only 86 MB compressed.
My new (and shorter) project is....
*drumroll*

THIRTY GIGABYTES, EVEN WHEN IN A .ZIP.
Strange thing is, MOMII BETA is not only longer than MOTLWL DEMO 1, it had a_lot_of unnecessary .exe files, while MOTLWL does not.
WHY IS IT SO GIGANTIC?!

Yikes!

That's more GB than how much my old computer could hold!

it is indeed large, that is a fact.
Why is it so big?

What do you have inside it? List the biggest items may help.

EDIT: From what I saw, the huffman thing calculates the frequency of a letter in a document before compiling it into a proper 'archive'. If a letter, for example, 'a', existed so many times, the program replaces 'a' with a bit. The letter 'z' appeared the least, the program replaces 'z' with at most 25 bits (note: not 26 because of 0). Each letter, at usual, takes 1 byte (8 bits), but using huffman's thingy (xD), 'a' only takes 1 bit (1/8) while 'z' takes 25 (25/8 -> 3.studIo wait I mean something). This effictively selectively compress letters that appeared the most.

FUNFACT: Usually the most appeared 'letter' is not letters, but space.

Edited by tyteen: merged post~ *whistles away*

As far as I know, the biggest things are the Hub, Player Profiles, Wonderland.exe, and wg.exe.

That's a lot. You should try .7z or .rar. Maybe that'll be better?

Quick question, why are the .exe's in the zip to begin with? Just wondering.

Because I was too lazy to take them out.
It's the demo's .exe files anyway, and you HAVE TO know about MS's site to find this forum anyway (also why the editor is free, but only here).

DEEMAN223344 wrote:Another thing: WHAT IS MAKING THESE HUB PROJECTS SO HUGE!?
MOMII was only 86 MB compressed.
My new (and shorter) project is....
*drumroll*

THIRTY GIGABYTES, EVEN WHEN IN A .ZIP.
Strange thing is, MOMII BETA is not only longer than MOTLWL DEMO 1, it had a_lot_of unnecessary .exe files, while MOTLWL does not.
WHY IS IT SO GIGANTIC?!

You can try compressing all wdf by editing in pic manager, saving it as JPG and renaming it to wdf (first delete or move original to some location)
You can also use FASTEST option while compressing using WINRAR etc

Guppy Star wrote:You can try compressing all wdf by editing in pic manager, saving it as JPG and renaming it to wdf (first delete or move original to some location)
You can also use FASTEST option while compressing using WINRAR etc

the first one probably won't work. the picture managers i use save jpg's at full quality, uncompressed. plus, jpg's aren't good for compression.
using the fastest option while compressing will make the file bigger. i don't see why anyone would do that.

Tip to all hub packagers: Only include files that were changed/added in your package. Always make notes of what files you edited in each stable revision.

A revisioning system could do it for you, unfortunately they don't really support binary files well.

~xpr'd~ wrote:

Guppy Star wrote:You can try compressing all wdf by editing in pic manager, saving it as JPG and renaming it to wdf (first delete or move original to some location)
You can also use FASTEST option while compressing using WINRAR etc

the first one probably won't work. the picture managers i use save jpg's at full quality, uncompressed. plus, jpg's aren't good for compression.
using the fastest option while compressing will make the file bigger. i don't see why anyone would do that.

Depends on the file you use
If there is only one file of large size, the RAR/ZIP size increases
If there are lots of small files of total 100MB size perhaps, the fastest option compresses it up to 60 above MB

EDIT: 60 MB or a little above - made a mistake earlier

Edited by tyteen: merged post

DEEMAN223344 wrote:Another thing: WHAT IS MAKING THESE HUB PROJECTS SO HUGE!?
MOMII was only 86 MB compressed.
My new (and shorter) project is....
*drumroll*

THIRTY GIGABYTES, EVEN WHEN IN A .ZIP.

DEEMAN223344 wrote:Strange thing is, MOMII BETA is not only longer than MOTLWL DEMO 1, it had a_lot_of unnecessary .exe files, while MOTLWL does not.
WHY IS IT SO GIGANTIC?!

DEEMAN223344 wrote:DEMO 1

DEEMAN223344 wrote:DEMO 1

*imagines the size of the full project*

Muzozavr wrote:

DEEMAN223344 wrote:Another thing: WHAT IS MAKING THESE HUB PROJECTS SO HUGE!?
MOMII was only 86 MB compressed.
My new (and shorter) project is....
*drumroll*

THIRTY GIGABYTES, EVEN WHEN IN A .ZIP.

DEEMAN223344 wrote:Strange thing is, MOMII BETA is not only longer than MOTLWL DEMO 1, it had a_lot_of unnecessary .exe files, while MOTLWL does not.
WHY IS IT SO GIGANTIC?!

DEEMAN223344 wrote:DEMO 1

DEEMAN223344 wrote:DEMO 1

*imagines the size of the full project*

^
With what I'm planning, it may be OVER NINE THOUSAND GB!!!!!!
=9.01 Terabytes.

Just to make sure, are you sure you're reading it correctly? WA and MoFI combined isn't even one GB to begin with.

OH! It's thirty MB, not GB. Silly me.

DEEMAN223344 wrote:OH! It's thirty MB, not GB. Silly me.

Still, glad to know it isn't REALLY this large!

I misread KB as MB.
IF it WAS 301,660 MB, I'd be scared.

When I read that I saw(in my head, of course) you sitting in front of a computer, and the screen exploded and a bunch of 0s and 1s spewed out.

DEEMAN223344 wrote:OH! It's thirty MB, not GB. Silly me.

Well, glad to know it's fine.

DEEMAN223344 wrote:OH! It's thirty MB, not GB. Silly me.

Try figuring that out

Technos72 wrote:

DEEMAN223344 wrote:OH! It's thirty MB, not GB. Silly me.

Try figuring that out

The image name already spells out the answer.

The image name already spells out the answer.

I didn't even think of that, but I found it on a picture of the deaf-language alphabet.

(Notice: Mind your language, even it is not English.)
But anyways, 30MB makes much more sense to me.

My reaction:

DEEMAN223344 wrote: THIRTY GIGABYTES, EVEN WHEN IN A .ZIP.

DEEMAN223344 wrote:OH! It's thirty MB, not GB. Silly me.

Oh.

Nice one. When I saw it I was like, wait no, not possible!
When I read it was MB I was like, O ok.