Announcement

Collapse
No announcement yet.

What kind of compression would be best?

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • What kind of compression would be best?

    Hi,

    I need some advice from those of you that have worked with compression.

    I have a file consisting of seven 6 byte strings in a comma seperated text file. The files are approx 6-8 GB each. (all the data in the file is numbers: 6 digit, 6 digit, 6 digit, 6 digit, 3 digit, 3 digit and 3 digit. The 6 digit numbers can be positive and negative. The 3 digit numbers are RGB codes.).

    I am going to convert the file so that it consists of 4 longs and 3 bytes. It will be sufficent to store the data. I'll write it to a binary file which should reduce the filesize a bit.

    Now for my question:

    What would be the best way to compress the file in order to transfer it over the internet? And what kind of ratio should I hope for?

    Thank you for taking the time,
    Gian
    Last edited by Gian Kolbjornsen; 3 Nov 2009, 05:10 PM.

  • #2
    http://www.powerbasic.com/support/pb...ad.php?t=32614
    Michael Mattias
    Tal Systems (retired)
    Port Washington WI USA
    [email protected]
    http://www.talsystems.com

    Comment


    • #3
      http://www.powerbasic.com/support/pb...ad.php?t=41101

      False positive on the virus.

      James

      Comment


      • #4
        http://www.7-zip.org
        There are quite a few other sites with 7Zip

        If many duplicates a sort and passing unique record numbers could be considered.
        How long is an idea?

        Comment


        • #5
          Gian, I have a compression algorithm for the data you show that does effectively maximum possible compression and is faster than say Winzip "Superfast" selection, but I have a question: do the six-digit numbers always have 6 digits, eg. -654321, or can they be eg. -3454? Or might they be -003456?

          Comment


          • #6
            6 digit, 6 digit, 6 digit, 6 digit, 3 digit, 3 digit and 3 digit.....
            I am going to convert the file so that it consists of 4 longs and 3 bytes.
            Not all three digit numbers will fit in a byte.

            > The 3 digit numbers are RGB codes..

            Well, these particular 3 digit numbers will, as long as they stay in the range 0x00 thru 0xFF.

            When I see "read values from file" and I did not create that file, I always have my doubts. I've just seen too many examples of "that which can never happen" happen.

            MCM
            Michael Mattias
            Tal Systems (retired)
            Port Washington WI USA
            [email protected]
            http://www.talsystems.com

            Comment


            • #7
              Originally posted by Michael Mattias View Post
              No I always have my doubts. I've just seen too many examples of "that which can never happen" happen.

              MCM
              Oh, what a weary weary world we live in today.{sound of big breath tiredly and effortly expelled}.

              ===========================================
              "What do you take me for, an idiot?"
              General Charles de Gaulle (1890-1970),
              when a journalist asked him if he was happy
              ===========================================
              Last edited by Gösta H. Lovgren-2; 6 Nov 2009, 11:21 AM. Reason: added ennui
              It's a pretty day. I hope you enjoy it.

              Gösta

              JWAM: (Quit Smoking): http://www.SwedesDock.com/smoking
              LDN - A Miracle Drug: http://www.SwedesDock.com/LDN/

              Comment

              Working...
              X