Need to compress some vectors?

At Luminoso, we’ve built on a ton of open source software and we’re committed to giving back to the open source community when we can, however niche those contributions may be. In this spirit, we present pack64. It’s a way to compress numerical vectors into base64 strings. It saves a bit of space over what you’d get from base64 encoding all the floating-point numbers by losing some precision on the smaller coordinates that don’t affect anything anyway. Encoding and decoding tools may be found on Github. If you’re wondering why you might need this, you probably don’t! But we send such an enormous number of vectors over networks that we needed to make this. If you find for some reason that you’re like us, maybe we can save you some time. Enjoy!

One thought on “Need to compress some vectors?

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s