And We're Back! (Kinda Sorta)

posted Apr 24, 2012, 12:06 PM by Alexia Chang   [ updated Apr 24, 2012, 12:15 PM ]

Hello, all of our eager fans, I am writing for Herb and Hc today because they are away on personal trips. We have all been going through some tough times... marriages and divorces, employment and layoffs, abortions and kids, foreclosures and bankruptcies... But despite these adversities, we continue to work on hzip. We do this because working on useful and challenging and open source software is our greatest passion.

Okay, so today's release will be a maintenance release containing bug fixes and several large refactoring that we have put together to migrate hzip from 0.19.0 to Hadoop 1.0.0. Please look forward to more and more functional updates in the coming months.

Again, thank you so much for the attention and support!


The Yagnus License

posted Mar 6, 2011, 8:13 PM by Herbert Bright   [ updated Mar 6, 2011, 8:17 PM ]

Dear users, contributors and friends, along with our release of version 0.0.4, I am also very happy to announce the first public draft of the Yagnus License version 0.1, which we have not put into effect around all Yagnus software. The license is reproduced below. We are still in the process of refining this license. It is expected that the license will change periodically, but it will always be checked into the same tag that it is applicable to. 

Happy coding!! :-)

Yagnus License, Copyright and Disclaimers v0.1

This document is about computer Files that Yagnus Software provides on Yagnus Website.  The data is provided by various Yagnus Websites and third party software and data repositories including, but not exclusively,, google code, github, and sourceforge. These servers that provide files will be collectively referred to as the Yagnus Website.

* By using Yagnus Files, you accept this document.
* Redistribution Of Yagnus Files or any transform of Yagnus Files must include a copy of of this document in plain text.
* Open Source Yagnus software may only be used and redistributed in Open Source software with a license that accepts and displays this document.
* Open Source Yagnus software may not be packaged or sold for commercial purposes.
* Academic use of Yagnus code must cite Yagnus Software as the author, creator and originator of the Files.
* Weapons industry and Spies may not use Open Source Yagnus software. However, this is not a statement of disagreement, plan or attitude with, about and towards any or all Weapons industry or spies.
* Files are provided "as is" without any warranties of effecacy towards any end. Yagnus Software is not liable for any effects or side-effects caused by the use of Open Source Yagnus software.

Yagnus File: A Yagnus File for the purpose of this document is computer files and any data transferred from Yagnus, static or dynamic web content, in part or in whole, source code, including creative images and organization of information.
Acceptance of this document means you agree with the principles stated and that you are aware of the requirements and that you will follow the stated restrictions and requests. Agreement means you agree and agree to abide by the entire document.
Use of Yagnus Files, not exclusively, include the following: Downloading Files from Yagnus Website, unarchiving a file containing this notice, compiling, executing, invoking components in it's software libraries, encrypting, summarizing, pruning, or otherwise transforming, quoting or citing Yagnus Files. By using Yagnus Files, you agree to the principles, requirements, and restrictions stated in this document.
Spy is a person or organization that actively obtains, or maintains the capability of obtaining, secretly, information about some person or organizational entities that the secret keeper tries to keep secret.
Trying to keep a secret is the fact of actions taken to prevent intelligent entities (generally or a specific) from knowing the secret where the actions are generally effective, probably intentional, and for the purpose of keeping the secret from the said entities.
Weapons industry includes all people and machinery directly participating in the invention, enhancement, research and creation of devices or procedures to destroy, kill, injure, disable or debilitate human and human creations.

Copyright (c) 2010 and forward, Yagnus Software
All rights reserved.

Version 0.0.4 Released.

posted Mar 6, 2011, 7:59 PM by Alexia Chang

Hi, everyone, I am happy to announce my first release of Yagnus project. We have just posted version 0.0.4 tag on our repositories. Please check it out! We have made many improvements to our code base. This release was a cleanup release where we filled in code that was missed during previous check-in's, as well as to introduce a new licensing term.

We have introduced a reflection utility class into the Yagnus library. We implemented it in Java and then wrote a wrapper class in Scala. Some other fascinating things include a "BreakableIterator". Since the development of Hzip began during Scala 2.8.0 release, we did not have an easy way to arbitrarily break out of a for loop. And the new implementation depends on throwing exceptions, which may not be efficient if used regularly. The Yagnus BreakableIterator allows the user to introduce additional "breakout" criterion based on the current value of the iterator. The for loop is therefore allowed to exit premature to the exhaustion of the iterator.

Finally, we've added a 'cmp' command to hzip to allow you to compare two files on hdfs system.

Hope you enjoy this release, and we have big plans in the coming months to release some new compression algorithms!

Also, happy international womens' day to all women-kind out there! 

Version 0.0.3 Released!

posted Jan 25, 2011, 8:09 AM by HC BUSY

Hi, everybody! Happy  new year!

I'd like to start the year by proudly welcoming Alexia to the Yagnus Software projects. Alexia has been working very hard on the hzip project as well as related Yagnus Libraries. She has also been asked to be a committer for YadoopYagnus Libraries, and hzip.

Featured in version 0.0.3 is the return of the Yagnus Libraries from the 2000's. Included are some superb sampling code as well as a data structure for storing and looking up ordered ranges. In this version, we have added infrastructure to hzip to support block compression algorithms. For now, it allows us to treat files as blocks, and apply subsequent compression on each block. This step is necessary because BWT based compression algorithms usually operate on blocks of data. We have supplied a gzip compressor for each block, but in our next release, we will begin to implement BWT based algorithms.

Stay tuned, and I hope everyone have a great decade starting in 2011.

Version 0.0.2 released

posted Dec 28, 2010, 8:23 AM by HC BUSY

Hi everybody, we have just released the source code for version 0.0.2; This is mostly a maintenance release fixing bugs, closing files where 0.0.1 left open. We have also changed the packaging format. In this version, you must invoke the hzip program using java. See details on the manuals page.

Happy new year and happy compressing to everyone!


First Post!!

posted Dec 5, 2010, 6:08 PM by Herbert Bright   [ updated Dec 5, 2010, 7:54 PM ]

haahaaa! Been waiting to do that for years.

Okay, it's the dawn of December in 2010 and we have just begun to make available the source code for Yagnus libraries, Yagnus Yadoop, and Yagnus hzip.

Our first release of hzip features three very important capability: You can now decompress ".gz" ".bz2" and ".zip" files on hdfs directly. This capability allows you to perform file manipulation right on hdfs and in parallel. You can download the alpha version here, and instructions for using it are on the same page.


1-6 of 6