Pail enables you to vertically partition a dataset and it provides a dead-simple API for common operations like appends, compression, and consolidation. In this article based on chapter 3 taken from Big Data, author Nathan Marz shows you how Pail makes it easy to satisfy all of the requirements you have for storage on the batch layer.

Data Storage in the Batch Layer with Pail (PDF)