Click here to Skip to main content
12,701,854 members (36,036 online)
Click here to Skip to main content
Add your own
alternative version

Tagged as


21 bookmarked

Test Data Extraction with Jailer

, 25 Oct 2008 Apache
Rate this:
Please Sign up or sign in to vote.
Jailer simplifies the extraction of referentially intact data


Databases are growing in both size and complexity to meet the increasing demands of business. Applications to process the data are also increasing in size and complexity. With the growing complexity, solid testing becomes more and more important in order to assure the quality of software. Ideally we would like to test all changes against up-to-date production data, so the general practice is use a copy of the production database for all testing.

The Problem

When a database exceeds a certain size, it becomes very expensive to provide full-size copies of the production database for development and testing. One solution to this problem is to have fewer full size copies of the production database than are really needed, often only one, which will be shared between the development and testing teams.

Of course this is far from optimal. Data in the database is left in an unknown state when passed from one team to the other. It takes a long time to provide a refresh of the production copy when it’s required. Always having an up-to-date production copy is almost impossible.

A Solution

The databases required for development and testing rarely need to be full size, it is often easier to work on a small copy. Unfortunately it is very hard to manually extract a small subset of the production data. It is not possible to just take 10% of each table to get a 10% size database. The data in one table would not be related to the data in the other tables. It would not be referentially intact.

Jailer simplifies the extraction of referentially intact data. Once you have defined an extraction model, it can be used to extract data from the production database fast and easily whenever up-to-date test data is required.

The open-source tool Jailer is available here

Click to enlarge


This article, along with any associated source code and files, is licensed under The Apache License, Version 2.0


About the Author

United States United States
No Biography provided

You may also be interested in...


Comments and Discussions

NewsRelease 2.7.0 supports the DbUnit flat XML dataset file format. Pin
RWisser6-Jan-09 11:01
memberRWisser6-Jan-09 11:01 
QuestionSQLite Pin
High200626-Oct-08 1:56
memberHigh200626-Oct-08 1:56 
AnswerRe: SQLite Pin
RWisser27-Oct-08 22:35
memberRWisser27-Oct-08 22:35 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Terms of Use | Mobile
Web02 | 2.8.170118.1 | Last Updated 25 Oct 2008
Article Copyright 2008 by RWisser
Everything else Copyright © CodeProject, 1999-2017
Layout: fixed | fluid