org.apache.hadoop.mapred

Class HadoopTestCase [ source ]

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

org.apache.hadoop.mapred.HadoopTestCase

All Implemented Interfaces:

Test

Direct Known Subclasses:

NotificationTestCase, TestChainMapReduce, TestDBJob, TestFileOutputFormat, TestKeyFieldBasedComparator, TestLocalJobControl, TestMultipleOutputs, TestMultithreadedMapper, TestMultithreadedMapRunner, TestNoDefaultsJobConf, TestTaskCommit

public abstract class HadoopTestCase
extends TestCase

Abstract Test case class to run MR in local or cluster mode and in local FS or DFS. The Hadoop instance is started and stopped on each test method. If using DFS the filesystem is reformated at each start (test method). Job Configurations should be created using a configuration returned by the 'createJobConf()' method.

Field Summary

Fields

Modifier and Type	Field and Description
static int	CLUSTER_MR
static int	DFS_FS
static int	LOCAL_FS
static int	LOCAL_MR

Constructor Summary

Constructors

Constructor and Description
HadoopTestCase(int mrMode, int fsMode, int taskTrackers, int dataNodes) Creates a testcase for local or cluster MR using DFS.

Method Summary

Methods

Modifier and Type	Method and Description
protected JobConf	createJobConf() Returns a job configuration preconfigured to run against the Hadoop managed by the testcase.
protected FileSystem	getFileSystem() Returns the Filesystem in use.
boolean	isLocalFS() Indicates if the filesystem is local or DFS.
boolean	isLocalMR() Indicates if the MR is running in local or cluster mode.
protected void	setUp() Creates Hadoop instance based on constructor configuration before a test case is run.
protected void	tearDown() Destroys Hadoop instance based on constructor configuration after a test case is run.

Methods inherited from class junit.framework.TestCase

countTestCases, createResult, getName, run, run, runBare, runTest, setName, toString

Methods inherited from class junit.framework.Assert

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, fail, fail, failNotEquals, failNotSame, failSame, format

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOCAL_MR

public static final int LOCAL_MR

See Also:

Constant Field Values

CLUSTER_MR

public static final int CLUSTER_MR

See Also:

Constant Field Values

LOCAL_FS

public static final int LOCAL_FS

See Also:

Constant Field Values

DFS_FS

public static final int DFS_FS

See Also:

Constant Field Values

Constructor Detail

HadoopTestCase

public HadoopTestCase(int mrMode,
              int fsMode,
              int taskTrackers,
              int dataNodes)
               throws IOException

Creates a testcase for local or cluster MR using DFS. The DFS will be formatted regardless if there was one or not before in the given location.

Parameters:

mrMode - indicates if the MR should be local (LOCAL_MR) or cluster (CLUSTER_MR)

fsMode - indicates if the FS should be local (LOCAL_FS) or DFS (DFS_FS) local FS when using relative PATHs)

taskTrackers - number of task trackers to start when using cluster

dataNodes - number of data nodes to start when using DFS

Throws:

IOException - thrown if the base directory cannot be set.

Method Detail

isLocalMR

public boolean isLocalMR()

Indicates if the MR is running in local or cluster mode.

Returns:

returns TRUE if the MR is running locally, FALSE if running in cluster mode.

isLocalFS

public boolean isLocalFS()

Indicates if the filesystem is local or DFS.

Returns:

returns TRUE if the filesystem is local, FALSE if it is DFS.

setUp

protected void setUp()
              throws Exception

Creates Hadoop instance based on constructor configuration before a test case is run.

Overrides:

setUp in class TestCase

Throws:

Exception

tearDown

protected void tearDown()
                 throws Exception

Destroys Hadoop instance based on constructor configuration after a test case is run.

Overrides:

tearDown in class TestCase

Throws:

Exception

getFileSystem

protected FileSystem getFileSystem()

Returns the Filesystem in use. TestCases should use this Filesystem as it is properly configured with the workingDir for relative PATHs.

Returns:

the filesystem used by Hadoop.

createJobConf

protected JobConf createJobConf()

Returns a job configuration preconfigured to run against the Hadoop managed by the testcase.

Returns:

configuration that works on the testcase Hadoop instance