Investment Securities (Details) (USD $)	3 Months Ended			6 Months Ended		12 Months Ended
	Jun. 30, 2013	Jun. 30, 2012	Mar. 31, 2012	Jun. 30, 2013	Jun. 30, 2012	Dec. 31, 2012
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost	$ 305,114,000			$ 305,114,000		$ 343,879,000
Gross unrealized gains	4,281,000			4,281,000		6,270,000
Gross unrealized losses, Non-OTTI in AOCI	(5,278,000)			(5,278,000)		(946,000)
Gross unrealized losses, Non-credit related OTTI in AOCI	0			0		0
Fair value	304,117,000			304,117,000		349,203,000
Amortized cost [Abstract]
Within 1 year	15,906,000			15,906,000
After 1 but within 5 years	5,445,000			5,445,000
After 5 but within 10 years	35,874,000			35,874,000
After 10 years	32,433,000			32,433,000
Mortgage-backed securities-residential	33,271,000			33,271,000
Collateralized mortgage obligations-residential	178,476,000			178,476,000
Total available for sale debt securities	301,405,000			301,405,000
No contractual maturity	3,709,000			3,709,000
Total available for sale securities	305,114,000			305,114,000
Fair value [Abstract]
Within 1 year	15,301,000			15,301,000
After 1 but within 5 years	5,406,000			5,406,000
After 5 but within 10 years	34,413,000			34,413,000
After 10 years	31,113,000			31,113,000
Mortgage-backed securities residential	32,922,000			32,922,000
Collateralized mortgage obligations-residential	180,509,000			180,509,000
Total available for sale debt securities	299,664,000			299,664,000
No contractual maturity	4,453,000			4,453,000
Total available for sale securities	304,117,000			304,117,000
Proceeds from sales of AFS investment securities	8,300,000	75,000		20,428,000	11,902,000
Gross realized gains and losses on the sale of securities recognized in earnings [Abstract]
Gross realized gains	43,000	29,000		181,000	340,000
Gross realized losses	(18,000)	(9,000)		(111,000)	(181,000)
Net realized gains	25,000	20,000		70,000	159,000
Other than Temporary Impairment Losses, Investments, Available-for-sale Securities [Abstract]
Other than temporary impairment losses on securities recognized in earnings	0	859,000		0	859,000
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	126,181,000			126,181,000		83,086,000
12 months or longer, Fair value	3,805,000			3,805,000		6,053,000
Total, Fair value	129,986,000			129,986,000		89,139,000
Less than 12 months, Gross unrealized losses	(5,132,000)			(5,132,000)		(789,000)
12 months or longer, Gross unrealized losses	(146,000)			(146,000)		(157,000)
Total, Gross unrealized losses	(5,278,000)			(5,278,000)		(946,000)
Percentage of negatively impact on market value of securities (in hundredths)				45.00%
Period of treasury yield				10 years
Percentage of treasury yield (in hundredths)				2.55%		1.76%
Gain recorded by common stock investment sold			112,000
Credit related impairment losses on debt securities held for which a portion of OTTI was recognized in other comprehensive income [Roll Forward]
Balance at beginning of year			173,000	173,000	173,000	173,000
Reductions for securities sold during the period (realized)				(173,000)	0
Balance at end of year	0	173,000		0	173,000	173,000
U.S. Government Agencies [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost	74,354,000			74,354,000		66,371,000
Gross unrealized gains	18,000			18,000		151,000
Gross unrealized losses, Non-OTTI in AOCI	(3,200,000)			(3,200,000)		(78,000)
Gross unrealized losses, Non-credit related OTTI in AOCI	0			0		0
Fair value	71,172,000			71,172,000		66,444,000
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	58,159,000			58,159,000		23,818,000
12 months or longer, Fair value	0			0		0
Total, Fair value	58,159,000			58,159,000		23,818,000
Less than 12 months, Gross unrealized losses	(3,200,000)			(3,200,000)		(78,000)
12 months or longer, Gross unrealized losses	0			0		0
Total, Gross unrealized losses	(3,200,000)			(3,200,000)		(78,000)
Period of treasury yield				10 years
Number of securities in an unrealized loss position for less than twelve months	20			20
Mortgage-backed Securities-residential [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost	33,271,000			33,271,000		30,038,000
Gross unrealized gains	375,000			375,000		518,000
Gross unrealized losses, Non-OTTI in AOCI	(724,000)			(724,000)		(47,000)
Gross unrealized losses, Non-credit related OTTI in AOCI	0			0		0
Fair value	32,922,000			32,922,000		30,509,000
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	19,201,000			19,201,000		7,280,000
12 months or longer, Fair value	0			0		0
Total, Fair value	19,201,000			19,201,000		7,280,000
Less than 12 months, Gross unrealized losses	(724,000)			(724,000)		(47,000)
12 months or longer, Gross unrealized losses	0			0		0
Total, Gross unrealized losses	(724,000)			(724,000)		(47,000)
Number of securities in an unrealized loss position for less than twelve months	7			7
Collateralized Mortgage Obligations-Residential [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost	178,476,000			178,476,000
Gross unrealized gains	2,958,000			2,958,000
Gross unrealized losses, Non-OTTI in AOCI	(925,000)			(925,000)
Gross unrealized losses, Non-credit related OTTI in AOCI	0			0
Fair value	180,509,000			180,509,000
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	39,185,000			39,185,000
12 months or longer, Fair value	2,642,000			2,642,000
Total, Fair value	41,827,000			41,827,000
Less than 12 months, Gross unrealized losses	(920,000)			(920,000)
12 months or longer, Gross unrealized losses	(5,000)			(5,000)
Total, Gross unrealized losses	(925,000)			(925,000)
Collateralized Mortgage Obligations, Issued or Guaranteed by U.S. Government Agencies [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost						229,556,000
Gross unrealized gains						5,031,000
Gross unrealized losses, Non-OTTI in AOCI						(611,000)
Fair value						233,976,000
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value						44,937,000
12 months or longer, Fair value						3,975,000
Total, Fair value						48,912,000
Less than 12 months, Gross unrealized losses						(592,000)
12 months or longer, Gross unrealized losses						(19,000)
Total, Gross unrealized losses						(611,000)
Number of investment securities	14			14
Number of securities in an unrealized loss position for less than twelve months	12			12
Number of securities in an unrealized loss position for more than twelve months	2			2
Collateralized Mortgage Obligations, Non-agency [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost						1,007,000
Gross unrealized gains						4,000
Gross unrealized losses, Non-OTTI in AOCI						0
Gross unrealized losses, Non-credit related OTTI in AOCI						0
Fair value						1,011,000
Corporate Bonds [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost	9,785,000			9,785,000		7,477,000
Gross unrealized gains	37,000			37,000		32,000
Gross unrealized losses, Non-OTTI in AOCI	(92,000)			(92,000)		(72,000)
Gross unrealized losses, Non-credit related OTTI in AOCI	0			0		0
Fair value	9,730,000			9,730,000		7,437,000
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	4,035,000			4,035,000		2,165,000
12 months or longer, Fair value	958,000			958,000		941,000
Total, Fair value	4,993,000			4,993,000		3,106,000
Less than 12 months, Gross unrealized losses	(50,000)			(50,000)		(13,000)
12 months or longer, Gross unrealized losses	(42,000)			(42,000)		(59,000)
Total, Gross unrealized losses	(92,000)			(92,000)		(72,000)
Number of investment securities	5			5
Number of securities in an unrealized loss position for less than twelve months	4			4
Number of securities in an unrealized loss position for more than twelve months	1			1
Number of securities at or above investment grade	5			5
Municipal Bonds [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost	5,519,000			5,519,000		5,645,000
Gross unrealized gains	0			0		0
Gross unrealized losses, Non-OTTI in AOCI	(188,000)			(188,000)		(30,000)
Gross unrealized losses, Non-credit related OTTI in AOCI	0			0		0
Fair value	5,331,000			5,331,000		5,615,000
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	5,331,000			5,331,000		4,597,000
12 months or longer, Fair value	0			0		882,000
Total, Fair value	5,331,000			5,331,000		5,479,000
Less than 12 months, Gross unrealized losses	(188,000)			(188,000)		(21,000)
12 months or longer, Gross unrealized losses	0			0		(9,000)
Total, Gross unrealized losses	(188,000)			(188,000)		(30,000)
Number of investment securities	7			7
Common Stocks [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost	33,000			33,000		33,000
Gross unrealized gains	13,000			13,000		14,000
Gross unrealized losses, Non-OTTI in AOCI	0			0		0
Gross unrealized losses, Non-credit related OTTI in AOCI	0			0		0
Fair value	46,000			46,000		47,000
Available for sale securities, continuous unrealized loss position [Abstract]
Number of investment securities sold			1
Number of investment securities	2			2
Other Securities [Member]
Carrying value and fair value of available for sale investment securities [Abstract]
Amortized cost	3,676,000			3,676,000		3,752,000
Gross unrealized gains	880,000			880,000		520,000
Gross unrealized losses, Non-OTTI in AOCI	(149,000)			(149,000)		(108,000)
Gross unrealized losses, Non-credit related OTTI in AOCI	0			0		0
Fair value	4,407,000			4,407,000		4,164,000
Other than Temporary Impairment Losses, Investments, Available-for-sale Securities [Abstract]
Other than temporary impairment losses on securities recognized in earnings	0	859,000		0	859,000
Available for sale securities, continuous unrealized loss position [Abstract]
Less than 12 months, Fair value	270,000			270,000		289,000
12 months or longer, Fair value	205,000			205,000		255,000
Total, Fair value	475,000			475,000		544,000
Less than 12 months, Gross unrealized losses	(50,000)			(50,000)		(38,000)
12 months or longer, Gross unrealized losses	(99,000)			(99,000)		(70,000)
Total, Gross unrealized losses	$ (149,000)			$ (149,000)		$ (108,000)
Number of securities invested in real estate funds	7			7
Number of securities considered not to be other than temporarily impaired	2			2
Number of securities recording an impairment charge	2			2