Loans and Credit Quality (Details) (USD $) In Thousands, unless otherwise specified	Sep. 30, 2012	Jun. 30, 2012	Dec. 31, 2011
Loans held for investment
Loans and Leases Receivable, Gross	$ 1,299,306		$ 1,347,624
Net deferred loan fees and discounts		(3,142)	(4,062)
Loans held for investment, net of deferred fees and discounts	1,296,164		1,343,562
Allowance for losses on loans held for investment	(27,641)	(27,461)	(42,689)
Loans held for investment, net	1,268,703		1,300,873
Consumer Portfolio Segment [Member]
Loans held for investment
Loans and Leases Receivable, Gross	743,507	743,507	655,870
Consumer Portfolio Segment [Member] \| Residential Mortgage [Member]
Loans held for investment
Loans and Leases Receivable, Gross	602,164	602,164	496,934
Consumer Portfolio Segment [Member] \| Home Equity Line of Credit [Member]
Loans held for investment
Loans and Leases Receivable, Gross	141,343	141,343	158,936
Commercial Portfolio Segment [Member]
Loans held for investment
Loans and Leases Receivable, Gross	555,799	555,799	691,754
Commercial Portfolio Segment [Member] \| Commercial Real Estate [Member]
Loans held for investment
Loans and Leases Receivable, Gross	360,919	360,919	402,139
Commercial Portfolio Segment [Member] \| Multifamily Residential [Member]
Loans held for investment
Loans and Leases Receivable, Gross	36,912	36,912	56,379
Commercial Portfolio Segment [Member] \| Commercial Real Estate Construction Financing Receivable [Member]
Loans held for investment
Loans and Leases Receivable, Gross	77,912	77,912	173,405
Commercial Portfolio Segment [Member] \| Commercial Business [Member]
Loans held for investment
Loans and Leases Receivable, Gross	$ 80,056	$ 80,056	$ 59,831

Amount of allowance to cover probable credit losses on loans and leases. Includes carryover of or adjustments to the allowance for loan losses in connection with business combinations. Excludes allowance for loans and leases covered under loss sharing agreements.

Reference 1: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Statement of Financial Accounting Standard (FAS)

-Number 5

-Paragraph 8, 9

-LegacyDoc This reference is SUPERSEDED by the Accounting Standards Codification effective for interim and annual periods ending after September 15, 2009. This reference is included to help users transition from the previous accounting hierarchy and will be removed from future versions of this taxonomy.

Reference 2: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Accounting Standards Codification

-Topic 310

-SubTopic 30

-Section 50

-Paragraph 2

-Subparagraph (b)(1)(ii)

-URI http://asc.fasb.org/extlink&oid=6379141&loc=d3e15032-111544

Reference 3: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Accounting Standards Codification

-Topic 942

-SubTopic 210

-Section S99

-Paragraph 1

-Subparagraph (SX 210.9-03.7(d))

-URI http://asc.fasb.org/extlink&oid=6876686&loc=d3e534808-122878

Reference 4: http://www.xbrl.org/2003/role/presentationRef

-Publisher OTS

-Name Federal Regulation (FR)

-Number Title 12

-Section 563c.102

-Paragraph 8

-Subparagraph a(ii)

-Chapter V

-Subsection I

-LegacyDoc This is a non-GAAP reference that was included in the 2009 taxonomy. It will be removed from future versions of this taxonomy.

Reference 5: http://www.xbrl.org/2003/role/presentationRef

-Publisher SEC

-Name Regulation S-X (SX)

-Number 210

-Section 03

-Paragraph 7

-Subparagraph d

-Article 9

Reference 6: http://www.xbrl.org/2003/role/presentationRef

-Publisher FASB

-Name Statement of Financial Accounting Standard (FAS)

-Number 114

-Paragraph 20

-LegacyDoc This reference is SUPERSEDED by the Accounting Standards Codification effective for interim and annual periods ending after September 15, 2009. This reference is included to help users transition from the previous accounting hierarchy and will be removed from future versions of this taxonomy.

Reference 7: http://www.xbrl.org/2003/role/presentationRef

-Publisher SEC

-Name Staff Accounting Bulletin (SAB)

-Number Topic 6

-Section L

-Subsection 1

+ Details

- Definition

Amount before allowance and after deduction of deferred interest and fees, unamortized costs and premiums and discounts from face amounts, of loans and leases held in portfolio, including but not limited to, commercial and consumer loans. Excludes loans and leases covered under loss sharing agreements.

+ References+ Details

- Definition

Amount after allowance and deduction of deferred interest and fees, unamortized costs and premiums and discounts from face amounts, of loans and leases held in portfolio, including but not limited to, commercial and consumer loans. Excludes loans and leases covered under loss sharing agreements.

+ References+ Details