Fair Value (Details 4) (USD $) In Thousands, unless otherwise specified	Dec. 31, 2013	Dec. 31, 2012
Level 1
Financial Assets:
Cash and cash equivalents	$ 58,196	$ 64,360
Level 2
Financial Assets:
Securities available-for-sale	9,397	13,378
Accrued interest receivable	27	42
Financial Liabilities:
Deposits	(209,656)	(253,155)
Federal Home Loan Bank advances	(82,840)	(84,769)
Accrued interest payable	(63)	(87)
Advance payments by borrowers for taxes and insurance	(776)	(711)
Level 3
Financial Assets:
Loans receivable held for sale		19,051
Loans receivable held for investment	248,167	252,043
Accrued interest receivable	1,080	1,208
Financial Liabilities:
Junior subordinated debentures	(2,167)	(4,852)
Senior debt	(1,429)	(4,205)
Accrued interest payable	(608)	(1,527)
Total
Financial Assets:
Cash and cash equivalents	58,196	64,360
Securities available-for-sale	9,397	13,378
Loans receivable held for sale		19,051
Loans receivable held for investment	248,167	252,043
Accrued interest receivable	1,107	1,250
Financial Liabilities:
Deposits	(209,656)	(253,155)
Federal Home Loan Bank advances	(82,840)	(84,769)
Junior subordinated debentures	(2,167)	(4,852)
Senior debt	(1,429)	(4,205)
Accrued interest payable	(671)	(1,614)
Advance payments by borrowers for taxes and insurance	(776)	(711)
Carrying Value
Financial Assets:
Cash and cash equivalents	58,196	64,360
Securities available-for-sale	9,397	13,378
Loans receivable held for sale		19,051
Loans receivable held for investment	247,847	251,723
Federal Home Loan Bank stock	3,737	3,901
Accrued interest receivable	1,107	1,250
Financial Liabilities:
Deposits	(214,405)	(257,071)
Federal Home Loan Bank advances	(79,500)	(79,500)
Junior subordinated debentures	(6,000)	(6,000)
Senior debt	(2,923)	(5,000)
Accrued interest payable	(718)	(1,941)
Advance payments by borrowers for taxes and insurance	$ (776)	$ (711)