Allowance for Loan and Lease Losses - Changes in Allowance for Loan and Lease Losses (Details) (USD $) In Thousands, unless otherwise specified	3 Months Ended		9 Months Ended		12 Months Ended
	Sep. 30, 2013	Sep. 30, 2012	Sep. 30, 2013	Sep. 30, 2012	Dec. 31, 2012
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	$ 15,179	$ 17,495	$ 17,261	$ 16,380	$ 16,380
Charge-offs	(837)	(2,080)	(3,079)	(2,861)	(6,271)
Recoveries	119	241	693	538	1,155
Provision	218	1,761	(196)	3,360	5,997
Ending balance	14,679	17,417	14,679	17,417	17,261
Ending balance: related to loans individually evaluated for impairment	660	2,808	660	2,808	2,026
Ending balance: related to loans collectively evaluated for impairment	14,019	14,609	14,019	14,609	15,235
LHFI [Abstract]
Ending balance	377,329	343,564	377,329	343,564	344,682
Ending balance: individually evaluated for impairment	23,418	28,593	23,418	28,593	28,828
Ending balance: collectively evaluated for impairment	353,911	314,971	353,911	314,971	315,854
Commercial Real Estate [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	7,952	7,679	8,750	7,744	7,744
Charge-offs	(605)	0	(1,440)	0	(1,313)
Recoveries	1	0	127	3	3
Provision	(1,159)	1,009	(1,248)	941	2,316
Ending balance	6,189	8,688	6,189	8,688	8,750
Ending balance: related to loans individually evaluated for impairment	230	1,313	230	1,313	835
Ending balance: related to loans collectively evaluated for impairment	5,959	7,375	5,959	7,375	7,915
LHFI [Abstract]
Ending balance	158,223	161,834	158,223	161,834	167,115
Ending balance: individually evaluated for impairment	10,045	13,493	10,045	13,493	10,958
Ending balance: collectively evaluated for impairment	148,178	148,341	148,178	148,341	156,157
Construction and Land Development [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	2,017	3,738	2,987	2,523	2,523
Charge-offs	0	(1,242)	(820)	(1,242)	(2,452)
Recoveries	106	232	297	423	816
Provision	72	753	(269)	1,777	2,100
Ending balance	2,195	3,481	2,195	3,481	2,987
Ending balance: related to loans individually evaluated for impairment	0	1,210	0	1,210	820
Ending balance: related to loans collectively evaluated for impairment	2,195	2,271	2,195	2,271	2,167
LHFI [Abstract]
Ending balance	39,594	40,280	39,594	40,280	37,215
Ending balance: individually evaluated for impairment	4,019	7,552	4,019	7,552	5,943
Ending balance: collectively evaluated for impairment	35,575	32,728	35,575	32,728	31,272
Commercial and Industrial [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	2,465	2,206	1,924	2,331	2,331
Charge-offs	(34)	(156)	(228)	(364)	(586)
Recoveries	4	3	14	60	67
Provision	1,080	(103)	1,805	(77)	112
Ending balance	3,515	1,950	3,515	1,950	1,924
Ending balance: related to loans individually evaluated for impairment	209	222	209	222	255
Ending balance: related to loans collectively evaluated for impairment	3,306	1,728	3,306	1,728	1,669
LHFI [Abstract]
Ending balance	86,401	39,831	86,401	39,831	40,560
Ending balance: individually evaluated for impairment	8,112	5,507	8,112	5,507	10,251
Ending balance: collectively evaluated for impairment	78,289	34,324	78,289	34,324	30,309
Multi Family [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	588	946	654	531	531
Charge-offs	0	(541)	0	(541)	(542)
Recoveries	0	0	0	0	0
Provision	(114)	101	(180)	516	665
Ending balance	474	506	474	506	654
Ending balance: related to loans individually evaluated for impairment	0	0	0	0	0
Ending balance: related to loans collectively evaluated for impairment	474	506	474	506	654
LHFI [Abstract]
Ending balance	11,678	8,490	11,678	8,490	11,756
Ending balance: individually evaluated for impairment	0	0	0	0	0
Ending balance: collectively evaluated for impairment	11,678	8,490	11,678	8,490	11,756
Residential Real Estate [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	353	1,125	1,098	1,188	1,188
Charge-offs	(32)	(30)	(32)	(30)	(111)
Recoveries	2	0	157	2	208
Provision	175	17	(725)	(48)	(187)
Ending balance	498	1,112	498	1,112	1,098
Ending balance: related to loans individually evaluated for impairment	16	22	16	22	14
Ending balance: related to loans collectively evaluated for impairment	482	1,090	482	1,090	1,084
LHFI [Abstract]
Ending balance	24,830	26,100	24,830	26,100	24,981
Ending balance: individually evaluated for impairment	520	1,273	520	1,273	994
Ending balance: collectively evaluated for impairment	24,310	24,827	24,310	24,827	23,987
Leases [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	999	1,212	1,108	1,311	1,311
Charge-offs	(40)	(82)	(149)	(377)	(465)
Recoveries	4	6	24	22	32
Provision	133	13	113	193	230
Ending balance	1,096	1,149	1,096	1,149	1,108
Ending balance: related to loans individually evaluated for impairment	138	41	138	41	55
Ending balance: related to loans collectively evaluated for impairment	958	1,108	958	1,108	1,053
LHFI [Abstract]
Ending balance	40,408	38,313	40,408	38,313	37,347
Ending balance: individually evaluated for impairment	190	52	190	52	81
Ending balance: collectively evaluated for impairment	40,218	38,261	40,218	38,261	37,266
Tax Certificates [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	586	332	472	425	425
Charge-offs	(126)	(29)	(410)	(307)	(802)
Recoveries	2	0	74	28	29
Provision	41	(35)	367	122	820
Ending balance	503	268	503	268	472
Ending balance: related to loans individually evaluated for impairment	67	0	67	0	47
Ending balance: related to loans collectively evaluated for impairment	436	268	436	268	425
LHFI [Abstract]
Ending balance	15,364	27,622	15,364	27,622	24,569
Ending balance: individually evaluated for impairment	532	716	532	716	601
Ending balance: collectively evaluated for impairment	14,832	26,906	14,832	26,906	23,968
Consumer [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	18	20	29	20	20
Charge-offs	0	0	0	0	0
Recoveries	0	0	0	0	0
Provision	(3)	6	(14)	6	9
Ending balance	15	26	15	26	29
Ending balance: related to loans individually evaluated for impairment	0	0	0	0	0
Ending balance: related to loans collectively evaluated for impairment	15	26	15	26	29
LHFI [Abstract]
Ending balance	831	1,094	831	1,094	1,139
Ending balance: individually evaluated for impairment	0	0	0	0	0
Ending balance: collectively evaluated for impairment	831	1,094	831	1,094	1,139
Unallocated [Member]
Allowance for Loan and Leases Losses [Roll Forward]
Beginning balance	201	237	239	307	307
Charge-offs	0	0	0	0	0
Recoveries	0	0	0	0	0
Provision	(7)	0	(45)	(70)	(68)
Ending balance	194	237	194	237	239
Ending balance: related to loans individually evaluated for impairment	0	0	0	0	0
Ending balance: related to loans collectively evaluated for impairment	194	237	194	237	239
LHFI [Abstract]
Ending balance	0	0	0	0	0
Ending balance: individually evaluated for impairment	0	0	0	0	0
Ending balance: collectively evaluated for impairment	$ 0	$ 0	$ 0	$ 0	$ 0