Fair Value of Financial Instruments - Quantitative Data (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2016	Mar. 31, 2015	Dec. 31, 2015
Quantitative information about level 3 of fair value measurements for financial instruments
Other real estate owned	$ 1,161	$ 997	$ 1,161
Non-recurring basis
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	1,593	2,742
Other real estate owned	1,161	997
Non-recurring basis | Level 3
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	1,593	2,742
Other real estate owned	1,161	997
Non-recurring basis | Level 3 | Commercial and industrial
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	$ 306
Non-recurring basis | Level 3 | Commercial and industrial | Collateral analysis | Minimum
Unobservable Inputs
Rate (as a percent)	6.25%
Maturity (years)	2 years
Unobservable Inputs (as a percent)	0.00%
Non-recurring basis | Level 3 | Commercial and industrial | Collateral analysis | Maximum
Unobservable Inputs
Rate (as a percent)	7.50%
Maturity (years)	6 years
Unobservable Inputs (as a percent)	10.00%
Non-recurring basis | Level 3 | Franchise
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	$ 169	$ 1,853
Non-recurring basis | Level 3 | Franchise | Collateral analysis
Unobservable Inputs
Rate (as a percent)		6.70%
Maturity (years)	8 years	8 years
Non-recurring basis | Level 3 | Franchise | Collateral analysis | Minimum
Unobservable Inputs
Rate (as a percent)	5.70%
Unobservable Inputs (as a percent)	0.00%	0.00%
Non-recurring basis | Level 3 | Franchise | Collateral analysis | Maximum
Unobservable Inputs
Rate (as a percent)	6.70%
Unobservable Inputs (as a percent)	10.00%	10.00%
Non-recurring basis | Level 3 | Commercial owner occupied
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	$ 507	$ 379
Non-recurring basis | Level 3 | Commercial owner occupied | Collateral analysis
Unobservable Inputs
Rate (as a percent)		6.75%
Maturity (years)		7 years
Non-recurring basis | Level 3 | Commercial owner occupied | Collateral analysis | Minimum
Unobservable Inputs
Rate (as a percent)	6.75%
Maturity (years)	1 year
Unobservable Inputs (as a percent)	0.00%	0.00%
Non-recurring basis | Level 3 | Commercial owner occupied | Collateral analysis | Maximum
Unobservable Inputs
Rate (as a percent)	7.75%
Maturity (years)	10 years
Unobservable Inputs (as a percent)	10.00%	10.00%
Non-recurring basis | Level 3 | SBA
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	$ 69
Non-recurring basis | Level 3 | SBA | Collateral analysis
Unobservable Inputs
Rate (as a percent)	6.00%
Maturity (years)	15 years
Non-recurring basis | Level 3 | SBA | Collateral analysis | Minimum
Unobservable Inputs
Unobservable Inputs (as a percent)	0.00%
Non-recurring basis | Level 3 | SBA | Collateral analysis | Maximum
Unobservable Inputs
Unobservable Inputs (as a percent)	10.00%
Non-recurring basis | Level 3 | Commercial non-owner occupied
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	$ 0	$ 458
Non-recurring basis | Level 3 | Commercial non-owner occupied | Collateral analysis
Unobservable Inputs
Rate (as a percent)	7.00%	7.00%
Maturity (years)	11 years	12 years
Non-recurring basis | Level 3 | Commercial non-owner occupied | Collateral analysis | Minimum
Unobservable Inputs
Unobservable Inputs (as a percent)	0.00%	0.00%
Non-recurring basis | Level 3 | Commercial non-owner occupied | Collateral analysis | Maximum
Unobservable Inputs
Unobservable Inputs (as a percent)	15.00%	15.00%
Non-recurring basis | Level 3 | One-to-four family
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	$ 523	$ 52
Non-recurring basis | Level 3 | One-to-four family | Collateral analysis | Minimum
Unobservable Inputs
Rate (as a percent)	7.00%	8.00%
Maturity (years)	4 years	5 years
Unobservable Inputs (as a percent)	0.00%	0.00%
Non-recurring basis | Level 3 | One-to-four family | Collateral analysis | Maximum
Unobservable Inputs
Rate (as a percent)	15.00%	15.00%
Maturity (years)	14 years	16 years
Unobservable Inputs (as a percent)	10.00%	10.00%
Non-recurring basis | Level 3 | Land
Quantitative information about level 3 of fair value measurements for financial instruments
Collateral dependent impaired loans	$ 19
Non-recurring basis | Level 3 | Land | Collateral analysis
Unobservable Inputs
Rate (as a percent)	13.00%
Maturity (years)	15 years
Non-recurring basis | Level 3 | Land | Collateral analysis | Minimum
Unobservable Inputs
Unobservable Inputs (as a percent)	0.00%
Non-recurring basis | Level 3 | Land | Collateral analysis | Maximum
Unobservable Inputs
Unobservable Inputs (as a percent)	10.00%
Non-recurring basis | Level 3 | Other real estate owned land
Quantitative information about level 3 of fair value measurements for financial instruments
Other real estate owned	$ 1,161	$ 711
Non-recurring basis | Level 3 | Other real estate owned land | Collateral analysis
Unobservable Inputs
Rate (as a percent)	0.00%	0.00%
Maturity (years)	0 years	0 years
Non-recurring basis | Level 3 | Other real estate owned land | Collateral analysis | Minimum
Unobservable Inputs
Unobservable Inputs (as a percent)	0.00%	0.00%
Non-recurring basis | Level 3 | Other real estate owned land | Collateral analysis | Maximum
Unobservable Inputs
Unobservable Inputs (as a percent)	10.00%	10.00%
Non-recurring basis | Level 3 | Other One-To-Four Family
Quantitative information about level 3 of fair value measurements for financial instruments
Other real estate owned		$ 286
Non-recurring basis | Level 3 | Other One-To-Four Family | Collateral analysis
Unobservable Inputs
Rate (as a percent)		0.00%
Maturity (years)		0 years
Non-recurring basis | Level 3 | Other One-To-Four Family | Collateral analysis | Minimum
Unobservable Inputs
Unobservable Inputs (as a percent)		0.00%
Non-recurring basis | Level 3 | Other One-To-Four Family | Collateral analysis | Maximum
Unobservable Inputs
Unobservable Inputs (as a percent)		10.00%