Fair Value - Financial Assets and Liabilities Measured on a Recurring Basis (Details) - USD ($) $ in Thousands	Dec. 31, 2015	Dec. 31, 2014
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	$ 385,079	$ 206,335
Agency mortgage-backed securities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	324,230	154,172
U.S. Treasury
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	30,003
Trust preferred securities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	15,132	15,300
U.S. Government sponsored entities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	9,041
Corporate bonds
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	6,673	36,863
Significant Other Observable Inputs (Level 2)
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	355,076	206,335
I/O strip receivables	1,367	1,481
Quoted Prices in Active Markets for Identical Assets (Level 1)
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	30,003
Recurring basis
Financial Assets and Liabilities Measured on a Recurring Basis
I/O strip receivables	1,367	1,481
Transfers between Level 1 and Level 2
Transfers between Level 1 and Level 2	0	0
Transfers between Level 2 and Level 1	0	0
Recurring basis | Agency mortgage-backed securities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	324,230	154,172
Recurring basis | U.S. Treasury
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	30,003
Recurring basis | Trust preferred securities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	15,132	15,300
Recurring basis | U.S. Government sponsored entities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	9,041
Recurring basis | Corporate bonds
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	6,673	36,863
Recurring basis | Significant Other Observable Inputs (Level 2)
Financial Assets and Liabilities Measured on a Recurring Basis
I/O strip receivables	1,367	1,481
Recurring basis | Significant Other Observable Inputs (Level 2) | Agency mortgage-backed securities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	324,230	154,172
Recurring basis | Significant Other Observable Inputs (Level 2) | Trust preferred securities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	15,132	15,300
Recurring basis | Significant Other Observable Inputs (Level 2) | U.S. Government sponsored entities
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	9,041
Recurring basis | Significant Other Observable Inputs (Level 2) | Corporate bonds
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	6,673	$ 36,863
Recurring basis | Quoted Prices in Active Markets for Identical Assets (Level 1) | U.S. Treasury
Financial Assets and Liabilities Measured on a Recurring Basis
Securities available-for-sale	$ 30,003