Revenue from Contracts with Customers (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2019	Mar. 31, 2018	Dec. 31, 2018
Disaggregation of Revenue [Line Items]
Service charges and fees	$ 5,412	$ 5,745
Accounts Receivable, Net	1,400		$ 1,400
Debit and credit card interchange fees	1,865	1,508
Success fees (2)	435	781
Other income	119	235
Total revenue from contracts with customers	7,831	8,269
Revenues outside the scope of ASC 606 (3)	7,579	3,374
Total non-interest income	15,410	11,643
Operating Segments [Member] | HOA Services [Member]
Disaggregation of Revenue [Line Items]
Service charges and fees	88	146
Debit and credit card interchange fees	8	3
Success fees (2)	0	0
Other income	0	0
Total revenue from contracts with customers	96	149
Revenues outside the scope of ASC 606 (3)	0	1
Total non-interest income	96	150
Operating Segments [Member] | Public and Non-Profit Finance [Member]
Disaggregation of Revenue [Line Items]
Service charges and fees	0	0
Debit and credit card interchange fees	0	0
Success fees (2)	0	0
Other income	0	0
Total revenue from contracts with customers	0	0
Revenues outside the scope of ASC 606 (3)	0	0
Total non-interest income	0	0
Operating Segments [Member] | Technology and Innovation [Member]
Disaggregation of Revenue [Line Items]
Service charges and fees	713	815
Debit and credit card interchange fees	0	0
Success fees (2)	435	779
Other income	0	0
Total revenue from contracts with customers	1,148	1,594
Revenues outside the scope of ASC 606 (3)	2,214	1,457
Total non-interest income	3,362	3,051
Operating Segments [Member] | HFF Loan Portfolio [Member]
Disaggregation of Revenue [Line Items]
Service charges and fees	0	0
Debit and credit card interchange fees	0	0
Success fees (2)	0	0
Other income	0	0
Total revenue from contracts with customers	0	0
Revenues outside the scope of ASC 606 (3)	0	13
Total non-interest income	0	13
Operating Segments [Member] | Other National Business Lines [Member]
Disaggregation of Revenue [Line Items]
Service charges and fees	1	0
Debit and credit card interchange fees	0	0
Success fees (2)	0	0
Other income	38	0
Total revenue from contracts with customers	39	0
Revenues outside the scope of ASC 606 (3)	618	224
Total non-interest income	657	224
Reportable Geographical Components [Member] | ARIZONA
Disaggregation of Revenue [Line Items]
Service charges and fees	1,079	917
Debit and credit card interchange fees	337	257
Success fees (2)	0	0
Other income	9	61
Total revenue from contracts with customers	1,425	1,235
Revenues outside the scope of ASC 606 (3)	96	181
Total non-interest income	1,521	1,416
Reportable Geographical Components [Member] | NEVADA
Disaggregation of Revenue [Line Items]
Service charges and fees	1,915	2,069
Debit and credit card interchange fees	376	272
Success fees (2)	0	0
Other income	23	69
Total revenue from contracts with customers	2,314	2,410
Revenues outside the scope of ASC 606 (3)	259	923
Total non-interest income	2,573	3,333
Reportable Geographical Components [Member] | Southern California [Member]
Disaggregation of Revenue [Line Items]
Service charges and fees	726	738
Debit and credit card interchange fees	173	139
Success fees (2)	0	0
Other income	9	27
Total revenue from contracts with customers	908	904
Revenues outside the scope of ASC 606 (3)	93	97
Total non-interest income	1,001	1,001
Reportable Geographical Components [Member] | Northern California [Member]
Disaggregation of Revenue [Line Items]
Service charges and fees	890	1,059
Debit and credit card interchange fees	971	837
Success fees (2)	0	2
Other income	26	73
Total revenue from contracts with customers	1,887	1,971
Revenues outside the scope of ASC 606 (3)	333	576
Total non-interest income	2,220	2,547
Corporate & Other
Disaggregation of Revenue [Line Items]
Service charges and fees	0	1
Debit and credit card interchange fees	0	0
Success fees (2)	0	0
Other income	14	5
Total revenue from contracts with customers	14	6
Revenues outside the scope of ASC 606 (3)	3,966	(98)
Total non-interest income	$ 3,980	$ (92)