Segment Information (Details) $ in Thousands	3 Months Ended		6 Months Ended
	Jun. 30, 2021 USD ($)	Jun. 30, 2020 USD ($)	Jun. 30, 2021 USD ($) Segment	Jun. 30, 2020 USD ($)	Dec. 31, 2020 USD ($)
Segment Information [Abstract]
Number of business units | Segment			2
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	$ 404,486		$ 404,486		$ 405,187
Revenues	51,457	$ 49,737	100,532	$ 89,147
Income (loss) before income taxes	3,754	8,281	3,207	(1,946)
Operating Segments [Member] | American Southern [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	162,761		162,761		158,808
Revenues	17,522	16,896	35,048	32,123
Income (loss) before income taxes	2,073	2,087	3,563	2,965
Operating Segments [Member] | Bankers Fidelity [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	230,595		230,595		236,197
Revenues	33,680	32,871	65,220	57,744
Income (loss) before income taxes	3,377	8,039	3,511	(742)
Corporate and Other [Member]
Assets, Revenue and Income (loss) before income taxes for each business unit [Abstract]
Assets	11,130		11,130		$ 10,182
Revenues	255	(30)	264	(720)
Income (loss) before income taxes	$ (1,696)	$ (1,845)	$ (3,867)	$ (4,169)