Segment Reporting (Details) - USD ($) $ in Thousands	12 Months Ended
	Dec. 31, 2015	Dec. 31, 2014	Dec. 31, 2013
Revenues:
Interest income	$ 42,281	$ 43,325	$ 44,272
Wealth management fees	4,785	4,362	3,970
Other income	5,605	10,424	20,569
Total operating income	52,671	58,111	68,811
Expenses:
Interest expense	4,207	5,243	6,567
Salaries and employee benefits	18,435	22,601	30,627
Provision for loan losses	2,293	1,960	109
Other expense	17,191	18,480	23,414
Total operating expenses	42,126	48,284	60,717
Income before income taxes	10,545	9,827	8,094
Income tax expense	2,715	2,341	1,931
NET INCOME	7,830	7,486	6,163
Non-controlling interest in consolidated subsidiary	0	98	(9)
Net income attributable to Middleburg Financial Corporation	7,830	7,584	6,154
Total assets	1,294,863	1,222,857	1,227,753
Capital expenditures	2,137	920	928
Goodwill and other intangibles	3,636	3,807	5,346
Commercial & Retail Banking [Member]
Revenues:
Interest income	42,270	43,149	43,702
Wealth management fees	0	0	0
Other income	5,605	5,349	4,527
Total operating income	47,875	48,498	48,229
Expenses:
Interest expense	4,207	5,227	6,444
Salaries and employee benefits	16,130	16,567	16,464
Provision for loan losses	2,293	1,926	105
Other expense	16,237	15,818	17,916
Total operating expenses	38,867	39,538	40,929
Income before income taxes	9,008	8,960	7,300
Income tax expense	2,131	1,894	1,608
NET INCOME	6,877	7,066	5,692
Non-controlling interest in consolidated subsidiary		0	0
Net income attributable to Middleburg Financial Corporation		7,066	5,692
Total assets	1,415,626	1,338,604	1,222,837
Capital expenditures	2,137	911	895
Goodwill and other intangibles	0	0	0
Wealth Management [Member]
Revenues:
Interest income	11	14	14
Wealth management fees	4,951	4,516	4,139
Other income	0	0	0
Total operating income	4,962	4,530	4,153
Expenses:
Interest expense	0	0	0
Salaries and employee benefits	2,305	2,262	2,187
Provision for loan losses	0	0	0
Other expense	1,120	1,140	1,195
Total operating expenses	3,425	3,402	3,382
Income before income taxes	1,537	1,128	771
Income tax expense	584	447	323
NET INCOME	953	681	448
Non-controlling interest in consolidated subsidiary		0	0
Net income attributable to Middleburg Financial Corporation		681	448
Total assets	12,461	12,953	5,909
Capital expenditures	0	6	0
Goodwill and other intangibles	3,636	3,807	3,979
Mortgage Banking [Member]
Revenues:
Interest income	0	450	1,773
Wealth management fees	0	0	0
Other income	0	5,121	16,473
Total operating income	0	5,571	18,246
Expenses:
Interest expense	0	304	1,340
Salaries and employee benefits	0	3,772	11,976
Provision for loan losses	0	34	4
Other expense	0	1,722	4,903
Total operating expenses	0	5,832	18,223
Income before income taxes	0	(261)	23
Income tax expense	0	0	0
NET INCOME	0	(261)	23
Non-controlling interest in consolidated subsidiary		98	(9)
Net income attributable to Middleburg Financial Corporation		(163)	14
Total assets	0	0	41,745
Capital expenditures	0	3	33
Goodwill and other intangibles	0	0	1,367
Intercompany Eliminations [Member]
Revenues:
Interest income	0	(288)	(1,217)
Wealth management fees	(166)	(154)	(169)
Other income	0	(46)	(431)
Total operating income	(166)	(488)	(1,817)
Expenses:
Interest expense	0	(288)	(1,217)
Salaries and employee benefits	0	0	0
Provision for loan losses	0	0	0
Other expense	(166)	(200)	(600)
Total operating expenses	(166)	(488)	(1,817)
Income before income taxes	0	0	0
Income tax expense	0	0	0
NET INCOME	0	0	0
Non-controlling interest in consolidated subsidiary		0	0
Net income attributable to Middleburg Financial Corporation		0	0
Total assets	(133,224)	(128,700)	(42,738)
Capital expenditures	0	0	0
Goodwill and other intangibles	$ 0	$ 0	$ 0