Segment Reporting (Details) (USD $) In Thousands, unless otherwise specified	12 Months Ended
	Dec. 31, 2013 segment	Dec. 31, 2012	Dec. 31, 2011
Segment Reporting [Abstract]
Number of reportable segments	3
INCOME:
Interest income	$ 44,272	$ 47,023	$ 48,636
Wealth management fees	3,970	3,751	3,636
Other income	20,569	25,703	16,326
Total operating income	68,811	76,477	68,598
Expenses:
Interest expense	6,567	8,824	10,691
Salaries and employee benefits	30,627	30,417	27,373
Provision for loan losses	109	3,438	2,884
Other expense	23,414	23,842	21,638
Total operating expenses	60,717	66,521	62,586
Income before income taxes	8,094	9,956	6,012
Income tax expense	1,931	1,966	1,350
NET INCOME	6,163	7,990	4,662
Non-controlling interest in consolidated subsidiary	(9)	(1,504)	298
Net income attributable to Middleburg Financial Corporation	6,154	6,486	4,960
Total assets	1,227,753	1,236,781	1,192,860
Capital expenditures	928	1,045	1,351
Goodwill and other intangibles	5,346	6,017	6,189
Commercial & Retail Banking [Member]
INCOME:
Interest income	43,702	46,095	47,080
Wealth management fees	0	0	0
Other income	4,527	4,413	3,914
Total operating income	48,229	50,508	50,994
Expenses:
Interest expense	6,444	8,433	10,374
Salaries and employee benefits	16,464	15,678	15,390
Provision for loan losses	105	3,410	3,141
Other expense	17,916	17,413	15,531
Total operating expenses	40,929	44,934	44,436
Income before income taxes	7,300	5,574	6,558
Income tax expense	1,608	1,593	1,230
NET INCOME	5,692	3,981	5,328
Non-controlling interest in consolidated subsidiary	0	0	0
Net income attributable to Middleburg Financial Corporation	5,692	3,981	5,328
Total assets	1,222,837	1,216,813	1,262,358
Capital expenditures	895	947	1,197
Goodwill and other intangibles	0	0	0
Wealth Management [Member]
INCOME:
Interest income	14	10	14
Wealth management fees	4,139	3,891	3,757
Other income	0	0	0
Total operating income	4,153	3,901	3,771
Expenses:
Interest expense	0	0	0
Salaries and employee benefits	2,187	2,208	2,369
Provision for loan losses	0	0	0
Other expense	1,195	1,300	1,232
Total operating expenses	3,382	3,508	3,601
Income before income taxes	771	393	170
Income tax expense	323	373	120
NET INCOME	448	20	50
Non-controlling interest in consolidated subsidiary	0	0	0
Net income attributable to Middleburg Financial Corporation	448	20	50
Total assets	5,909	6,416	5,975
Capital expenditures	0	0	3
Goodwill and other intangibles	3,979	4,150	4,322
Mortgage Banking [Member]
INCOME:
Interest income	1,773	2,740	2,931
Wealth management fees	0	0	0
Other income	16,473	21,787	12,543
Total operating income	18,246	24,527	15,474
Expenses:
Interest expense	1,340	2,213	1,706
Salaries and employee benefits	11,976	12,531	9,614
Provision for loan losses	4	28	(257)
Other expense	4,903	5,766	5,127
Total operating expenses	18,223	20,538	16,190
Income before income taxes	23	3,989	(716)
Income tax expense	0	0	0
NET INCOME	23	3,989	(716)
Non-controlling interest in consolidated subsidiary	(9)	(1,504)	298
Net income attributable to Middleburg Financial Corporation	14	2,485	(418)
Total assets	41,745	94,282	101,876
Capital expenditures	33	98	151
Goodwill and other intangibles	1,367	1,867	1,867
Intercompany Eliminations [Member]
INCOME:
Interest income	(1,217)	(1,822)	(1,389)
Wealth management fees	(169)	(140)	(121)
Other income	(431)	(497)	(131)
Total operating income	(1,817)	(2,459)	(1,641)
Expenses:
Interest expense	(1,217)	(1,822)	(1,389)
Salaries and employee benefits	0	0	0
Provision for loan losses	0	0	0
Other expense	(600)	(637)	(252)
Total operating expenses	(1,817)	(2,459)	(1,641)
Income before income taxes	0	0	0
Income tax expense	0	0	0
NET INCOME	0	0	0
Non-controlling interest in consolidated subsidiary	0	0	0
Net income attributable to Middleburg Financial Corporation	0	0	0
Total assets	(42,738)	(80,730)	(177,349)
Capital expenditures	0	0	0
Goodwill and other intangibles	$ 0	$ 0	$ 0