Revenue from Contract with Customers ( Disaggregation of Revenue) (Details) - USD ($) $ in Thousands	3 Months Ended
	Mar. 31, 2018	Mar. 31, 2017
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	$ 431,937	$ 392,671
Product sales revenue	241,592	245,620
Affiliate management fee revenue	5,250	3,783
Total revenue	678,779	642,074
Revenue from Contract with Customer, Including Assessed Tax	661,442
Operating Leases, Income Statement, Lease Revenue	19,462
Unrealized Gain (Loss) on Derivatives	(7,375)
Operating Segments [Member] | Refined Products Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	260,394	241,905
Product sales revenue	232,774	240,170
Affiliate management fee revenue	297	329
Total revenue	493,465	482,404
Revenue from Contract with Customer, Including Assessed Tax	495,524
Operating Leases, Income Statement, Lease Revenue	3,109
Unrealized Gain (Loss) on Derivatives	(5,465)
Operating Segments [Member] | Crude Oil Pipeline and Terminals Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	126,258	105,053
Product sales revenue	6,439	3,103
Affiliate management fee revenue	4,016	3,134
Total revenue	136,713	111,290
Revenue from Contract with Customer, Including Assessed Tax	122,497
Operating Leases, Income Statement, Lease Revenue	12,110
Unrealized Gain (Loss) on Derivatives	(1,910)
Operating Segments [Member] | Marine Storage Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	46,200	46,407
Product sales revenue	2,379	2,347
Affiliate management fee revenue	937	320
Total revenue	49,516	49,074
Revenue from Contract with Customer, Including Assessed Tax	44,336
Operating Leases, Income Statement, Lease Revenue	4,243
Unrealized Gain (Loss) on Derivatives	0
Intersegment Eliminations [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	(915)	(694)
Product sales revenue	0	0
Affiliate management fee revenue	0	0
Total revenue	(915)	$ (694)
Revenue from Contract with Customer, Including Assessed Tax	(915)
Operating Leases, Income Statement, Lease Revenue	0
Unrealized Gain (Loss) on Derivatives	0
Transferred over Time [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	431,937
Transferred over Time [Member] | Transportation [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	246,025
Transferred over Time [Member] | Terminalling [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	40,060
Transferred over Time [Member] | Storage [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	88,533
Transferred over Time [Member] | Ancillary Services [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	37,857
Transferred over Time [Member] | Lease Revenue [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	19,462
Transferred over Time [Member] | Operating Segments [Member] | Refined Products Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	260,394
Transferred over Time [Member] | Operating Segments [Member] | Crude Oil Pipeline and Terminals Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	126,258
Transferred over Time [Member] | Operating Segments [Member] | Marine Storage Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	46,200
Transferred over Time [Member] | Operating Segments [Member] | Transportation [Member] | Refined Products Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	166,902
Transferred over Time [Member] | Operating Segments [Member] | Transportation [Member] | Crude Oil Pipeline and Terminals Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	79,123
Transferred over Time [Member] | Operating Segments [Member] | Transportation [Member] | Marine Storage Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	0
Transferred over Time [Member] | Operating Segments [Member] | Terminalling [Member] | Refined Products Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	39,348
Transferred over Time [Member] | Operating Segments [Member] | Terminalling [Member] | Crude Oil Pipeline and Terminals Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	0
Transferred over Time [Member] | Operating Segments [Member] | Terminalling [Member] | Marine Storage Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	712
Transferred over Time [Member] | Operating Segments [Member] | Storage [Member] | Refined Products Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	25,247
Transferred over Time [Member] | Operating Segments [Member] | Storage [Member] | Crude Oil Pipeline and Terminals Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	29,990
Transferred over Time [Member] | Operating Segments [Member] | Storage [Member] | Marine Storage Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	34,211
Transferred over Time [Member] | Operating Segments [Member] | Ancillary Services [Member] | Refined Products Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	25,788
Transferred over Time [Member] | Operating Segments [Member] | Ancillary Services [Member] | Crude Oil Pipeline and Terminals Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	5,035
Transferred over Time [Member] | Operating Segments [Member] | Ancillary Services [Member] | Marine Storage Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	7,034
Transferred over Time [Member] | Operating Segments [Member] | Lease Revenue [Member] | Refined Products Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	3,109
Transferred over Time [Member] | Operating Segments [Member] | Lease Revenue [Member] | Crude Oil Pipeline and Terminals Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	12,110
Transferred over Time [Member] | Operating Segments [Member] | Lease Revenue [Member] | Marine Storage Segment [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	4,243
Transferred over Time [Member] | Intersegment Eliminations [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	(915)
Transferred over Time [Member] | Intersegment Eliminations [Member] | Transportation [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	0
Transferred over Time [Member] | Intersegment Eliminations [Member] | Terminalling [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	0
Transferred over Time [Member] | Intersegment Eliminations [Member] | Storage [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	(915)
Transferred over Time [Member] | Intersegment Eliminations [Member] | Ancillary Services [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	0
Transferred over Time [Member] | Intersegment Eliminations [Member] | Lease Revenue [Member]
Disaggregation of Revenue [Line Items]
Transportation and terminals revenue	0
Transferred at Point in Time [Member]
Disaggregation of Revenue [Line Items]
Product sales revenue	241,592
Transferred at Point in Time [Member] | Operating Segments [Member] | Refined Products Segment [Member]
Disaggregation of Revenue [Line Items]
Product sales revenue	232,774
Transferred at Point in Time [Member] | Operating Segments [Member] | Crude Oil Pipeline and Terminals Segment [Member]
Disaggregation of Revenue [Line Items]
Product sales revenue	6,439
Transferred at Point in Time [Member] | Operating Segments [Member] | Marine Storage Segment [Member]
Disaggregation of Revenue [Line Items]
Product sales revenue	2,379
Transferred at Point in Time [Member] | Intersegment Eliminations [Member]
Disaggregation of Revenue [Line Items]
Product sales revenue	$ 0