Investment Securities - Components of Non-marketable and Other Equity Securities (Details) - USD ($) $ in Thousands	Mar. 31, 2020	Dec. 31, 2019
Investment Holdings [Line Items]
Investments in qualified affordable housing projects, net	$ 500,802	$ 458,476
Non-marketable and other equity securities	1,200,595	1,213,829
Fair value accounting | Consolidated venture capital and private equity fund investments
Investment Holdings [Line Items]
Nonmarketable securities	85,336	87,180
Fair value accounting | Unconsolidated venture capital and private equity fund investments
Investment Holdings [Line Items]
Nonmarketable securities	171,930	178,217
Fair value accounting | Equity securities
Investment Holdings [Line Items]
Other equity securities in public companies (fair value accounting)	26,899	59,200
Fair value accounting | Other investments
Investment Holdings [Line Items]
Nonmarketable securities	52,666	55,255
Equity method accounting | Consolidated venture capital and private equity fund investments
Investment Holdings [Line Items]
Nonmarketable securities	206,495	215,367
Equity method accounting | Unconsolidated venture capital and private equity fund investments
Investment Holdings [Line Items]
Nonmarketable securities	206,495	215,367
Equity method accounting | Debt funds
Investment Holdings [Line Items]
Nonmarketable securities	6,910	7,271
Equity method accounting | Other investments
Investment Holdings [Line Items]
Nonmarketable securities	$ 149,557	$ 152,863