The debt will mature no later than June 30, 2012, the source said. Goldman Sachs is the sole bookrunner, while Citigroup and Morgan Stanley are joint leads, the source said.
The debt is guaranteed under the FDIC's Temporary Liquidity Guarantee Program, and investors are watching the deal as a test case for demand under the new program.
The new debt is expected to price at 85 basis points over midswaps, plus or minus 3 basis points, the source said.
Goldman is expected to be the first firm to tap the FDIC's new program. The FDIC on Friday approved a program to guarantee to banks' new senior unsecured debt, potentially allowing the firms to issue debt with top "AAA" ratings.
The market could see roughly $50 billion in issuance per month until the deadline for debt issuance next June, Bank of America estimated in a report.
The TLGP is expected to fill a financing gap for banks shut out of the corporate bond market by skyrocketing yields.