Many banks in the U.S. require an SSN to open an account.  Two banks in Charlottesville will open accounts for you using your passport and DS-2019:

Bank of America

Wells Fargo

Both banks have branch offices adjacent to the University. Bank of America has an office on Grounds in Newcomb Hall.