Looking for a single-family home to rent in Alexandria Bay, NY on a limited budget? Let Apartments.com help you find the perfect home that’s also affordable! Select any of the Not sure where to look? Alexandria Bay contains some fantastic neighborhoods to live in and explore. With over a million rentals to choose from, finding a cheap house for rent in Alexandria Bay is a breeze.