Explore details about location 4th Avenue. 4th Avenue is a location situated within the Middlesex County alongside other areas such as Vincent Court, Railroad Avenue, Comstock Bridge Road. Additionally, some smaller parts of 4th Avenue include specific areas like Chester Bowles Hwy adding to the diversity of its landscape.