The con has grown considerably between my first year there and the last few years. It used to be you could get a hotel room at a host hotel in the spring and now they are sold out within days of being available for reservations. And it was easy to hang out in the Marriott lobby and find people and talk. Now it's shoulder to shoulder at night.
However! I stayed at the Sheraton for the first time last year and HUGE difference from the Marriott. I could definitely envision a meet up happening there where you can hear the person you are talking to. ;) And, should Jamie make it this year, I'd be happy to open up a discussion post where people could arrange smaller meet ups and I could see about organizing a larger get together. Of course, with people wanting to attend panels and other events, it's always tricky to herd a large group of people.
You'll also find yourself talking to whoever you are standing next to in line as you wait to get into a panel. :)