I think long pants and a button up shirt is fine.
In my opinion, people in EEB are some of the least dressed up academics so you would probably be fine. Say that if this was law school, one shirt probably wouldn't cut it.
On another note, thanks for this announcement. I'm also applying to Yale EEB and was wondering when they are sending interview invites.