This might be a fit for you: https://ese.wustl.edu/faculty-research/research-areas/Applied-Physics.html
On the whole, though, I'd take a look at materials science departments. Materials science is usually classified as "engineering," but it doesn't suck (I started out trying to double major in materials science and EE, so I say this from experience, although I'm still probably biased). Some places to get you started: MIT, Northwestern, Berkeley, Cornell, UPenn, WashU, UIUC, Vermont, UMichigan, UT Austin... It might be easier for you to get in to a materials science program with an engineering background than it would be for you to get in to an applied physics program.