Not physically attracted to my BF?? Will it work?

Yes, break up. Dating someone you aren't attracted to just to prove you aren't shallow is about as shallow as it gets.