Used a 360 for years, still have two since SO has one and I was recently given one, and use them regularly, the tile layout actually works quite nicely with a controller.
Windows Phone are so bad that I'm pretty sure the world is a slightly worse place just because they exist. iOS is great for 90% of people and Android fills in the missing features for people who do shit like download APKs off the internet.
Saying you don't mind Windows 8.1 is worse than pineapple on pizza, you truly are a heretic. I tried using a friends computer with Windows 8.1 on it once, I'd rather computers never be invented than have to put up with that pile of shit.