One of the best server provider and cheap in France is Kimsufi, a subcontractor of OVH, another worldwide server providers. They offer dedicated server and VPS.
There's also SoYouStart, better config (RAM greater than 32GB) but a little more expensive.
I'd check for other server hosting in others country like Canada, Russia but the final fiat money price was always greatter than the price of some server hosting in France.