I am no lawyer, either, but in the United States it would not fly as trademark infringement. It would be a nuisance lawsuit,and a judge could fine the plaintiff for filing a frivolous lawsuit. As digitig and Gallowglass said, French law might differ.
I haven't checked, but since status and image are so vitally important to French firms, I wouldn't be the least bit surprised if they were able to pursue a lawsuit for defamation...good luck to them...
Mine is memoir and I do mention some nightclubs and restaurants and landmarks in the area by name. There is a scene set in a park on a university campus, and one in a diner, and I do use street names too. Its a true story that happened in Richmond, VA, and I'm keeping the hometown pride alive. But there were some names and places that were changed, considering the main plot of my story centers around a local establishment and its staff. I tried to make it as anynomous as possible
if you fictionalize anything, then it's no longer a 'memoir' is it?... and given that all the rest is told as it happened, with real names and such, people who know you and/or were around at the time will be able to figure out what place and who you mean, anyway, so what purpose is served by changing some names?... if you're worried about being sued by those who don't want you writing about them, that won't protect you from a court battle... you need to consult a literary attorney before submitting this work, if you want to cover your tush legally...
