Broken down by chapter, this would work. You'll need to put in some overtime bringing all the pieces together, but it would work. You can have main characters from one plot be minor characters in another.
This sounds similar to 'The Slap' by Christos Tsiolkas. That said, the stories of the characters in this book are united through a shared past event.
I think you need to tie it together with either theme or plot. If its theme, it needs to be more precise than the town is weird - morality tale, statement about humanity etc. Or with plot where you tie it all together at the end. If not, then why not present it as a bunch of novellas or short stories centered around a town?
@Dunning Kruger, I was just talking about you! You're effect is all over this forum! I'm glad you finally showed up.
If the short stories are connected, the readers will expect an overarching plot. I suggest some sort of evolvement in either the world, or a character, which carries through the stories. The Last Wish by Andrzej Sapkowski was an anthalogy of short stories, set in the same world and featuring a constant protagonist. In order to tie them all together, he created a frame story which is featured in between every story.
