I don't just mean the practical "it could hunt me down and maul me" danger of creatures like crocodiles, lions, tigers and bears. I mean something alien, like if you were hiking through the woods and saw a random new creature that you had never seen before. What kind of physical features would make this thing seem horrifying, like a monster that would make your heart drop and make you run like the wind? Instead of a reaction more like "Ooh, interesting, what kind of animal is that?" or "Huh, must be a unique local species." Again, something more unnatural and off-beat than the practical dangerous features of the predatory animals in our world that we know. If you came across a large bear in the woods, sure you'd be scared of getting hurt, but I'm looking for that extra level of "horror movie factor." A real-life bear would be scary if it entered your camping tent, but looking at Google Images of bears and reading about bears in nature books doesn't invoke fear. I'm looking for something where even its picture or video would make you feel creeped out. Know what I mean?
Google some of the creepy shit that lives at the bottom of the ocean for ideas. I love those creepy bastards but I gather that most people don't so much. When it comes to scary creatures design, if you want it to hit as many people as possible, you have to cast a wide net. Most people are suceptible to the uncanny valley, so there's something to be said for things that seem normal but have just one thing off. Are you familiar with smiledog? It's that shoop of a dog with human teeth. It's been around for ages so I think most people are desensitized to it specifically, but it's a good illustration of the idea. There's also irl a fish that has very human-looking teeth (that's the ocean for ya). Maned wolves look like someone stretched out a fox and some people find them unsettling. On the thought of bears, though, check out what they look like with mange. It's not really uncanny, but they do kinda stop looking like bears. That's what I'd aim for. Take something that's real - scary or not - and add something that doesn't belong - scary or not. Or, take something away. Or both! It's juxtaposition. A bear with human fingers, or without a head, or an ordinary bear where there should be no bear, like in the elevator of your office building. I think it's a lot easier to tailor creepy critters to a specific audience. Have a theme. The sex and pregnancy themes in Alien, for instance. Another gross thing that came to mind is teratomas. They're a type of tumor that basically randomly grow shit like teeth, hair, and eyeballs anywhere in your body. Again - it's stuff where it shouldn't be, just body horror instead of the uncanny valley angle. Less unsettling, more repulsive. Depends on what exactly you're going for. A bear, but it's hairless with mange, human teeth are sprouting from its spine, and there are no eyes in its face but clusters of them, blue and cloudy, dotting its body.
It depends on size relative to me. Scary smaller creatures have multiple legs and appendages that stab, grab, sting, or slice. Or they have slithering bodies difficult to get away from. Or they fly with the ability to bite or latch onto something. Anthropomorphic creatures can be scary if they are human-like, yet too distorted to be confused as human. Stories of humans mating with animals and having offspring freak me out: pig-man, dog-girl, etc. Multiple heads, or the ability to mimic me in appearance and speech can be spooky. I scream like a little girl if a wasp lands on me.
Part of it's what I can't see - seeing bits of a snake with other bits hidden by foliage is creepier than seeing the whole snake. Certain ways of moving are creepy (slithering, or anything that seems "unnatural" and stilted, but still fast). Sliminess is bad. Things that look like they'd smell bad or like their flesh would feel wrong... Yeah, I'm mostly with @izzybot - it's the wrongness that creeps me out. I'm not scared of bears. But a hairless bear with slimy skin? Yikes.
I think people have a primal fear of being devoured. So a creature that appears like it is carnivorous to a major extent... I think darker coloration and possibly slimy. Foul odor that can be described might help. Fetid breath, for example--where fetid means nasty or unpleasant. Or description such as: smelled like it normally fed from barrel of raw sewage spiced with rotting pig intestines. In the end, a reader's imagination will go further than any detailed description could do. So, saying a little and letting the reader's imagination run with it, will make the creature as frightening within the description as possible.
I was working on beasties and the rabbit hole led me to shaved primates and bears. They really look alien.
You'd probably want to try invoking the uncanny valley and the fear of the unknown. Maybe describe vaguely human features with subtle details that something isn't quite right.
Some feature (which I'll leave up to you) that makes the creature resilient and if it catches you, you will die a very painful death. Don't shed too much light on it, fear of the unknown is powerful. This stuff is basic though, it all depends on the context I imagine.
A very alien creature, with features that aren't comparable to any animal on earth. It's hard to tell if it's intelligent or not, but it needs to be immediately threatening. Maybe its mouth is on its chest, an oval with rows and rows of razor-sharp teeth. Perhaps its body bends and contorts in ways that aren't consistent with a vertebrate. Maybe it doesn't have eyes, or at least visible eyes, and relies on detecting electric currents in its prey, or echolocation.
Lamprey mouths and hatchetfish eyeballs (and gaping maws) freak me out. The former has too many teeth and the latter... I guess since their "expressions" can be human like as in they seem to be in unimaginable pain or screaming in abject terror.
I think that the eyes of a predator are the most alarming. Tiger eyes freak me out really badly. Maybe go with something that has a really intense gaze. The sensation of being watched majorly freaks people out.
I can't speak for tigers but I've come across a mountain lion or two at night, and those glowing eyes are freaky as fuck!
Yeah they really are scary! I saw wolf eyes once in Montana many years ago, it was really terrifying too. Ughh
Anything insectile would get me. If I saw something like, let's say a roach the size of a dinner plate, I would run and keep running. Doesn't matter what it's doing, I'm gone. Because there could be a nest, you see.
Definitely this. To me, Uncanny Valley is more terrifying than any animal I've ever seen. Need an example? Watch this: This is pretty much my nightmare fuel.
For me it's a way of movement. If the thing moves with precision, with a controlled surety, a primal instinct kicks in and I automatically assume 'danger'. The extent of my reaction depends on who/what the thing is looking at/moving towards.
Something vaguely arachnoid, combined with something vaguely human-skeleton-like, would combine some of my fear buttons....
Teeth. Human teeth. Not in its mouth, but on its face. Like that fake hyperdontia picture. If you don't feel too freaked out by teeth, look here: https://videos.deathaddict.com/2017/05/28488_teeth.jpg They don't have to be REAL human teeth, but can be any kind of alien surface structure that looks a bit alike. Or another skin/shell/surface pattern that evokes trypophobia. Like this: http://images.mentalfloss.com/sites/default/files/67867-istock-616012888_0.jpg?resize=1100x740 Bonus points if things come crawling out of it. What if coral have evolved into sentient beings and now want to colonize Earth? Their surface houses polyps that grab insects and other yummi foodstuffs out of the air. ^ ^
wide, unblinking eyes that show too much white and a smile that's too large gives me the heebie jeebies. but having it just standing there isn't gonna cut it. imagining its hot breath half an inch from my ear or being backed in to an inescapable corner as it advances slowly is what gets my pulse racing. something that invades my impression of personal space or sense of safety. sometimes the best monsters are the ones that don't look like one.
For me personally, the closer something is to human while still not quite fitting into the role, the more terrifying it comes off as. Things like tall humanoid beings with blacked out eyes and unnaturally lithe limbs are a good example appearance-wise.
The eyes are a major part in how people connect with each other and understand each other. If you take away the eyes from your creature, or hide them in some way, you're taking away that potential connection. That's one reason why H.R. Giger's alien's were terrifying, they didn't appear to have eyes, but could still very easily find you and kill you. Monsters that mimic or resemble humans in some way are terrifying. If they move in a way that seems inhuman or is slightly off from typical human movement, it's pretty nerve-wracking. Strange noises during the movement is even worse, such as popping of joints or scrabbling claws makes it even worse. Giving the monster a pungent or rotted smell may be a good touch for horror effects. Probably the most horrifying things I've seen, when done right, are pure or cute things that have been corrupted in someway and become twisted. The Crawlers and Lurkers, from the Dead Space games, are a good example of this. They're babies infected with an alien virus that crawl on the ground, walls, and ceilings, and either explode or impale you with long and grotesque tentacle arms. While I generally follow those concepts when designing horror monsters, you can pretty much turn anything into something gut wrenching with enough thought. =)