Everyone seems to be having issues getting it up! See what I did there? However, my window doesn't seem to want to go down, at least not on it's own. I need to use my hand to actually move it down once I've pushed the switch to where it should be down. Can I safely assume the actuator has a broken gear and needs to be replaced or is it simpler/more complicated?

 

Sounds like it. The teeth are surprisingly small. I've replaced both mechanisms in my front doors. My passenger side window just randomly free fell right down while driving one day.