Not quite the only thing; having troops on your planet also helps. From the happiness file for neutral happiness type:
New Treaty Non Intercourse       := -100 
New Treaty None                  := -100
Our Troops on Planet             := -2
(negative values increase happiness).
This is the same happiness increase from troops as for the Peaceful happiness type which I usually use, and I find that a good squad of troops can do wonders.  
