Yes, you can just use mammoths against the AI and win. I ran my first SP game this way because I didn't know how to use magic effectively. Though I suppose you could just not recruit them since you are trying to challenge yourself.
You could even remove the unit entirely with a mod.