Scientists have found sperm in fossilised ostracods estimated at 17 million years old in what was a bat roosting cave in Queensland:  

http://www.abc.net.au/science/articles/2014/05/14/4003454.htm#.U3MyPpWOixU.email