Trying to build modules from the respective OLPC-kernel SRPMs I find that if you build the whole kernel and then just copy the module over and insmod during init works [1], but if you build only the module quite often does not.(???)
[1] http://www.olpcnews.com/forum/index.php?topic=4623