Semaeval is a python package to evaluate the quality of semantic engines. It supports evaluation of the natural language processing capabilities of many engines like alchemyapi, semantria, textrazor. It also offers tools to get example texts in many languages from sources like Welt.de, Huffingtonpost.fr or Fakt.pl.