Replace VarSets by SmallSet<size_t> where appropriate, in order to minimize the use of FactorGraph::findVar().
Improve SWIG interfaces and merge their build process with the main build process
Define a better fileformat for .fg files (maybe using XML)?
Add support for sparse factors.
Replace all Neighbor subclasses with a global Neighbor class, and introduce global (un)directed edge classes
Replace all Name members by virtual functions (or add virtual functions returning the Name)
Use ClusterGraph instead of a vector<VarSet> for speed.
Optimize this code for large factor graphs.
Implement GBP parent-child algorithm.