New frontiers in modeling adsorption in metal-organic frameworks accounting for flexibility and accurate intermolecular interactions