Run it through xpra - and disconnect (after filling it with links). The system will swap X away when it needs RAM.