Memory Reinforced Networks