German Chancellor Angela Merkel told Russian President Vladimir Putin on Sunday that she considered the referendum being held in Crimea this month on joining Russia was "illegal".