The new Ukrainian prime minister has said that embattled Crimea must remain part of Ukraine, but may be granted more local powers.