The new head of Taiwan's central bank said in a brief speech on Monday that his agency will eye on blockchain to improve the payment system in Taiwan.