Cryptocurrency exchange Gemini has hired an executive from a Nasdaq company as it seeks to attract more institutional clients.