A Wigan grandad whose surprise cancer diagnosis sparked a major charity challenge has spoken of his bitter disappointment at having to abandon it with just weeks to go.