The Telegram app has the ability to run HTML5 games. I was wondering if this meant Godot web games could be published there, or if anyone had any experience publishing on Telegram?

Probably, but it's more a question of how telegram supports HTML games. I presume you really mean to ask if there's a dedicated export template specifically for targeting telegram tho, in which case I'm certainly not aware of any.