In a large measuring glass with a spout, add the coffee, coconut milk, sugar and vanilla extract. Stir together until the sugar dissolves and the mixture is well incorporated.
Pour the mixture into your popsicle molds and place in the freezer. Freeze for 4 hours or until fully solid. Enjoy!