Anything can be captioned. 

echo "i have a caption!"
captioned soure block
https://placekitten.com/200/200#.png
captioned link (image in this case)

note that the whole paragraph is captioned, so a linebreak is needed for images to caption correctly

https://placekitten.com/200/200#.png see?

captioned link (image in this case)