The Art Of Pop Video, by Michael P Aust and Daniel Kothenschulte, is the catalogue of an exhibition that opened in Germany in 2011 and transferred to the UK in 2013. The book (accompanied by a DVD) includes several short essays, and features images from more than 100 music videos. (Each video is represented by a grid of twelve small screenshots, arranged like a storyboard.)
Experimental films by Man Ray and Len Lye are included, as is the Bob Dylan documentary Dont Look Back (described as the "most quoted music video of all times"). Most of the videos are from the MTV era, such as Michael Jackson's Thriller ("the first music video blockbuster") and Madonna's Express Yourself (inspired by Metropolis; directed by David Fincher).
Michael Shore's Rolling Stone Book Of Rock Video has more background on the history of music videos (including earlier formats such as Soundies and Scopitones), though it was published in 1984. The Art Of Pop Video is therefore more up-to-date, and it has many more illustrations.