YouTube will let users download content for playback within 48-hour period. This means you will be able to look at videos on offline mode. However one of the biggest contributor of music videos Vevo is not in the game and will not let you watch their videos offline.
Variety: Why YouTube Offline Videos Won’t Be a Game-Changer
Variety: Vevo Will Block YouTube’s Offline-Video Viewing Feature