At the end, when Venice Beach Girl comes back to return all the stuff she stole from Hank, Mia narrates the line "here we are, she thought, at the edge of the world and all of western civilization". This is a lyric from the song Californication by Red Hot Chili Peppers. The song references California as the "edge of the world and all of western civilization".
When Hank's talking to the Venice Beach surfer girl, he advises "Life'll Kill Ya" which is the title of Warren Zevon's album on which 'Don't Let Us Get Sick' (performed in this episode) is featured. Also another song from the album is featured later in this season.