I have to say in my experience the saddest anime in the whole world is 'Graveyard of the Fireflies'. I don't know anyone who has watch this and not tear up. I mean the music and the plot is haunting.
In the beginning of the movie you see the main character, who is a young boy' die from in a public subway only to be reunited with the ghost of his baby sister. So, you basically know how this film is going to end. Then you have to sit there and watch the life of two children during World War II Japan.
I don't know about you but watching a little girl slowly die makes you tear up. Not to mention the freaking music does not help it one bit. I managed to watch the live version of the film, but it doesn't hold candle to the anime. Probbably because of the music.
Watch the film and try not to cry and if you don't... You have no heart!
.