Definitely worth it!
This tiny museum is filled with beautiful sculptures, very reminiscent of Modigliani and Brancusi. It's a great museum to go to if you feel overwhelmed by the Louvre and the other tourists. It's so small (just a few rooms and a sculpture garden) that you feel like you wandered into an artist's studio. If the weather is nice, pair this with an picnic lunch in the Luxembourg Gardens just down the street.